[invisit](https://invisit.dev) · [Docs](https://invisit.dev/docs) · [llms.txt](https://invisit.dev/llms.txt) · [llms-full.txt](https://invisit.dev/llms-full.txt)

# GPTBot

> GPTBot is an AI training crawler run by OpenAI. It crawls content that may be used to train OpenAI's generative AI foundation models. Disallowing it tells OpenAI your content should not be used for that training.

- Operator: OpenAI
- Kind: AI training crawler
- robots.txt token: GPTBot
- Follows robots.txt: yes
- Source: https://platform.openai.com/docs/bots (checked 2026-11-05)
- Page: https://invisit.dev/bots/gptbot

## What is GPTBot?

It crawls content that may be used to train OpenAI's generative AI foundation models. Disallowing it tells OpenAI your content should not be used for that training.

Collects pages to train language models. Blocking it keeps your pages out of future training data, and does not remove you from AI search answers.

Blocking GPTBot does not remove a site from ChatGPT search; OpenAI controls that separately with OAI-SearchBot.

- [OpenAI’s documentation](https://platform.openai.com/docs/bots)

## GPTBot user agent

OpenAI documents this user agent for GPTBot. Version numbers in it change over time, so match on the name, not the whole string.

```
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; GPTBot/1.4; +https://openai.com/gptbot
```

## Should you block GPTBot?

Block it if you don’t want your pages used to train models; nothing else changes. Allow it if you’d rather future models know your product, docs or writing.

## How to block GPTBot in robots.txt

Add a group for its token to robots.txt at the root of your site.

A bot follows only the group that names it, so it ignores your `User-agent: *` rules once it has a group of its own. Repeat any paths you also want kept from it there.

```
User-agent: GPTBot
Disallow: /
```

- [Build a robots.txt for AI bots](https://invisit.dev/tools/robots-txt-generator)

## How to verify a request is really GPTBot

Anyone can send any user agent, so the string alone proves nothing.

OpenAI publishes the IP ranges GPTBot crawls from. A request that claims to be GPTBot from any other address is not GPTBot.

- [GPTBot IP ranges](https://openai.com/gptbot.json)

## See when GPTBot reads your site

Bots don’t run JavaScript analytics, so a script tag never sees them. invisit records crawler reads on the server instead, through its server SDK or a Cloudflare Worker, and shows which bots read which pages, next to your visitors.

- [Track crawlers with invisit](https://invisit.dev/docs/server/sdk#crawler-reads)

## Common questions

### What is GPTBot?

GPTBot is an AI training crawler run by OpenAI. It crawls content that may be used to train OpenAI's generative AI foundation models. Disallowing it tells OpenAI your content should not be used for that training.

### Is GPTBot safe to block?

Block it if you don’t want your pages used to train models; nothing else changes. Allow it if you’d rather future models know your product, docs or writing.

### How do I block GPTBot?

Add “User-agent: GPTBot” followed by “Disallow: /” to your robots.txt.