GPTBot
OpenAI's crawler used to collect publicly available web content that may be used to improve future models; controllable via robots.txt.
GEO AIUser-triggered fetcher
ChatGPT-User
OpenAI's agent that fetches a specific page in real time because a user or an agentic task requested it, rather than for indexing or training.
In full
User-triggered fetches are one-off requests on behalf of a person, analogous to Google's user-triggered fetchers. Blocking them means a user who explicitly asks the assistant to read your page gets nothing, which is usually undesirable even for publishers who block training. Traffic from these agents shows in logs but rarely in analytics, since they typically do not execute the JavaScript that analytics depends on.
Example
A user pastes a URL and asks for a summary; the request appears in server logs as ChatGPT-User seconds later.
Related terms
OAI-SearchBot
OpenAI's crawler that builds the search index used to surface and link websites in ChatGPT search results; distinct from the training…
Agentic browsing
AI systems that navigate websites on a user's behalf — reading pages, filling forms, comparing options and sometimes completing…
AI referral traffic
Visits arriving from AI assistants and answer engines, identifiable in analytics by referrer hosts such as chatgpt.com, perplexity.ai…
Log file analysis
Examining raw server access logs to see exactly which URLs crawlers fetched, how often, with what status codes and response times.
Where to read more
- Overview of OpenAI Crawlers · Documentation · developers.openai.com