OAI-SearchBot
Last updated 17 hours ago.
What is OAI-SearchBot?
About
OAI-SearchBot is used to create an index of websites that can be surfaced as results in OpenAI's SearchGPT product.
Track OAI-SearchBot Visiting Your Website
You can see when OAI-SearchBot visits your website using the API or WordPress plugin.
Detail
Operator | OpenAI |
Documentation | https://platform.openai.com/docs/bots |
Type
AI Search Crawler
Indexes web content for AI-powered search results
Expected Behavior
AI search crawlers do not adhere to a fixed visitation schedule for websites. The frequency of visits varies widely based on many factors, and can even happen on-demand in response to a user query.
Insights
OAI-SearchBot's Activity on Your Website
Other Websites
Access Control
Should I Block OAI-SearchBot?
Probably not. AI search crawlers power AI search engines, which are a useful way for users to discover your website. AI search engine assistants usually cite their sources and provide links to their results.
Using Robots.txt
User Agent Token | Description |
---|---|
OAI-SearchBot |
Should match instances of OAI-SearchBot |
You can block OAI-SearchBot or limit its access by setting user agent token rules in your website's robots.txt.
# robots.txt
# This should block OAI-SearchBot
User-agent: OAI-SearchBot
Disallow: /