Applebot
Operated by Apple. Last seen today.
What is Applebot?
About
Applebot is a web crawler used by Apple to index search results that allow the Siri AI Assistant to answer user questions. Siri's answers normally contain references to the website.
Detail
| Website | http://apple.com/go/applebot |
Type
AI Search Crawler
Indexes web content for AI-powered search results
Expected Behavior
AI Search Crawlers do not adhere to a fixed visitation schedule for websites. The frequency of visits varies widely based on many factors, and can even happen on-demand in response to a user query.
Insights
Other Websites
Access Control
Should I Block Applebot?
Probably not. AI search crawlers power AI search engines, which are a useful way for users to discover your website. AI search engine assistants usually cite their sources and provide links to their results.
Using Robots.txt
| User Agent Token | Description |
|---|---|
Applebot |
Should match instances of Applebot |
You can block Applebot or limit its access by setting user agent token rules in your website's robots.txt.
# robots.txt
# This blocks Applebot
User-agent: Applebot
Disallow: /