Twitterbot
Operated by X. Last seen today.
What is Twitterbot?
About
Twitterbot is a fetcher operated by X. It's not currently known to be artificially intelligent or AI-related. If you think that's incorrect or can provide more detail about its purpose, please contact us.
Detail
| Website | https://developer.twitter.com/en/docs/twitter-for-websites/cards/guides/troubleshooting-cards |
Type
Fetcher
Fetches web content on behalf of an app
Expected Behavior
Fetchers visit websites on-demand. They're normally dispatched by apps to present metadata about a link (e.g. the title and thumbnail image) to a user.
Insights
Other Websites
Access Control
Should I Block Twitterbot?
Probably not. If you block a fetcher, it won't be able to fetch the metadata it needs to display a link preview. Fewer people will click on the link to your website without this.
Using Robots.txt
| User Agent Token | Description |
|---|---|
Twitterbot |
Should match instances of Twitterbot |
You can block Twitterbot or limit its access by setting user agent token rules in your website's robots.txt.
# robots.txt
# This blocks Twitterbot
User-agent: Twitterbot
Disallow: /