bitlybot
Last updated 13 hours ago.
What is bitlybot?
About
bitlybot is a fetcher operated by Bitly. It's not currently known to be artificially intelligent or AI-related. If you think that's incorrect or can provide more detail about its purpose, please contact us.
Track bitlybot Visiting Your Website
You can see when bitlybot visits your website using the API or WordPress plugin.
Detail
Operator | Bitly |
Type
Fetcher
Fetches web content on behalf of an app
Expected Behavior
Fetchers visit websites on-demand. They're normally dispatched by apps to present metadata about a link (e.g. the title and thumbnail image) to a user.
Insights
bitlybot's Activity on Your Website
Other Websites
Access Control
Should I Block bitlybot?
Probably not. If you block a fetcher, it won't be able to fetch the metadata it needs to display a link preview. Fewer people will click on the link to your website without this.
Using Robots.txt
User Agent Token | Description |
---|---|
bitlybot |
Should match instances of bitlybot |
You can block bitlybot or limit its access by setting user agent token rules in your website's robots.txt.
# robots.txt
# This should block bitlybot
User-agent: bitlybot
Disallow: /