SurdotlyBot
Last updated 17 hours ago.
What is SurdotlyBot?
About
SurdotlyBot is a fetcher operated by Sur.ly. It's not currently known to be artificially intelligent or AI-related. If you think that's incorrect or can provide more detail about its purpose, please contact us.
Track SurdotlyBot Visiting Your Website
You can see when SurdotlyBot visits your website using the API or WordPress plugin.
Detail
Operator | Sur.ly |
Documentation | http://sur.ly/bot.html |
Type
Fetcher
Fetches web content on behalf of an app
Expected Behavior
Fetchers visit websites on-demand. They're normally dispatched by apps to present metadata about a link (e.g. the title and thumbnail image) to a user.
Insights
SurdotlyBot's Activity on Your Website
Other Websites
Access Control
Should I Block SurdotlyBot?
Probably not. If you block a fetcher, it won't be able to fetch the metadata it needs to display a link preview. Fewer people will click on the link to your website without this.
Using Robots.txt
User Agent Token | Description |
---|---|
SurdotlyBot |
Should match instances of SurdotlyBot |
You can block SurdotlyBot or limit its access by setting user agent token rules in your website's robots.txt.
# robots.txt
# This should block SurdotlyBot
User-agent: SurdotlyBot
Disallow: /