Dark Visitor
What is Dark Visitor?
About
Dark Visitor is a web crawler operated by Dark Visitors, designed to collect data from various online sources for analysis and reporting. You can see how often Dark Visitor visits your website by setting up Dark Visitors agent analytics.
Expected Behavior
Fetchers visit websites on-demand. They're normally dispatched by apps to present metadata about a link (e.g. the title and thumbnail image) to a user.
Type
Detail
Operated By | Dark Visitors |
Last Updated | 17 hours ago |
Insights
Top Website Robots.txts
Country of Origin
Global Traffic
The percentage of all internet traffic coming from Fetchers
Robots.txt
Should I Block Dark Visitor?
Probably not. If you block a fetcher, it won't be able to fetch the metadata it needs to display a link preview. Fewer people will click on the link to your website without this.
How Do I Block Dark Visitor?
You can block Dark Visitor or limit its access by setting user agent token rules in your website's robots.txt. Set up Dark Visitors agent analytics to check whether it's actually following them.
User Agent String | Mozilla/5.0 (compatible; Dark Visitor/1.0; +https://darkvisitors.com) |
# robots.txt
# This should block Dark Visitor
User-agent: Dark Visitor
Disallow: /