Cookiebot
What is Cookiebot?
About
Cookiebot is a compliance scanner that automatically crawls websites to detect and categorize cookies and tracking technologies, ensuring GDPR compliance by identifying data collection practices for consent management. You can see how often Cookiebot visits your website by setting up Dark Visitors agent analytics.
Expected Behavior
Security scanners do not follow a predictable schedule when visiting websites. Their scans can be one-time, occasional, or recurring depending on the purpose of the scanner and the organization's security practices. The frequency and depth of their scans can vary based on factors like the visibility of the site on the public internet, past scan results, and inclusion in external threat intelligence feeds.
Type
Detail
Operated By | Cybot A/S |
Last Updated | 10 hours ago |
Insights
Top Website Robots.txts
Country of Origin
Global Traffic
The percentage of all internet traffic coming from Security Scanners
Robots.txt
Should I Block Cookiebot?
Probably not. Security scanners can be beneficial, especially if they're configured to report issues back to you.
How Do I Block Cookiebot?
You can block Cookiebot or limit its access by setting user agent token rules in your website's robots.txt. Set up Dark Visitors agent analytics to check whether it's actually following them.
User Agent String | Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; Cookiebot/1.0; +http://cookiebot.com/) Chrome/129.0.6668.29 Safari/537.36 |
# robots.txt
# This should block Cookiebot
User-agent: Cookiebot
Disallow: /