HeadlessChrome
What is HeadlessChrome?
About
Headless Chrome is a tool provided by Google's open source Chromium project. It gives other software the ability to render web pages in full detail. One of the most common use cases is enabling AI agents to browse the internet through libraries like Playwright and Puppeteer. You can see how often HeadlessChrome visits your website by setting up Dark Visitors Agent Analytics.
Expected Behavior
The behavior of headless agents generally depends who is using them and what exactly they're using them for. Patterns could vary significantly depending whether the operator is human-guided software (e.g. performance testing), or an autonomous AI agent acting like a human.
Type
Detail
| Last Updated | 26 minutes ago |
Insights
Top Website Robots.txts
Country of Origin
Global Traffic
The percentage of all internet traffic coming from Headless Agents
Top Visited Website Categories
Robots.txt
Should I Block HeadlessChrome?
Probably not. Headless agents normally don't follow robots.txt rules anyway.
How Do I Block HeadlessChrome?
You can block HeadlessChrome or limit its access by setting user agent token rules in your website's robots.txt. Set up Dark Visitors Agent Analytics to check whether it's actually following them.
# In your robots.txt ...
User-agent: HeadlessChrome # https://darkvisitors.com/agents/headlesschrome
Disallow: /
⚠️ Manual Robots.txt Editing Is Not Scalable
New agents are created every day. We recommend setting up Dark Visitors Automatic Robots.txt if you want to block all agents of this type.