About
The Company
Dark Visitors is built in New York City by a team with experience building things at Instagram, Meta, Vimeo, PayPal, Intuit, and various startups. If you want to reach out, feel free to send an email.
The Product
Half of your traffic is invisible to you. Get realtime insight into the hidden ecosystem of artificial agents scraping, crawling, archiving, and gathering intelligence on your website.
Features
- Keep Your Robots.txt Updated Automatically: Use the API or WordPress plugin to continuously generate a robots.txt that stays up to date with the latest AI agents.
- Expose Your Hidden Traffic With Agent Analytics: Watch the activity of AI assistants, scrapers, and other bots swarming across your website in real time.
- Protect Your Content From Scraping: Block agents who try to ignore your robots.txt rules. Opt out of LLM training and save server costs.
- Spot Spoofed Visits With Agent Verification: Detect bad actors who try to disguise their visits as legitimate agents.
- Get Spike Alert Notifications: Find out when an agent's traffic starts surging and causing high server load.
- Identify Top Agents and Pages: See which agents visit your website the most, and which pages they're most interested in.
- Connect Your Website in Seconds: Use either the API or the WordPress plugin.
Links to demos can be found on the home page.
Website Owner FAQ
Is Dark Visitors free?
Dark Visitors is a freemium service. Most features are free, but you can choose to pay for premium features. More detail can be found on the pricing page.
What are some examples of agents?
Examples include GPTBot, CCBot, Claudebot, PerplexityBot, Googlebot, etc. See the full agent list for more.
Why should I care about agents?
There are many reasons. Their activity affects:
- Whether your content is used in AI model training
- If your users can use AI assistants to access your website
- How your pages appear in search engine results
- Server resource usage
- Etc.
Agent Operator FAQ
How do I add my agent?
Please send us an email, and we'll add a page for it.
Why should I add my agent?
Your agent page will help promote it to new users. It also gives website owners visibility into what it's doing, so they can better optimize for it.
Screenshots
An overview of all agent activity on the website
A timeline of all agent visits to the website
Insights into an agent's activity on the website
Insights into agents who are not following the website's robots.txt rules
Agent details including insight into how many websites are blocking it
A generated robots.txt