Dark Visitors

Track AI Agents and Control Bot Traffic

Half of your website's traffic is invisible to you.

Get realtime insight into the hidden ecosystem of artificial agents scraping, crawling, archiving, and gathering intelligence on your website.

Keep Your Robots.txt Updated Automatically

Use the API or WordPress plugin to continuously generate a robots.txt that stays up to date with the latest AI agents. See the list or read the docs.
Robots.txt Updated 3 Hours Ago
2 new AI data scrapers were added to your robots.txt.

Expose Your Hidden Traffic With Agent Analytics

Watch the activity of AI assistants, scrapers, and other bots swarming across your website in real time. See a live demo or read the docs.

ChatGPT-User

AI Assistant

Protect Your Content From Scraping

Block agents who try to ignore your robots.txt rules. Opt out of LLM training and save server costs. See a live demo or read the docs.
Rule Breakers
Blocked from visiting /archive
A few seconds ago
AI Data Scraper
from Singapore
Blocked from visiting /contact
1 minute ago
AI Data Scraper
from China
Blocked from visiting /articles/123
2 minutes ago
Scraper
from Germany

Spot Spoofed Visits With Agent Verification

Detect bad actors who try to disguise their visits as legitimate agents. See a live demo or read the docs.
127
Agent visits in the last 30 minutes
Open Realtime →
Realtime Timeline
Googlebot
Visited /articles/123
A few seconds ago
Search Engine Crawler
129.205.96.146
from Nigeria
Googlebot
Visited /docs
A few seconds ago
Search Engine Crawler
66.249.79.228
from the United States

Get Spike Alert Notifications

Find out when an agent's traffic starts surging and causing high server load. Read the docs.

PerplexityBot

AI Search Crawler

Identify Top Agents and Pages

See which agents visit your website the most, and which pages they're most interested in. Read the docs.