Companybook-Crawler
Last updated 17 hours ago.
What is Companybook-Crawler?
About
Companybook-Crawler is an uncategorized agent. It's not currently known to be artificially intelligent or AI-related. If you think that's incorrect or can provide more detail about its purpose, please contact us.
Track Companybook-Crawler Visiting Your Website
You can see when Companybook-Crawler visits your website using the API or WordPress plugin.
Type
Uncategorized
Not currently assigned a type
Expected Behavior
Behavior will vary depending on whether this agent is a search engine crawler, data scraper, archiver, one-off fetcher, etc.
Insights
Companybook-Crawler's Activity on Your Website
Other Websites
Access Control
Should I Block Companybook-Crawler?
It's difficult to say without a type. Its purposes could either be good or bad for your website, depending on what it is.
Using Robots.txt
User Agent Token | Description |
---|---|
Companybook-Crawler |
Should match instances of Companybook-Crawler |
You can block Companybook-Crawler or limit its access by setting user agent token rules in your website's robots.txt.
# robots.txt
# This should block Companybook-Crawler
User-agent: Companybook-Crawler
Disallow: /