SiteAuditBot
Last updated 8 hours ago.
What is SiteAuditBot?
About
SiteAuditBot is a developer helper operated by Semrush. It's not currently known to be artificially intelligent or AI-related. If you think that's incorrect or can provide more detail about its purpose, please contact us.
Track SiteAuditBot Visiting Your Website
You can see when SiteAuditBot visits your website using the API or WordPress plugin.
Detail
Operator | Semrush |
Documentation | http://semrush.com/bot.html |
Type
Developer Helper
Used by developers to test website functionality
Expected Behavior
Developer helpers generally visit websites on direct behalf of a user who is evaluating some feature or attribute. Visits can be one-off or part of a larger crawl.
Insights
SiteAuditBot's Activity on Your Website
Other Websites
Access Control
Should I Block SiteAuditBot?
Probably not. Developer helpers are normally used to optimize or find problems with your website.
Using Robots.txt
User Agent Token | Description |
---|---|
SiteAuditBot |
Should match instances of SiteAuditBot |
You can block SiteAuditBot or limit its access by setting user agent token rules in your website's robots.txt.
# robots.txt
# This should block SiteAuditBot
User-agent: SiteAuditBot
Disallow: /