ias_crawler
What is ias_crawler?
About
ias_crawler from Integral Ad Science performs digital ad verification, brand safety monitoring, and fraud detection across digital advertising channels to ensure quality media measurement. You can see how often ias_crawler visits your website by setting up Dark Visitors Agent Analytics.
Expected Behavior
The behavior of intelligence gatherers depends on the goals of their clients. For example, a client might be interested in brand sentiment, in which case the agent would crawl related social media or blog posts at a more frequent rate than unrelated websites.
Type
Detail
| Operated By | Integral Ad Science |
| Last Updated | 12 hours ago |
Insights
Top Website Robots.txts
Country of Origin
Global Traffic
The percentage of all internet traffic coming from Intelligence Gatherers
Top Visited Website Categories
Robots.txt
Should I Block ias_crawler?
Probably not, especially if you benefit from an intelligence gathering service yourself. However, you might choose to block them if you're concerned about things like server resource usage.
How Do I Block ias_crawler?
You can block ias_crawler or limit its access by setting user agent token rules in your website's robots.txt. Set up Dark Visitors Agent Analytics to check whether it's actually following them.
| User Agent String | IAS Crawler (ias_crawler; http://integralads.com/site-indexing-policy/) |
# In your robots.txt ...
User-agent: ias_crawler # https://darkvisitors.com/agents/ias-crawler
Disallow: /
⚠️ Manual Robots.txt Editing Is Not Scalable
New agents are created every day. We recommend setting up Dark Visitors Automatic Robots.txt if you want to block all agents of this type.