Google-InspectionTool

What is Google-InspectionTool?

About

Google-InspectionTool powers Search Console's URL Inspection tool and Rich Results Test, crawling pages to validate indexability, structured data markup, and search feature compatibility on user request. You can see how often Google-InspectionTool visits your website by setting up Dark Visitors Agent Analytics.

Expected Behavior

Security scanners do not follow a predictable schedule when visiting websites. Their scans can be one-time, occasional, or recurring depending on the purpose of the scanner and the organization's security practices. The frequency and depth of their scans can vary based on factors like the visibility of the site on the public internet, past scan results, and inclusion in external threat intelligence feeds.

Type

Security Scanner
Scans websites to find vulnerabilities

Detail

Operated By Google
Last Updated 10 hours ago

Insights

Top Website Robots.txts

2%
2% of top websites are blocking Google-InspectionTool
Learn How →

Country of Origin

United States
Google-InspectionTool normally visits from the United States

Global Traffic

See All Global Bot & LLM Insights →

The percentage of all internet traffic coming from Security Scanners

Top Visited Website Categories

People and Society
Beauty and Fitness
Finance
Science
Business and Industrial
How Do I Get These Insights for My Website?
Use the WordPress plugin, Node.js package, or API to get started in seconds.
Set Up Agent Analytics

Robots.txt

Should I Block Google-InspectionTool?

Probably not. Security scanners can be beneficial, especially if they're configured to report issues back to you.

How Do I Block Google-InspectionTool?

You can block Google-InspectionTool or limit its access by setting user agent token rules in your website's robots.txt. Set up Dark Visitors Agent Analytics to check whether it's actually following them.

How Do I Block All Security Scanners?
Serve a continuously updating robots.txt that blocks new security scanners automatically.
Set Up Automatic Robots.txt
User Agent String Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.6099.224 Safari/537.36 (compatible; Google-InspectionTool/1.0) 
# In your robots.txt ...

User-agent: Google-InspectionTool # https://darkvisitors.com/agents/google-inspectiontool
Disallow: /

⚠️ Manual Robots.txt Editing Is Not Scalable

New agents are created every day. We recommend setting up Dark Visitors Automatic Robots.txt if you want to block all agents of this type.

References