gsa-crawler

What is gsa-crawler?

About

gsa-crawler is an uncategorized agent. If you think this is incorrect or can provide additional detail about its purpose, please contact us. You can see how often gsa-crawler visits your website by setting up Dark Visitors Agent Analytics.

Expected Behavior

Behavior will vary depending on whether this agent is a search engine crawler, data scraper, archiver, one-off fetcher, etc.

Type

Uncategorized
Not currently assigned a type

Detail

Last Updated 3 hours ago

Insights

Top Website Robots.txts

0%
0% of top websites are blocking gsa-crawler
Learn How →

Country of Origin

Germany
gsa-crawler normally visits from Germany

Global Traffic

The percentage of all internet traffic coming from Uncategorized Agents

How Do I Get These Insights for My Website?
Use the WordPress plugin, Node.js package, or API to get started in seconds.

Robots.txt

Should I Block gsa-crawler?

It's difficult to say without a type. Its purposes could either be good or bad for your website, depending on what it is.

How Do I Block gsa-crawler?

You can block gsa-crawler or limit its access by setting user agent token rules in your website's robots.txt. Set up Dark Visitors Agent Analytics to check whether it's actually following them.

How Do I Block All Uncategorized Agents?
Serve a continuously updating robots.txt that blocks new uncategorized agents automatically.
User Agent String gsa-crawler (Enterprise; T3-LNMUGC6JBKQNE; thomas@brainfuck.space)
# In your robots.txt ...

User-agent: gsa-crawler # https://darkvisitors.com/agents/gsa-crawler
Disallow: /

⚠️ Manual Robots.txt Editing Is Not Scalable

New agents are created every day. We recommend setting up Dark Visitors Automatic Robots.txt if you want to block all agents of this type.