factset_spyderbot

What is factset_spyderbot?

About

factset_spyderbot is a web crawler operated by FactSet that gathers financial and business data from websites to support their comprehensive financial data platform and analytics services. You can see how often factset_spyderbot visits your website by setting up Dark Visitors Agent Analytics.

Expected Behavior

The behavior of intelligence gatherers depends on the goals of their clients. For example, a client might be interested in brand sentiment, in which case the agent would crawl related social media or blog posts at a more frequent rate than unrelated websites.

Type

Intelligence Gatherer
Searches for useful insights

Detail

Operated By Factset
Last Updated 17 hours ago

Insights

Top Website Robots.txts

0%
0% of top websites are blocking factset_spyderbot
Learn How →

Country of Origin

Unknown
factset_spyderbot has no known country of origin

Global Traffic

The percentage of all internet traffic coming from Intelligence Gatherers

How Do I Get These Insights for My Website?
Use the WordPress plugin, Node.js package, or API to get started in seconds.

Robots.txt

Should I Block factset_spyderbot?

Probably not, especially if you benefit from an intelligence gathering service yourself. However, you might choose to block them if you're concerned about things like server resource usage.

How Do I Block factset_spyderbot?

You can block factset_spyderbot or limit its access by setting user agent token rules in your website's robots.txt. Set up Dark Visitors Agent Analytics to check whether it's actually following them.

How Do I Block All Intelligence Gatherers?
Serve a continuously updating robots.txt that blocks new intelligence gatherers automatically.
# In your robots.txt ...

User-agent: factset_spyderbot # https://darkvisitors.com/agents/factset-spyderbot
Disallow: /

⚠️ Manual Robots.txt Editing Is Not Scalable

New agents are created every day. We recommend setting up Dark Visitors Automatic Robots.txt if you want to block all agents of this type.