web-archive-net.com.bot

Last seen referenced today.

What is web-archive-net.com.bot?

About

web-archive-net.com.bot is an uncategorized agent. It's not currently known to be artificially intelligent or AI-related. If you think that's incorrect or can provide more detail about its purpose, please contact us.

Type

Uncategorized
Not currently assigned a type

Expected Behavior

Behavior will vary depending on whether this agent is a search engine crawler, data scraper, archiver, one-off fetcher, etc.

Access Control

Using Robots.txt

User Agent Token Description
web-archive-net.com.bot Should match instances of web-archive-net.com.bot

You can block web-archive-net.com.bot or limit its access by setting user agent token rules in your website's robots.txt.

# robots.txt
# This blocks web-archive-net.com.bot

User-agent: web-archive-net.com.bot
Disallow: /

Instead of doing this manually, you can generate your robots.txt automatically using the free API or Wordpress plugin.

Get the Robots.txt

Insights

Other Websites

0%
of top websites are currently blocking web-archive-net.com.bot in some way
Updated today