rogerbot

Operated by Moz. Last seen today.

What is rogerbot?

About

rogerbot is a developer helper operated by Moz. It's not currently classified as artificially intelligent or AI-related in any way. If you think this is incorrect or want to provide more detail, please contact us.

Detail

Website https://moz.com/help/moz-procedures/crawlers/rogerbot

Type

Developer Helper
Used by developers to test website functionality

Expected Behavior

Developer Helpers generally visit websites on direct behalf of a user who is evaluating some feature or attribute. Visits can be one-off or part of a larger crawl.

Access Control

Using Robots.txt

User Agent Token Description
rogerbot Should match instances of rogerbot

You can block rogerbot or limit its access by setting user agent token rules in your website's robots.txt.

# robots.txt
# This blocks rogerbot

User-agent: rogerbot
Disallow: /

Instead of editing your robots.txt manually, use the API or Wordpress plugin to keep your robots.txt up to date with the agent list automatically.

Get the Robots.txt

Insights

Other Websites

2%
of top websites are currently blocking rogerbot in some way
Updated today