Mail.RU_Bot
Operated by VK. Last seen today.
What is Mail.RU_Bot?
About
Mail.RU_Bot is a fetcher operated by VK. It's not currently known to be artificially intelligent or AI-related. If you think that's incorrect or can provide more detail about its purpose, please contact us.
Detail
Website | https://help.mail.ru/webmaster/indexing/robots |
Type
Fetcher
Fetches web content on behalf of an app
Expected Behavior
Fetchers visit websites on-demand. They're normally dispatched by apps to present metadata about a link (e.g. the title and thumbnail image) to a user.
Insights
Other Websites
Access Control
Should I Block Mail.RU_Bot?
Probably not. If you block a fetcher, it won't be able to fetch the metadata it needs to display a link preview. Fewer people will click on the link to your website without this.
Using Robots.txt
User Agent Token | Description |
---|---|
Mail.RU_Bot |
Should match instances of Mail.RU_Bot |
You can block Mail.RU_Bot or limit its access by setting user agent token rules in your website's robots.txt.
# robots.txt
# This blocks Mail.RU_Bot
User-agent: Mail.RU_Bot
Disallow: /