Yahoo Link Preview

What is Yahoo Link Preview?

About

Yahoo Link Preview bot fetches metadata and preview data from URLs shared on Yahoo platforms and services. Supports Yahoo's social features, news aggregation, and content discovery across their ecosystem of web properties. You can see how often Yahoo Link Preview visits your website by setting up Dark Visitors Agent Analytics.

Expected Behavior

Fetchers visit websites on-demand. They're normally dispatched by apps to present metadata about a link (e.g. the title and thumbnail image) to a user.

Type

Detail

Insights

The percentage of all internet traffic coming from Fetchers

Top Visited Website Categories

Robots.txt

Should I Block Yahoo Link Preview?

Probably not. If you block a fetcher, it won't be able to fetch the metadata it needs to display a link preview. Fewer people will click on the link to your website without this.

How Do I Block Yahoo Link Preview?

You can block Yahoo Link Preview or limit its access by setting user agent token rules in your website's robots.txt. Set up Dark Visitors Agent Analytics to check whether it's actually following them.

# In your robots.txt ...

User-agent: Yahoo Link Preview # https://darkvisitors.com/agents/yahoo-link-preview
Disallow: /

⚠️ Manual Robots.txt Editing Is Not Scalable

New agents are created every day. We recommend setting up Dark Visitors Automatic Robots.txt if you want to block all agents of this type.

References

• https://developer.yahoo.com/