Gemini-Deep-Research

What is Gemini-Deep-Research?

About

Gemini-Deep-Research is the agent responsible for collecting and scanning resources used in Google Gemini's Deep Research feature, which acts as a personal research assistant. You can see how often Gemini-Deep-Research visits your website by setting up Dark Visitors agent analytics.

Expected Behavior

AI assistants make one-off visits to websites based on user requests, rather than crawling the web in any automatic fashion. This allows the underlying LLM to incorporate up-to-date information outside of its training data in its answers, using a technique called retrieval-augmented generation (RAG).

Type

Detail

Insights

The percentage of all internet traffic coming from AI Assistants

Top Visited Website Categories

Robots.txt

Should I Block Gemini-Deep-Research?

Probably not. AI assistants visit websites directly on behalf of human users, so blocking them will effectively block those users. This could lead to a poor user experience and possible negative sentiment about your website. Not blocking AI assistants will allow more human users to use your website as they choose.

How Do I Block Gemini-Deep-Research?

You can block Gemini-Deep-Research or limit its access by setting user agent token rules in your website's robots.txt. Set up Dark Visitors agent analytics to check whether it's actually following them.

# robots.txt
# This should block Gemini-Deep-Research

User-agent: Gemini-Deep-Research
Disallow: /

References

• https://gemini.google/overview/deep-research/