Claude Search Optimisation

Last updated 19 May 2026

Claude’s web search, launched in March 2025, retrieves current web content to answer queries and cite sources inline. The retrieval backend is Brave Search, not Google or Bing. That distinction is the central fact for content strategy: Google rankings and Bing visibility do not translate directly to Claude citations. Brave indexing does.

How does Claude retrieve and cite?

When a query requires current information, Claude reformulates the user’s question into a more search-optimised form and issues it to Brave Search rather than passing the original prompt directly. It then retrieves candidate results and, where necessary, fetches specific pages to read content in detail. This two-step process means Claude evaluates both a page’s presence in Brave’s index and the quality of the content it finds on the page.

Research published by Profound in March 2025 found 86.7% overlap between Claude’s cited results and Brave Search’s top organic results, with statistical significance well beyond chance (p < 0.0001).¹ The practical upshot is that Claude functions largely as a Brave Search interface with its own citation filtering on top.

Citations appear inline within Claude’s prose as numbered references, embedded where the content is relevant to the point being made. This differs from Perplexity’s sidebar source list and ChatGPT’s citation list appended to the end of the response. Inline placement means citations appear where users are actively reading, giving cited sources contextual visibility rather than a footnote position.

What are Anthropic’s three crawlers?

Anthropic operates three crawlers with distinct purposes. Conflating them is a common mistake with direct consequences for robots.txt decisions.²

ClaudeBot collects web content for AI model training. Blocking it excludes your site from future training datasets. It has no effect on whether Claude cites your content in real-time search responses.

Claude-SearchBot indexes content to power Claude’s web search features. This is the crawler that matters for citation visibility. Allowing it gives Claude’s search index access to your pages; blocking it reduces the chance of appearing in Claude’s search responses.

Claude-User fetches specific pages during live user sessions, for instance when a user asks Claude to summarise a URL they have pasted. It operates outside the search indexing pipeline.

For citation visibility, the relevant user agent is Claude-SearchBot. Blocking only ClaudeBot, the more frequently discussed of the three, has no effect on Claude’s ability to retrieve and cite your content.

What does Claude favour?

Brave Search ranking. Before any of Claude’s citation logic applies, your page must be in Brave’s index and rank for the query Claude generates internally. Brave maintains a fully independent index with no reliance on Google or Bing. Ranking factors broadly resemble Google’s, but Brave weights editorial authenticity more explicitly: real authors with verifiable credentials, transparent sourcing, and content written for readers rather than for rankings.

Named, credible authorship. Author authority signals carry more weight in Claude’s citation behaviour than in most other AI surfaces. A named author linked to a verifiable profile (personal site, LinkedIn, or institutional affiliation) is treated differently from anonymous or byline-free content. Article schema with an explicit author entity gives Claude’s retrieval layer structured signals it can resolve without inference.

Verifiable claims backed by primary sources. Claude is conservative with citations and avoids asserting things it cannot confirm. Pages that link to original research, official documentation, and named experts are cited more readily than pages making unsupported claims, even where the underlying information is accurate. Linking out to credible sources is a direct citation signal, not just good editorial practice.

Passage-level structure. Claude cites at the passage level rather than the page level. A well-structured paragraph can earn a citation from an otherwise unremarkable page. Each section should be self-contained and open with a sentence that directly answers the question the heading implies. Answers buried mid-paragraph are extracted less reliably than those that lead.

Neutral, informational register. Claude avoids content that advocates for a position rather than informs. Promotional language, superlative-heavy product pages, and listicles that rank without defending criteria are cited less often than editorial content written in a factual, balanced tone.

How do you optimise for Claude citations?

Verify Brave indexing. Search for your key pages on Brave directly. If they do not appear for relevant queries, Claude is unlikely to surface them regardless of other signals. Brave offers a Web Discovery Project for publishers to submit sites for indexing.
Allow Claude-SearchBot in robots.txt. If you have historically blocked all AI crawlers or applied wildcard rules, verify that Claude-SearchBot is not inadvertently blocked. Each Anthropic user agent must be managed independently.
Establish author entities in schema. Add author markup to Article schema with sufficient structured data for Claude to resolve the author: name, a url pointing to a personal site or profile, and sameAs links to LinkedIn or institutional pages where relevant.
Write for passage extraction. Open each H2 and H3 section with one or two sentences that directly answer the question the heading raises. Long preambles before the substantive answer reduce the chance of that passage being selected.
Cite primary sources outbound. Link to original research, official documentation, and named experts. Claude’s citation behaviour favours sources that themselves demonstrate editorial rigour.
Build authority through traditional means. Editorial backlinks, brand recognition, and original content all improve Brave rankings, which is the prerequisite for Claude visibility. The same off-page work that improves Google rankings improves Brave rankings, though relative weighting differs between the two indexes.

How do you measure Claude visibility?

There is no Claude equivalent of Google Search Console. The most direct available signal is referrer tracking: sessions from Claude appear in analytics with claude.ai as the referrer. As of May 2026, Google Analytics 4 aggregates traffic from major AI tools including Claude into a dedicated ‘AI Assistant’ channel, making this visible without custom configuration.³

For proactive measurement, manual sampling is the most reliable approach. Run representative queries for your niche in Claude and record which sources are cited. For brand-sensitive queries, tracking this periodically gives a directional indicator of how well your content is indexed and trusted within Claude’s retrieval pipeline.

Frequently asked questions

Does blocking ClaudeBot affect Claude citations?
No. ClaudeBot is the training crawler only. The crawler relevant to citation visibility is Claude-SearchBot.

If my site ranks well on Google, will Claude cite it?
Not automatically. Google and Brave rankings correlate imperfectly. A page can rank on the first page of Google and not appear in Brave for the same query. Checking Brave directly is the only reliable way to confirm indexing status.

Is Claude a significant traffic source?
Referral volumes from claude.ai are currently smaller than from Perplexity or ChatGPT Search for most sites. The more immediate value is visibility with technical and professional audiences, who use Claude at above-average rates relative to the general search population.

Does Claude use Google’s index at all?
No. Brave Search has operated an independent index with no Google or Bing fallback since April 2023.