Why did AI stop citing my page?
Your page used to show up as a source in ChatGPT, Perplexity or Google's AI Overviews. Now it doesn't. Before you rewrite anything, work out which kind of problem you have. Some causes are blocks you can see and undo today. Others are changes on the AI side that you can only watch. Here is what the official docs say, the order we check things in, and how to confirm each cause.
Usually one of three things. Something on your site now blocks or hides the page (robots.txt, noindex, nosnippet, a firewall or a changed URL). Google has dropped or demoted it, which also removes it from AI Overviews. Or the AI simply picked other sources this time, since its citations change often. Check the blocks first: they are the only cause you can prove and fix in a day.
What are the key facts about why AI stops citing a page?
| Fact | Detail | Source |
|---|---|---|
| Google's AI needs indexing | A page "must be indexed and eligible to be shown in Google Search with a snippet" | |
| Snippet controls reach AI | nosnippet keeps content from being "a direct input for AI Overviews and AI Mode"; max-snippet limits it | |
| Blocking OAI-SearchBot | Opted-out sites "will not be shown in ChatGPT search answers" | OpenAI |
| Blocking Claude-SearchBot | "May reduce your site's visibility and accuracy" in search results | Anthropic |
| Firewalls can block Perplexity | Perplexity says you may need to allowlist its bots in your firewall | Perplexity |
| Changes take about a day | OpenAI: "~24 hours" after a robots.txt update; Perplexity: up to 24 hours | OpenAI, Perplexity |
| URL moves cause wobble | Google: "Expect temporary fluctuation" during a move; keep redirects at least 1 year | |
| Core updates | Broad changes made "several times a year" that "don't target specific sites" | |
| Sources churn | 45.5% of cited sources were new between consecutive checks of the same AI Overview (43,000+ keywords) | Ahrefs (third-party) |
What are the most common reasons AI stops citing a page?
They fall into three groups, and the group tells you what to do next.
- Your site now blocks or hides the page. A robots.txt rule, a noindex or nosnippet tag, a firewall setting, or a URL that changed without a clean redirect. These are on your side. You can find them and undo them.
- The page lost its place in the search index the AI reads. Google's AI Overviews and AI Mode only use pages that are indexed and eligible for a snippet. Google If Google drops or demotes the page, the AI answer usually goes with it.
- The AI chose other sources. Your page is still reachable and indexed, but a competitor has a better or newer answer, your own edit removed the line that was being quoted, or the answer just varies from run to run.
Google's own guide to traffic drops lists the same families: technical issues, "core updates and other smaller updates," security and spam problems, site moves, changes in demand, and even reporting glitches. Google The guide is about Search, not AI answers, but the causes overlap because Google's AI features draw on the same index.
Could my robots.txt or a noindex tag have removed me from AI answers?
Yes, and each AI company documents the effect.
- OpenAI. Sites that block OAI-SearchBot "will not be shown in ChatGPT search answers," though they can still appear as plain navigational links. OpenAI says it can take "~24 hours" after a robots.txt change for its systems to adjust. OpenAI
- Anthropic. Turning off Claude-SearchBot "may reduce your site's visibility and accuracy in user search results." Blocking Claude-User may reduce visibility "for user-directed web search." Anthropic says opting out works through robots.txt, and that blocking its IP addresses may not work reliably. Anthropic
- Perplexity. PerplexityBot exists to "surface and link websites in search results." Perplexity recommends allowing it so your site appears there, and says crawler changes can take up to 24 hours to show. Perplexity
- Google. A noindex tag means "Do not show this page" in results, and nosnippet also stops the content being used as "a direct input for AI Overviews and AI Mode." max-snippet limits how much can be used. Google
Two traps catch people. First, robots.txt "is not a mechanism for keeping a web page out of Google." A blocked page can still be listed, but "won't have a description." Google Our advice, not a vendor statement: a result with no description has no snippet to work from, so treat a Googlebot block as an AI Overviews block too. Second, if robots.txt blocks a page, Google never sees its noindex tag at all: the rules "will be ignored." Google
These changes often arrive by accident: a new theme, an SEO plugin setting, a staging site's rules copied to the live site, or a privacy setting meant to stop AI training. For which bots to allow and which to refuse, see our guide to AI crawlers and robots.txt.
Can a firewall or CDN stop AI engines from citing my page?
Yes. A firewall can turn bots away before robots.txt even matters, and you won't see it on the page itself.
Perplexity warns that with a web application firewall "you may need to explicitly whitelist Perplexity's bots." It suggests matching both the bot's user agent and its published IP ranges, and updating those rules automatically. Perplexity
Cloudflare, a CDN many small sites use, said on 1 July 2025 that it would "block AI crawlers accessing content without permission or compensation, by default," and that "every new domain will now be asked" whether to allow AI crawlers. Cloudflare Its docs add that from 15 September 2026, crawlers that do both search and training "will also be blocked" by its settings that block AI training, including the older Block AI bots switch. Cloudflare So a setting nobody touched recently can still start blocking a crawler that used to get through.
If you use Cloudflare, our guide is Cloudflare blocking AI crawlers? walks through each switch. Other hosts and security plugins have their own bot rules. The proof is in your server logs: an AI bot getting 403 errors or challenge pages is being blocked.
What if Google dropped my page or I changed its URL?
Then the AI answer often drops it too, because Google's AI features only use indexed pages that can show a snippet. Google
Google's URL Inspection tool tells you where you stand. "URL is not on Google" means the page can't appear. The report also shows whether crawling is allowed, whether the page "explicitly disallowed indexing," and which URL Google picked as the canonical version. Google Search Console Help If Google chose a different URL as canonical, that other URL is the one that can be cited.
If you moved the page, check the redirect. Google recommends permanent redirects such as 301 or 308, says to keep them "generally at least 1 year," and warns: "Expect temporary fluctuation in site ranking during the move." For medium-sized sites, "it can take a few weeks or more" for Google to start showing the new URLs. Google A missing redirect, a redirect to the homepage, or a chain of hops is worse than a slow move.
Server errors count here too. Our guide to page speed and AI citations covers how pages that keep failing fall out of Google's index.
Can a content edit or a competitor's page cost me the citation?
Yes, though no AI company publishes exactly how it picks sources, so this part is partly our reading.
Your own edit. If an AI was quoting a specific line, such as a price, a definition or a step, and a redesign cut or buried it, there is nothing left to quote. Compare the old version of the page (your CMS history or a web archive) with the new one and look for the missing fact.
A better answer elsewhere. Google says AI Overviews and AI Mode aim to show "a wider and more diverse set of helpful links." Google Each answer has room for a handful of sources, so a competitor's clearer or newer page can take your slot without you changing anything. Search the question yourself and read the pages that are cited now.
Our advice, not a vendor statement: if the page is reachable and indexed, and newer pages are winning, update the facts, date the update honestly, and put the direct answer in the first lines. Our guide on whether AI prefers fresh content covers what is and isn't known about recency.
Is it normal for AI answers to stop citing a page for no reason?
Yes, often it is. AI answers change from one check to the next, so a single missing citation proves very little.
Google says AI Overviews and AI Mode "may use different models and techniques, so the set of responses and links they show will vary." It also says AI Overviews appear only when Google judges them useful and "often don't trigger." Google
Ahrefs (third-party study, November 2025). It tracked more than 43,000 keywords over about a month, each with at least 16 recorded AI Overviews. An AI Overview had a 70% chance of changing between observations, and on average 45.5% of cited sources were new from one check to the next. The meaning stayed close (average similarity 0.95), so the answer said much the same thing while citing different pages. Ahrefs collected the data with its own tool, and checks were not daily, so it says the true change rate is likely higher. Ahrefs
Google core updates are a separate, bigger cause. Google makes "significant, broad changes" to its systems "several times a year." They "don't target specific sites," and a page that drops isn't necessarily bad. Google advises waiting "at least a full week" after an update finishes before analyzing, and warns against "quick fix" changes. Google Google's core update page does not mention AI features, so any link between a core update and AI Overview citations is unconfirmed by Google.
For the full list of reasons answers shift, see why AI answers change.
What is the step-by-step checklist when AI stops citing my page?
Work top to bottom. The early checks take minutes and are fully in your control.
| Check | Done when | Source |
|---|---|---|
| Confirm it's a real drop | You've asked the same question several times, on more than one day and engine, and the page is still missing | Ahrefs; Google |
| robots.txt allows search bots | OAI-SearchBot, Claude-SearchBot, PerplexityBot and Googlebot are not disallowed for the page | OpenAI; Anthropic; Perplexity; Google |
| No noindex or nosnippet | The page has no noindex, nosnippet or tight max-snippet you didn't intend | |
| Firewall lets bots in | Server logs show AI bots getting 200 responses, not 403s or challenge pages | Perplexity; Cloudflare |
| Page is on Google | URL Inspection says "URL is on Google" and shows the canonical you expect | |
| URL changes redirect cleanly | Old URLs 301 straight to the new page, kept for at least a year | |
| Quoted content still there | The fact or line AI was citing is still on the page, near the top | Our advice |
| Compare today's cited pages | You've read the sources now cited and know what they answer better | Our advice |
| Rule out a core update | You checked Google's Search Status Dashboard and waited a week after any update ended |
How do I check why AI stopped citing my page?
Use three kinds of evidence: what Google sees, what bots get from your server, and what the AI engines answer today.
Google's view. Paste the URL into Search Console's URL Inspection tool. Its live test "fetches and examines the URL in real time" and reports robots.txt blocks, noindex and the canonical. Google Search Console Help In the Performance report, pick "Last 16 months" to see whether the drop repeats each year or lines up with a known update. Google
Your server's view. Search your server logs for OAI-SearchBot, ChatGPT-User, Claude-SearchBot, PerplexityBot and Googlebot, and note the status code each one received. A run of 403s, 429s or redirects around the date the citations stopped usually points to the cause. Our guide to finding AI bots in your server logs shows how.
The AI's view. Our free AI visibility check fetches your pages the way AI crawlers do and flags blocks, noindex tags and pages that come back empty. Then use the Prompt Simulator to ask the engines the question your page used to answer, a few times, and see which sources each one cites now. If you fix a block, give it about a day, as OpenAI and Perplexity suggest, before checking again.
Sources
- AI features and your website — Google Search Central. Read Oct 12, 2026.
- Robots meta tag, data-nosnippet, and X-Robots-Tag specifications — Google Search Central. Read Oct 12, 2026.
- Introduction to robots.txt — Google Search Central. Read Oct 12, 2026.
- Site moves with URL changes — Google Search Central. Read Oct 12, 2026.
- Google Search's core updates — Google Search Central. Read Oct 12, 2026.
- Debugging drops in Google Search traffic — Google Search Central. Read Oct 12, 2026.
- URL Inspection tool — Google Search Console Help. Read Oct 12, 2026.
- Overview of OpenAI Crawlers — OpenAI. Read Oct 12, 2026.
- Does Anthropic crawl data from the web, and how can site owners block the crawler? — Anthropic. Read Oct 12, 2026.
- Perplexity Crawlers — Perplexity. Read Oct 12, 2026.
- Cloudflare just changed how AI crawlers scrape the Internet-at-large — Cloudflare. Read Oct 12, 2026.
- Block AI bots — Cloudflare Docs. Read Oct 12, 2026.
- AI Overviews change every 2 days (but never change their mind) — Ahrefs (third-party study). Read Oct 12, 2026.
Common questions
How long does it take for AI to cite my page again after I fix a block?
For the crawler side, OpenAI says about 24 hours after a robots.txt change, and Perplexity says up to 24 hours. Whether the page is cited again then depends on the question and the competing sources. Google gives no fixed time for reindexing. OpenAI Perplexity
Does nosnippet remove my page from Google AI Overviews?
It stops the page's content from being used as a direct input for AI Overviews and AI Mode. max-snippet limits how much of it can be used. Google
If I block GPTBot, will ChatGPT stop citing me?
OpenAI documents the citation effect for OAI-SearchBot: sites opted out of it will not be shown in ChatGPT search answers. OpenAI lists separate bots for separate jobs, so check which one your robots.txt actually blocks. OpenAI
Did a Google core update remove me from AI Overviews?
Possibly, but Google hasn't said. Its core update page says updates are broad, happen several times a year and don't target specific sites, and does not mention AI features. Wait a week after the update ends before judging. Google
My page shows up in AI answers some days but not others. Is something broken?
Probably not. Google says the links in AI Overviews and AI Mode will vary, and a third-party study found nearly half of cited sources were new between consecutive checks of the same AI Overview. Track it over many checks. Google Ahrefs
Related pages.
Find out if something is blocking your pages.
Enter your domain. The free AI visibility check fetches your pages the way AI crawlers do and shows where ChatGPT, Gemini, Perplexity and Google's AI answers mention you, and where they don't.