How do I know if a page is indexed?

Use the URL inspection tool in Search Console for a specific page, or the page indexing report for the whole site. Searching for your own page in Google is unreliable, because personalization and the phrasing you use can both mislead you.

What does crawled but not indexed mean?

Google fetched the page and decided it was not worth storing, usually because it is thin, near-duplicate, or adds nothing beyond a page it already has. Resubmitting does not change that assessment. Making the page genuinely different does.

What does discovered but not crawled mean?

Google knows the URL exists and has not fetched it yet, often because of crawl budget or because the site signals it is low priority. Better internal linking and a cleaner sitemap usually resolve it faster than any technical fix.

Why would a page be excluded by a noindex tag?

Because something is telling Google not to index it, and on business sites that is usually a leftover from staging or a platform setting nobody knew about. It is the most common cause of a page mysteriously missing, and the fastest to fix once found.

Can robots.txt cause an indexing problem?

Yes, and in a confusing way: a disallowed page cannot be crawled, so a noindex on it is never seen, and the URL can still appear as a bare result. If you want a page gone, allow the crawl and use noindex on the page.

How long should indexing take for a new page?

Days to a few weeks, depending on how well the site is crawled and how well linked the page is. A page nothing links to can wait a long time. If it has not appeared after a month, something is wrong rather than slow.

Does submitting a URL guarantee indexing?

No. It requests a recrawl, which is useful after a meaningful update. It does not override the decision about whether the page is worth storing, and repeatedly submitting a thin page does nothing but consume your quota.

Why did pages fall out of the index?

Usually a technical change: a deploy adding a noindex, a robots rule, a canonical pointing elsewhere, or a redirect. Occasionally it is a quality reassessment. Check the technical causes first, because they are fast to confirm and fast to fix.

What is a canonical problem?

A page telling Google that a different URL is the real version, so the page itself is not indexed. Self-referencing canonicals on unique pages, and correct ones on genuine duplicates, is the rule. A template shipping the wrong canonical de-indexes everything it renders.

How does duplicate content affect indexing?

Near-identical pages compete, and Google stores one and drops the others. That is the standard outcome for templated location pages with a swapped town name, and the fix is making them genuinely different rather than adjusting technical signals.

What is the diagnostic order?

Is it crawlable, is it indexed, is it canonical to itself, is it distinct enough to be worth storing. Working in that order means you never rewrite a page that was blocked by a robots rule, which is the most common wasted effort here.

What should I check first when traffic drops?

The indexed page count. If it fell, this is a technical problem with a specific cause and a fast fix. If it held, the problem is rankings or the results page, which is a different investigation entirely.

Search Console SEO How-to

Why Isn’t My Page Indexed? 8 Causes, Fixed

‘My page isn’t indexed’ has eight common causes. Six of them are fixable in an hour.

John Cravey with AIFounderMar 20, 20264 min readUpdated Aug 6, 2026

A page that isn’t indexed by Google can’t rank, can’t drive traffic, and can’t support your other pages. Most SMBs we audit have 10-40% of their published pages unindexed without realizing it. The fixable reasons cluster around eight common issues. Here’s how to diagnose each one and what to do.

Free estimate · 2 minutes

Your Search Console data already shows the gap.

The estimate doubles as intake for an audit: we read your data, show where the clicks are being lost, and price the fix.

#Step 0: confirm the page isn’t indexed

Two ways. (1) Search `site:example.com/path` in Google — if the page appears, it’s indexed. (2) Paste the URL into GSC’s Inspect URL tool — gives you the canonical answer plus the reason if it’s not indexed.

#Reason 1: Google hasn’t crawled the page yet

GSC Coverage status: ‘Discovered – currently not indexed.’ Google knows about the URL (probably from your sitemap) but hasn’t prioritized crawling it. Common for new pages on sites without much authority. Fix: build internal links to the page from indexed pages on your site. Or use Inspect URL → Request Indexing to nudge a crawl.

#Reason 2: Google crawled the page and chose not to index

GSC status: ‘Crawled – currently not indexed.’ Google looked at the page and decided it doesn’t add value. Usually thin content, duplicate-of-something-else, or low-quality. Fix: improve the content. Make it longer, more specific, more useful. Add internal links. Update the publication date. Re-request indexing.

#Reason 3: noindex directive

GSC status: ‘Excluded by ‘noindex’ tag.’ Your page has a `<meta name="robots" content="noindex">` in the HTML head or an `X-Robots-Tag: noindex` HTTP header. Fix: remove the directive if you want the page indexed. Common sources: a layout-level meta tag that wasn’t supposed to apply to this route, a CMS setting, a previous developer’s WIP state that got committed.

#Reason 4: blocked by robots.txt

GSC status: ‘Blocked by robots.txt.’ Your `/robots.txt` is disallowing the URL. Fix: edit robots.txt to allow the path. We’ve seen this caused by an over-broad disallow rule meant to block admin pages also catching marketing pages.

#Reason 5: canonical points elsewhere

GSC status: ‘Alternate page with proper canonical tag.’ Your page declares another URL as the canonical. Google indexes the canonical instead. Fix: only if the canonical was wrong. Most ‘alternate page’ exclusions are healthy — they prevent duplicate-content issues from query strings and pagination.

#Reason 6: page returns a 404 or 5xx

GSC status: ‘Not found (404)’ or ‘Server error (5xx).’ Google tried to crawl the URL and got an error response. Fix: make the URL accessible. If it should be a 404 (the page genuinely doesn’t exist), update your sitemap to remove the URL.

#Reason 7: redirect chain or loop

GSC status: ‘Page with redirect’ or ‘Redirect error.’ The URL redirects to another URL — Google follows the redirect but may not re-crawl deep chains. Fix: collapse chains to single hops. URL A → URL B → URL C should become URL A → URL C directly.

#Reason 8: duplicate content

GSC status: ‘Duplicate without user-selected canonical’ or ‘Duplicate, Google chose different canonical.’ The page is too similar to another page on your site and Google deduplicated. Fix: make the pages substantively different, or canonicalize to one of them.

#Diagnosing in Inspect URL

Paste the URL → click Test Live URL → see exactly what Google sees, including rendered HTML, headers, and any blocking directives. The Live Test view is the source of truth for what Googlebot encounters.

#The investigation order

Inspect URL the affected URL. Note the GSC status.
If status is ‘Crawled – currently not indexed,’ look at the page content. Thin? Duplicate? Low value? Improve it.
If status is technical (noindex, robots.txt, redirect), fix the technical issue.
If status is ‘Discovered,’ improve internal linking to the page.
After fixing, re-Inspect → Request Indexing. Wait 24-48 hours. Re-check.

#When pages get deindexed AFTER being indexed

Different problem. Look at:

Did the page’s content change significantly? Google might have re-evaluated and demoted.
Did a recent Google algorithm update affect the topic? Industry tracker check.
Did a server issue prevent crawling for an extended period? Pages with persistent crawl errors get dropped.
Did the page get a new canonical pointing at a different URL?

#Bulk-fixing indexing issues

If you have hundreds of pages with indexing issues, fix the underlying pattern, not each page individually. Common patterns:

All blog tag pages excluded → check if your tag pages have meaningful content or are just lists.
All paginated pages excluded → fine, this is healthy.
Many location pages thin → invest in real local content per page.
Old blog posts dropping → update or consolidate them.

#How often to check

Weekly. The weekly GSC review should include a glance at the Coverage report. New excluded URLs in the past 7 days are the early warning that something’s drifting.

#How this lands across FH client work

Every FH SEO engagement starts with an indexing audit: how many pages are in the sitemap, how many are indexed, what’s the gap, why. We fix the gap before doing anything else — there’s no point ranking effort on pages Google won’t even index. If your site’s indexed-page count is well below your published-page count, book a consultation — the diagnostic is a half-day engagement that almost always finds quick wins.

Answers

Frequently asked questions

How do I know if a page is indexed?: Use the URL inspection tool in Search Console for a specific page, or the page indexing report for the whole site. Searching for your own page in Google is unreliable, because personalization and the phrasing you use can both mislead you.
What does crawled but not indexed mean?: Google fetched the page and decided it was not worth storing, usually because it is thin, near-duplicate, or adds nothing beyond a page it already has. Resubmitting does not change that assessment. Making the page genuinely different does.
What does discovered but not crawled mean?: Google knows the URL exists and has not fetched it yet, often because of crawl budget or because the site signals it is low priority. Better internal linking and a cleaner sitemap usually resolve it faster than any technical fix.
Why would a page be excluded by a noindex tag?: Because something is telling Google not to index it, and on business sites that is usually a leftover from staging or a platform setting nobody knew about. It is the most common cause of a page mysteriously missing, and the fastest to fix once found.
Can robots.txt cause an indexing problem?: Yes, and in a confusing way: a disallowed page cannot be crawled, so a noindex on it is never seen, and the URL can still appear as a bare result. If you want a page gone, allow the crawl and use noindex on the page.
How long should indexing take for a new page?: Days to a few weeks, depending on how well the site is crawled and how well linked the page is. A page nothing links to can wait a long time. If it has not appeared after a month, something is wrong rather than slow.
Does submitting a URL guarantee indexing?: No. It requests a recrawl, which is useful after a meaningful update. It does not override the decision about whether the page is worth storing, and repeatedly submitting a thin page does nothing but consume your quota.
Why did pages fall out of the index?: Usually a technical change: a deploy adding a noindex, a robots rule, a canonical pointing elsewhere, or a redirect. Occasionally it is a quality reassessment. Check the technical causes first, because they are fast to confirm and fast to fix.
What is a canonical problem?: A page telling Google that a different URL is the real version, so the page itself is not indexed. Self-referencing canonicals on unique pages, and correct ones on genuine duplicates, is the rule. A template shipping the wrong canonical de-indexes everything it renders.
How does duplicate content affect indexing?: Near-identical pages compete, and Google stores one and drops the others. That is the standard outcome for templated location pages with a swapped town name, and the fix is making them genuinely different rather than adjusting technical signals.
What is the diagnostic order?: Is it crawlable, is it indexed, is it canonical to itself, is it distinct enough to be worth storing. Working in that order means you never rewrite a page that was blocked by a robots rule, which is the most common wasted effort here.
What should I check first when traffic drops?: The indexed page count. If it fell, this is a technical problem with a specific cause and a fast fix. If it held, the problem is rankings or the results page, which is a different investigation entirely.

Question we did not answer? Ask us directly and we will answer it here.

Tagged#Search Console #SEO #How-to

Written by

John Cravey

Founder

Founder of Frontend Horizon. Writes most of the long-form work on the FH blog.