Technical SEOBeginner

Indexing

Indexing is when a search engine processes a crawled page and stores it in its index so it can appear in search results.

Also called: Search index, Indexation

After a crawler fetches a page, the search engine analyzes it: the text, title, links, structured data, images and how it renders. If the page passes its checks, it is added to the index, the database results are drawn from. Only indexed pages can rank, and Google is explicit that it does not index every page it crawls.

From crawl to index

Google describes three stages: crawling, indexing and serving. During indexing it renders the page (running JavaScript where needed), groups duplicates and chooses a canonical, and records signals about the content. A page can be crawled and still not indexed, for example because it is a duplicate, has a noindex directive, or is judged not useful enough.

Reading the Page indexing report

Search Console's Page indexing report groups URLs by why they are or are not indexed. A few statuses come up constantly.

  • Discovered, currently not indexed: Google knows the URL but has not crawled it yet, often a crawl priority or site quality signal
  • Crawled, currently not indexed: Google fetched it and chose not to index it for now
  • Duplicate without user-selected canonical: Google picked another URL as the main version
  • Alternate page with proper canonical tag: working as intended
  • Excluded by noindex tag: check it is deliberate

Getting important pages indexed

There is no switch that forces indexing. What helps is making pages easy to find (internal links, sitemaps), clearly the canonical version, and substantial enough to be worth storing. For a single URL, URL Inspection in Search Console lets you request indexing, which prompts a recrawl but does not guarantee inclusion.

Google's Indexing API is limited to pages with JobPosting or BroadcastEvent structured data. It is not a general way to submit marketing pages.

Index bloat

The opposite problem is having too much indexed: tag pages, internal search results, parameter URLs, empty user profiles, or thin programmatic pages. These dilute the site and can make it harder for Google to judge overall quality. Prune with noindex, canonicals, consolidation or removal, depending on whether the pages serve visitors.

Example

Programmatic pages stuck in "crawled, not indexed"

Suppose a SaaS for invoicing, Billpine, launches several hundred "invoice template for [profession]" pages. Weeks later, most sit in "Crawled, currently not indexed". The templates differ only by the profession name in the heading.

The team adds genuinely different content to each page (relevant line items, tax notes, sample terms) and cuts professions where there is nothing distinct to say. Indexing improves on the pages with real differences; how much depends on Google's assessment, which it does not explain per page.

Common mistakes

Repeatedly requesting indexing

Hitting "Request indexing" again does not change Google's decision about a page it chose not to index. Improve the page or its links instead.

Assuming the site: operator is a full count

site: searches give rough, inconsistent numbers. Use Search Console for indexing data.

Questions

Anywhere from hours to weeks. Google does not commit to a timeline, and it varies with how often it crawls the site and how much it values the page.

Google does not give a per-page reason. Common causes are duplication, thin or low-value content, or weak internal linking that signals low importance.

No. Indexing makes a page eligible to appear. Ranking depends on relevance and quality compared with other indexed pages.

Know the terms. Now win the searches.

We find the searches your buyers make, then build, publish and improve the pages that win them.