Faceted navigation
Filter and sort controls on listing pages that can generate a combinatorial explosion of crawlable URLs from a small product set.
Crawling Indexing
Index bloat
A condition where a site has far more URLs indexed or crawlable than it has genuinely useful pages, diluting crawl attention and site-level quality signals.
In full
Common sources are faceted navigation, session and tracking parameters, paginated archives, internal search results, tag pages and auto-generated location or variant pages. The cost is twofold: crawlers spend their budget on low-value URLs, and quality evaluation systems see a site dominated by thin pages. Remediation combines noindex, canonicalisation, robots.txt for genuinely infinite spaces, and outright deletion.
Example
A WordPress site has 60 real posts but 9,000 indexed URLs because every tag, author and date archive is crawlable and paginated.
Related terms
Thin content
Pages with little or no substantive value of their own — scraped, auto-generated, doorway-like, or near-empty templated pages.
Crawl budget
The number of URLs a search engine is willing and able to crawl on a site in a given period, set by crawl capacity limit and crawl demand.
noindex
A robots directive, delivered by meta tag or X-Robots-Tag header, that instructs search engines to drop a page from their index.
Content pruning
Systematically removing, merging or noindexing low-value pages so a site's indexed footprint reflects only content worth ranking.