Faceted navigation
Filter and sort controls on listing pages that can generate a combinatorial explosion of crawlable URLs from a small product set.
Splitting a long list or article across sequential URLs; Google stopped using rel=next/prev for indexing in 2019 and treats each page independently.
Because rel=next/prev is no longer used by Google as an indexing signal, each paginated URL must stand on its own: unique title, self-referencing canonical, and crawlable `<a href>` links to adjacent pages. Canonicalising page 2+ to page 1 is a common mistake that hides deep items from crawlers. Infinite scroll should be backed by real paginated URLs, and 'view all' pages are a valid alternative when they load acceptably fast.
A category with 900 products exposes `/shoes/`, `/shoes/page/2/` … each with a self-canonical and standard anchor links, so Googlebot reaches product 900.
Filter and sort controls on listing pages that can generate a combinatorial explosion of crawlable URLs from a small product set.
A link annotation (in the head or an HTTP header) that tells search engines which URL you consider the preferred version of duplicate…
Links between pages on the same site, which control crawl paths, distribute link equity, and communicate topical relationships and page…
A UI pattern that appends more items as the user scrolls; without backing paginated URLs the additional items are usually invisible to…
The number of URLs a search engine is willing and able to crawl on a site in a given period, set by crawl capacity limit and crawl demand.