Pagination
Splitting a long list or article across sequential URLs; Google stopped using rel=next/prev for indexing in 2019 and treats each page…
Crawling IndexingEndless scrolling
Infinite scroll
A UI pattern that appends more items as the user scrolls; without backing paginated URLs the additional items are usually invisible to crawlers.
In full
Crawlers do not scroll, so anything loaded by a scroll event is not fetched. The supported pattern is to back the experience with real, linkable paginated URLs updated via the History API, so each chunk of items exists at a crawlable address. Failing that, items beyond the first viewport batch are typically discovered only through sitemaps, which delays or prevents indexing of deep inventory.
Example
A jobs board loads 20 listings per scroll; adding `/jobs?page=2` URLs with real anchors makes listings 21-40 crawlable.
Related terms
JavaScript rendering
The execution of a page's client-side JavaScript by a search engine so that content and links generated at runtime become indexable.
Crawl budget
The number of URLs a search engine is willing and able to crawl on a site in a given period, set by crawl capacity limit and crawl demand.
Internal linking
Links between pages on the same site, which control crawl paths, distribute link equity, and communicate topical relationships and page…
Orphan page
A page with no internal links pointing to it, reachable only via sitemap, external link or direct URL.