Canonicalization
The process by which a search engine groups duplicate or near-duplicate URLs into a cluster and picks one representative URL to index and…
Crawling Indexing
Duplicate content
Substantively identical or near-identical content available at more than one URL, within a site or across sites.
In full
There is no general 'duplicate content penalty'; the normal outcome is consolidation, where one URL is chosen to represent the cluster and the others simply do not rank. Problems arise when the engine picks the wrong canonical, when link signals are split across variants, or when duplication is scaled deliberately, which can cross into scraped or scaled content abuse. Common internal causes are protocol and www variants, trailing slashes, parameters, print views and syndicated boilerplate.
Example
Both `http://example.com/page` and `https://www.example.com/page` resolve with 200 status, so Google must guess which to index.
Related terms
rel="canonical"
A link annotation (in the head or an HTTP header) that tells search engines which URL you consider the preferred version of duplicate…
URL parameters
Key-value pairs after a question mark in a URL; they frequently create duplicate content and crawl waste when they do not change page…
Scaled content abuse
Generating many pages primarily to manipulate rankings rather than help users, whether by AI, templates, scraping, or stitching content…
Content syndication
Republishing the same content on third-party sites for reach; without correct canonicalisation it creates duplicates that can outrank the…
Where to read more
- How to Specify a Canonical with rel=canonical and Other Methods · Documentation · developers.google.com