What is duplicate content?
Duplicate content is the same, or nearly the same, material reachable at more than one address. Sometimes that is two sites: a syndicated article, a scraped page, a manufacturer's product description reused by every retailer. More often it is one site tripping over itself: the same page at http and https, with and without www, with a tracking parameter appended, sorted three ways by a filter, and offered again as a print version.
Google does not penalize duplicate content in the ordinary case. It picks one version, the canonical, and files the rest as copies. The trouble is that its choice is not always yours, and the signals that should have pointed to one strong page get split across five weak ones.
Why it matters
Why duplicate content matters
Every link, share and crawl is a vote, and duplicates divide the vote. A product page that exists at four URLs may have links to all four and rank with none. Crawlers also spend a finite budget on each site; a store with a hundred products and ten thousand filtered variants is asking Google to crawl copies instead of the work. On large sites, duplicate control is most of technical SEO.
Across sites the stakes differ. If you syndicate a story to a bigger publisher and they outrank you with your own words, you have lost the traffic you wrote it for. If someone scrapes you, Google usually works out the original, but not always, and not quickly.
In practice
How duplicate content works in practice
- 01
Find it first. A crawl that flags matching titles and bodies, plus the Page indexing report in Search Console (duplicates without a user-selected canonical), shows where copies live. Then resolve each cluster with the right tool: a 301 redirect when a URL should not exist at all (the http version, the old slug), a canonical tag when variants must stay live but one should carry the credit (filters, parameters, print pages), and noindex for pages that have to exist but should never rank (internal search results).
- 02
Prevent the rest at the source. Pick one hostname and protocol and redirect the others. Keep internal links consistent. When you syndicate, ask the partner for a canonical tag pointing home, or at least a link; when you reuse supplier descriptions, rewrite the ones that matter. On a glossary or a blog, watch for near-duplicates: two posts answering the same question are duplicates in Google's eyes, and the fix is to merge them.
At RIOT
Duplicate content at RIOT
This glossary is the biggest duplicate-content risk on our site. It runs to hundreds of terms, and many sit close together: a doorway page and a gateway page, a focus keyword and a primary keyword. Each entry is written to be the one page for its term, with its own definition, examples and questions, so Google has no reason to fold two into one. Where two terms genuinely mean the same thing, we say so and send the reader on.
Watch out
What people get wrong about duplicate content
Believing in a duplicate content penalty. Google has said repeatedly that there is none for ordinary duplication; the damage is dilution, not punishment. The second mistake is over-correcting with noindex, which hides pages that could have passed their signals to a canonical instead. The third is ignoring boilerplate: a site where every page is eighty percent header, footer and sidebar looks duplicated to a crawler even when the other twenty percent is original. Make the unique part the big part.
