Creative agency glossarySEO and Analytics

Scraped Content

Scraped content is material copied from other websites, automatically or by hand, and republished without adding anything, which search engines treat as low quality and may penalize.

What is scraped content?

Scraped content is other people's work, lifted. In its crudest form a program, a scraper, visits sites, copies their articles, product descriptions or images and republishes them on another domain, sometimes with the words lightly rearranged by software, sometimes with the original site's name left in by accident. In its subtler form a site republishes feeds, reviews or listings from elsewhere wholesale, or stitches extracts from many sources into a page that says nothing of its own.

Google's spam policies name it directly: sites that copy and republish content from other sites without adding original value. The test is value. Quoting a source with attribution and commentary is normal publishing; aggregating with a point of view is editorial work; republishing a page because it ranked somewhere else is scraping.

Why it matters

Why scraped content matters

For the site doing the scraping, the risks are a ranking drop, a manual action for spam, and in many cases a copyright claim. For the site being scraped, the harm is subtler and more common: its content appears on another domain, sometimes outranking the original for a while, taking its traffic and confusing searchers about who said it first. Brands whose product descriptions and editorial get copied into marketplaces and affiliate sites deal with this constantly.

It also matters as the line between curation and theft. A site that publishes industry news, reviews or guides needs to know where quoting ends and copying begins, and so does the agency writing its content.

In practice

How scraped content works in practice

  1. 01

    Detecting scraping of your own site is a search. Take a distinctive sentence from a page, put it in quotes, search it, and see where it appears. Tools such as Copyscape automate that across a site. Google generally identifies the original by which version it saw first and by which domain it trusts more, so a well-established site is usually safe, but a new site can be outranked by a scraper of its own launch content.

  2. 02

    Dealing with it is a ladder. Ask the site to remove it. If they will not, file a copyright removal request with Google, which takes the scraped URLs out of its results, and a DMCA notice with the site's host. Internally, make sure your own pages are crawled fast, by submitting new URLs through Search Console, so that Google sees the original first. And on your own site, be sure nothing you publish could be mistaken for scraping: attribute quotations, add original analysis and never republish a supplier's product copy word for word across hundreds of pages.

Watch out

What people get wrong about scraped content

Thinking rewording makes it original. Spinning a copied article with synonyms produces text that Google's systems recognize as derivative and readers recognize as nonsense. Original value means a point of view, new information or real synthesis, not a thesaurus.

The other mistake is assuming your supplier's product descriptions are yours to use as they are. They are on a thousand other retailers' sites too, and a page built on them is duplicate content at best. Rewrite them, or add the detail only you have.

Questions

People also ask

Is scraped content illegal?

Copying substantial content without permission is usually copyright infringement, which is a civil matter rather than a crime, and the owner can send a takedown notice or sue. Separately, Google's spam policies treat scraped content as a violation that can bring a ranking penalty or removal from results.

How do I find out if my content has been scraped?

Search a distinctive sentence from your page in quotation marks and look for other domains showing it. Services such as Copyscape check an entire site for copies. Checking after each major launch catches scrapers while the request to remove is still simple.

What should I do if another site has copied my content?

Contact the site and ask for removal. If that fails, submit a copyright removal request to Google to have the copied pages taken out of search results and send a DMCA notice to the site's hosting provider. Keep records of dates and URLs; the earliest published version is the evidence.

Next to it in the glossary

  1. 200 (OK) Response CodeA 200 OK response code is the server's confirmation that a request succeeded and the page was delivered as asked.
  2. 301 RedirectA 301 redirect is a permanent instruction that sends browsers and search engines from an old URL to a new one, carrying the old page's ranking signals with it.
  3. 302 RedirectA 302 redirect is a temporary instruction that sends visitors from one URL to another while telling search engines the original address will return.
  4. 304 Not ModifiedA 304 Not Modified response tells a browser or a crawler that the page has not changed since it was last fetched, so the cached copy can be used instead.
  5. 307 Temporary RedirectA 307 Temporary Redirect sends a visitor to a different URL for now, while guaranteeing that the request is repeated exactly as it was made.
  6. 403 ForbiddenA 403 Forbidden error means the server understood the request but refuses to serve the page, usually because the visitor does not have permission to see it.

Every SEO and Analytics term →

In the work

Where it shows up

All our creations →

From the journal

Read around it

The journal →

Talking the talk is one thing

We make the work.

RIOT is a creative agency and production studio in New York. Strategy, brand, film, photography, design and the campaigns that carry them, made by one team. A few lines is enough to start: we read every brief the same day.

    Footage