Creative agency glossarySEO and Analytics

Deindexing

Deindexing is the removal of a page or a whole site from a search engine's index so that it no longer appears in results.

What is deindexing?

Deindexing is the act of getting a URL out of a search engine's index. An indexed page is one Google has crawled, understood and stored so it can be served as a result; a deindexed page has been dropped from that store, deliberately or otherwise. It can be your choice (a noindex tag on a thin page, a removal request for a leaked document) or Google's (a manual action for spam, a page that returned 404 for long enough).

The term covers both the surgical and the catastrophic. Deindexing a staging subdomain is housekeeping. Having a whole domain deindexed is the worst outcome in search, and it is rare, usually reserved for pure spam or hacked sites.

Why it matters

Why deindexing matters

An index full of pages you do not want ranking is a liability. Internal search results, expired campaign microsites, duplicate parameter URLs, a PDF with a client's pricing in it: every one of these can outrank the page you actually built, and every one spends crawl budget that could go to the work that matters. Getting the wrong pages out is as much a part of SEO as getting the right pages in.

It also matters because it is slow and partly outside your control. Google decides when to recrawl, and a page can linger in results for weeks after you have asked for it to go. Knowing the fast path (the Removals tool) from the permanent one (noindex, a 410) is the difference between a problem fixed today and a problem fixed next quarter.

In practice

How deindexing works in practice

  1. 01

    Start by deciding what the page should become. If a better page exists, redirect to it with a 301 and let the index consolidate. If the page should exist but not rank, add a noindex robots meta tag or an X-Robots-Tag header and leave it crawlable so Google can see the instruction. If it should not exist, return 410 Gone (or 404) and remove internal links to it. For anything urgent, such as leaked or sensitive content, use the Removals tool in Search Console, which hides the URL within about a day for roughly six months while the permanent fix takes effect.

  2. 02

    Then verify. The Page indexing report in Search Console shows what Google still holds; URL Inspection confirms a single page's status. One thing to avoid: blocking the URL in robots.txt as the way to deindex it. A blocked page cannot be crawled, so Google never sees the noindex tag, and the URL can stay in results as a bare link for as long as something points to it.

Watch out

What people get wrong about deindexing

The robots.txt mistake above is the big one; we see it on nearly every audit. The second is deindexing pages that were quietly earning: an old blog post with real backlinks gets noindexed in a cleanup and the links stop counting toward anything. Redirect it instead. The third is panic. A page missing from the index is often just not yet crawled, or filtered as a duplicate, not removed. Check the report before rebuilding anything.

Questions

People also ask

How long does deindexing take?

With a noindex tag or a 410, as long as it takes Google to recrawl the page, which can be days for a busy site and weeks for a quiet one. The Removals tool in Search Console hides a URL within about a day, but only temporarily, so the permanent signal still needs to be in place.

Can I deindex a page with robots.txt?

Not reliably. Disallowing a URL stops Google crawling it, but if other pages link to it the URL can stay indexed with no snippet. To remove a page, let it be crawled and serve a noindex tag, a 410 or a redirect.

Does deindexing hurt my rankings?

Deindexing the right pages (thin, duplicate, expired) usually helps, because the pages left are stronger and crawl attention concentrates on them. Deindexing pages with links pointing to them throws that equity away; redirect those rather than remove them.

Next to it in the glossary

  1. Dashboard SoftwareDashboard software is a tool that pulls data from several sources into one live screen of charts and figures, so the people running a business or a campaign can see how it is doing without opening every platform.
  2. Data VisualizationData visualization is the practice of turning numbers into charts, maps, diagrams and graphics so that a pattern, a comparison or a result can be seen at a glance instead of read from a table.
  3. Data-NosnippetData-nosnippet is an HTML attribute that tells Google not to show a marked section of a page's text in its search result snippets.
  4. Direct TrafficDirect traffic is the share of website visits that arrive with no referrer, typically from a typed URL, a bookmark or an untagged link.
  5. Directory SubmissionDirectory submission is the practice of listing a website in online directories to earn citations, referral visits and backlinks.
  6. Disavow ToolThe Disavow Tool is a Google Search Console feature that lets a site owner ask Google to ignore specific backlinks when assessing the site.

Every SEO and Analytics term →

In the work

Where it shows up

All our creations →

From the journal

Read around it

The journal →

Talking the talk is one thing

We make the work.

RIOT is a creative agency and production studio in New York. Strategy, brand, film, photography, design and the campaigns that carry them, made by one team. A few lines is enough to start: we read every brief the same day.

    Footage