What Is a Noindex Tag?
Updated 17 September 2026
Jump to section
A noindex tag is a small instruction in a page's code that tells Google and other search engines to keep that specific page out of their search results. It takes one of two forms: a <meta name="robots" content="noindex"> tag in the page's HTML head, or a noindex value in the HTTP X-Robots-Tag response header. The page stays live for anyone who visits it directly. It simply never appears when someone searches.
How does a noindex tag work?
A noindex tag works only after a search engine crawls the page and reads the rule. Googlebot fetches the page, sees the noindex instruction, and drops that URL from its index, so the page stops appearing in results.
The tag sits in one of two places. The most common is a meta tag in the <head> of the HTML:
<meta name="robots" content="noindex">
The second is an HTTP header, X-Robots-Tag: noindex, which is useful for files that have no HTML head, such as PDFs. Both carry the same instruction to the same crawlers.
One point catches people out. A search engine can only obey a noindex rule on a page it is allowed to crawl. If you also block that page in robots.txt, the crawler never fetches it, never sees the noindex, and the rule does nothing. This mechanism is why the two tools are not interchangeable.
Noindex vs robots.txt: what is the difference?
Noindex and robots.txt control different stages of the process, and confusing them is the most common mistake. A noindex tag controls indexing, which is whether a crawled page is allowed into the results. Robots.txt controls crawling, which is whether the crawler may fetch the page at all.
The practical difference is sharp. Google states that a page blocked by robots.txt can still appear in search results, for example if other pages link to it (Google Search Central). The crawler never reads the page, so it never sees any noindex rule inside, and Google can still list a bare URL it discovered through links.
So to reliably keep a page out of Google, you let the crawler in and add a noindex tag. You do not block it in robots.txt.
| Tool | What it controls | Keeps a page out of results? |
|---|---|---|
noindex tag |
Indexing (after crawl) | Yes, once the page is crawled |
robots.txt Disallow |
Crawling (before fetch) | No, a linked URL can still be listed |
rel="canonical" |
Which duplicate is preferred | No, it is a consolidation hint |
Source: Block search indexing with noindex, Google Search Central.
A canonical tag is a third tool people mix in here, and it does something else again. It points search engines to the preferred version of near-duplicate pages, rather than removing anything. Reach for noindex when the page should never show at all.
When should you use a noindex tag?
A noindex tag suits pages that need to exist for visitors but add nothing to search results. The classic cases are thank-you and order-confirmation pages, internal search-result pages, printer-friendly duplicates, and thin tag or filter pages that split ranking signals without answering a real query.
Staging and test copies of a site are another common case, though a staging site is better kept private at the server level as well. A stray noindex left on after a redesign is a frequent cause of a page quietly dropping out of Google.
In our experience, a whole section of a site can disappear from search overnight. When it does, a noindex tag left behind from a staging build or a half-finished redesign is one of the first things worth ruling out. It is invisible on the page itself, so nobody notices until the traffic goes.
Be deliberate about it. Noindex removes a page from the index entirely, so it should never sit on a page you actually want found, such as a service or product page.
How do you add a noindex tag?
On a hand-built site, you add the meta tag to the page's <head>, or set the X-Robots-Tag header on the server. Both are one-line changes, and the header is the right choice for non-HTML files like PDFs.
On WordPress, which powers about 41% of all websites worldwide (W3Techs, as of August 2026) and a large share of Malaysian business sites, you rarely touch code. An SEO plugin such as Yoast or Rank Math adds a per-page "no-index" toggle, and WordPress itself has a "Discourage search engines" setting under Reading. That single checkbox applies a site-wide block, so it is worth confirming it is switched off on a live site.
After adding the tag, you can confirm it works in Google Search Console. The URL Inspection tool reports whether a page is indexed and shows the exact reason when it is excluded.
Frequently asked questions
Does a noindex tag remove a page from Google immediately?
Not instantly. Google has to crawl the page again to see the new noindex rule before it drops the URL. Depending on how often the page is crawled, that can take days or weeks. To speed it up, request indexing for that URL in Google Search Console after adding the tag. For an urgent removal, Google's Removals tool can hide a result temporarily while the crawl catches up.
What is the difference between noindex and nofollow?
Noindex and nofollow control different things and are often combined. Noindex keeps the page out of search results. Nofollow tells search engines not to pass ranking signals through the links on the page. You can use them together as content="noindex, nofollow", but for most pages you want kept private, noindex on its own is enough.
Will a noindex tag hurt my rankings?
Not on the pages that matter, as long as you apply it deliberately. Noindexing thin or duplicate pages can actually help, because it stops low-value URLs competing for attention and wasting crawl budget. The danger is applying it by accident to a page you want ranked, which removes that page from Google completely.
Can I noindex a page and still block it in robots.txt?
No, and doing both breaks the noindex. If robots.txt blocks the page, the crawler never fetches it, so it never sees the noindex rule inside. To keep a page out of results, allow crawling and use noindex. Save the robots.txt block for pages you simply do not want fetched, accepting that a linked URL may still appear.
How do I check if a page has a noindex tag?
View the page source in your browser and search for noindex. You can also use the URL Inspection tool in Google Search Console, which states plainly whether a page is indexed and why. Browser SEO extensions also flag noindex directives as you browse. If a page you expected to rank is missing, checking for a stray noindex tag is a fast first test.
Keep the right pages visible and the rest out of sight
Storming Solutions runs SEO, AEO, and GEO for Malaysian businesses from Kuala Lumpur. Sorting out which pages belong in Google, and which should be held back with noindex, is part of every technical audit we run.
We would rather spend an hour auditing index rules than let a stray tag hide a page that should be earning traffic.
Not sure whether the right pages on your site are actually indexed? Message us on WhatsApp or start with the SEO in Malaysia pillar. Our SEO, AEO, and GEO work keeps your best pages findable and the clutter out of the way.