Removing content from Google's index

 

There are a thousand reasons why you might not want search engines indexing particular content on a published project. Maybe you need to publish assets or sensitive information but don't want Google — or any other search engine — listing that page in search results.

In this lesson

We're going to show you one of the most common ways to block Google from indexing your content — using this snippet of code: <meta name="robots" content="noindex">

  1. Remove a page from the index
  2. Remove a site from the index
Before you begin

Remove a page from the index

To remove a specific page, add the code snippet in the <head> code of that page.

  1. Go to Page panel  → Page settings →  Custom code
  2. Paste the code: <meta name="robots" content="noindex" />
  3. Save and publish

Remove a site from the index

To remove the entire project from the index, add the same code in the <head> code of the project.

  1. Go to Project settings  →  Custom code  → Head code
  2. Paste the code: <meta name="robots" content="noindex" />
  3. Save the changes
  4. Publish the site
Good to know
  • You won't need to add the noindex code for pages that are saved as draft since they aren't published at all. So, if you have any pages that are still under construction, or that you do not need to publish (like your project’s style guide for example), it's best to save them as draft.
Troubleshooting

Search engines must be able to crawl your page in order to see the noindex meta tags. If they cannot crawl your page, they won’t be able to read that code, meaning your page will still be indexed and might still appear in search results.

If your page is still appearing in search results after you’ve added the noindex code, check the following:

  1. Go to your page settings and check that the code snippet is saved in the head section of your custom code
  2. Publish the site again
  3. Request Google to recrawl your page using the Fetch as Google tool
  4. Check your robots.txt file if it's blocking your page or site. You can test your robots.txt using the robots.txt Tester tool.
  5. If the page is blocked from webcrawlers, unblock it by removing it from your robots.txt file
  6. Publish your site again
  7. Again, request Google to recrawl your page
Helpful resources