Hide Your Website from Search Engine Crawlers: A Step-by-Step Guide
Search engines scan websites using web crawlers (bots) to index content for search results. Here's how to hide your website or specific pages from these scans.
Hide Your Entire Website
- Go to Settings > Crawlers
- Check "Block search engine crawlers"
- This adds a robots.txt rule preventing search engines from indexing your site
Hide Specific Pages
You can add a noindex tag using two methods:
Page Settings Method:
- Navigate to Pages menu
- Hover over page and click settings
- Go to SEO tab
- Enable "Hide Page from Search Results"
Benefits:
- Available on all subscriptions
- No coding required
- Removes page from sitemap
- Automatically enabled on demo pages
Code Injection Method:
- Add this code to page header:
<meta name="robots" content="noindex" />
Benefits:
- Works on homepages
- Keeps page in sitemap
- Available on all plans except Personal
Important Notes:
- Hiding a collection page also hides all its content (products, posts, etc.)
- Individual collection items can't be hidden separately
- Hiding an index page doesn't hide its subpages
- Pages remain visible in website search
- These methods only affect external search engines
While both methods are effective, use Page Settings unless you specifically need Code Injection features. Remember that custom code modifications aren't supported by customer service and may require updates after platform changes.
Your website remains accessible to direct visitors - it just won't appear in search results.