Web crawlers scan and index websites to display them in search results. You can prevent your site from appearing in search results while keeping it accessible to visitors.

Block All Search Engine Crawlers

1. Go to Settings > Crawlers
2. Check "Block search engine crawlers"
3. This adds a blocking rule to your robots.txt file

Exclude Specific Pages from Search Results

You can add a noindex tag in two ways:

1. Through Page Settings:

• Open Pages panel
• Click Settings (gear icon) on desired page
• Go to SEO tab
• Enable "Hide page from search results"

2. Via Code Insertion:

• Add this code to the page's Header:

<meta name="robots" content="noindex" />

Important Notes:

• Excluding a collection page also excludes all its items (products, blog posts, etc.)
• Individual collection items cannot be excluded separately
• Excluding an index page doesn't affect its subpages
• These methods only affect external search engines, not site search
• Pages remain accessible to direct visitors

Page Settings vs. Code Insertion

Page Settings:

• Available on all plans
• No coding required
• Removes page from sitemap
• Not available for homepage
• Enabled on demo pages

Code Insertion:

• Available on Business plans and higher
• Requires manual code addition
• Keeps page in sitemap
• Works on homepage
• More flexibility but requires technical knowledge

Remember that hiding pages from search results doesn't affect their visibility to direct visitors or prevent access to the content.

Related Articles

Previous Articles