SEO: How do I block the entire site from the search engines via robots.txt?


In some cases, you may need to actively prevent search engines from indexing your Shift4Shop store. This is typically needed when you are developing a copy of your store on Shift4Shop and - since it likely contains the same product information as your live store - you need to prevent the development store from being indexed to avoid information from being interpreted as "duplicate content."

The best way to do this is to edit your robots.txt files to prevent all indexing on the store. Here's how:

  1. Log into your Shift4Shop Online Store Manager
  2. Using the left hand navigation menu, go to Marketing >SEO Tools
  3. Under "SEO Settings" locate the "Robots.txt" section and click on the "Edit Robots.txt File" link
  4. Remove all of the information in the Robots.txt section and replace it with the following

User-agent: *
Disallow: /

  1. Then click "Save" at the top right to commit your changes.

The Shared SSL (or *, for legacy users) Robots.txt section at the bottom should already be set this way. However if it is not, you'll want to update it as well.

Help Desk Software by Kayako fusion