How to Add robots.txt Meta Tags to Your Site

icon1 Posted by Rochelle in How To..., Site Building Strategies on 02 10th, 2008 | 2 responses

If you have a robots.txt on your store’s site it is a good idea to add a meta tag that helps search engine spiders find your robots.txt file (click here for instructions on how to add a robots.txt to your site). Doing this may also help your site get indexed quicker, which will help bring more potential customers to your store.

 

My instructions to add robots.txt meta tags to your site:

Step One
 Log in to your site’s Admin and click on the ‘Template‘ tab and ‘header.php‘ link.
  
 Save a copy of the original code (click here for instructions on how to do this).
Step Two
 Copy and paste the contents of robots-meta.txt UNDER the other meta tags. The other meta tags may look different than the code you paste into header.php but they will have the word meta in their tags and will be under the <head> tag.
  
 Here is how the added meta code looks in the header.php for one of my sites:
Image of how the robots.txt meta tags look in header.php
  
 Save changes and view site for errors.
.

Rochelle

2 Responses to “How to Add robots.txt Meta Tags to Your Site”

  1. Val says:
    March 14, 2008 at 9:37 pm

    Hi Rochelle,
    It supposed to be robots and not “robot”

    I prefer to use this instead

    The following is not used anymore so there is no need to place it in BANS

  2. Val says:
    March 14, 2008 at 9:38 pm

    a part of my previous message did not get posted.
    the meta tag that is not used anymore is “revisit-after”

Leave a Reply