|
bme
Starting Member
35 Posts |
 Posted - November 23 2005 : 18:14:12
|
I use 2 shoppage_header files for various pages. Both have robots meta tags. 1 has index,follow and the other has noindex,nofollow. I apply them to whatever page is appropriate.
I also have a robots.txt file in the main directory tree that disallows what ever pages I want.
The robots don't have to follow the instructions, but none of the disallowed pages have been indexed.
Here is what my robots.txt file looks like;
User-agent: *
Disallow: /images/
Disallow: /editor/
Disallow: /databasefoldername/
Disallow: /logs/
Disallow: shopaddtocart.asp
Disallow: shopcustomer.asp
Disallow: shopcreateorder.asp
Disallow: shopcheckout.asp
Disallow: shopthanks.asp
Disallow: shopemptycart.asp
Disallow: shoptellafriend.asp
Edited by - bme on November 23 2005 22:24:36 |
 |
|
All Forums
Stop robots Indexing Shoptellafriend.asp
New Topic
Printer Friendly
Topic 
TrustGuard - PCI Security Scanner
