|
Flowerguy
Starting Member
USA
1 Posts |
 Posted - October 28 2005 : 07:12:58
|
Thanks in advance to anyone who can help.
Does anyone have a list or some suggestions as to what file names to add in a ROBOT.TXT file for better SEO....
I have a site, using ver 5.5, where by many of the TELL A FRIEND and ASK A QUESTION LINKS are being found and posted on the SE's...Pointless in my mind and a waste of the robot, especially if that robot has a limit on the number of pages to crawl during it's visit.
For example, go to google and type in SITE:WWW.YOURSITE.COM and you may see lots of junk and some very good stuff too...
I'm sure there are plenty of other files and pages that we all want the SE to NOT INDEX and FOLLOW and a list of these may help all users.
Again, thanks in advance
Paul
Paul |
|
All Forums
Robot.txt files
New Topic
Printer Friendly
Topic 
TrustGuard - PCI Security Scanner
