October 31, 2005

Robots.txt Generator

Filed under: uncategorized — admin @ 6:29 pm

Robots.txt is a file that allows or disallow page access to most major search engine robots. Enter the pages or folders(relative to your root path) that you would like to prevent each spider from indexing in the boxes below, and click generate to get a ready Robots.txt. To disallow spidering anything on the site, put a forward slash("/") in the pages box. Then place it into the root folder of your site to activate.

Google Pages or Folders to disallow (one per line):
Google Image Search Pages or Folders to disallow (one per line):
Yahoo Pages or Folders to disallow (one per line):
MSN Pages or Folders to disallow (one per line):
Teoma/Ask Jeeves Pages or Folders to disallow (one per line):
DMOZ Checker Pages or Folders to disallow (one per line):
Alexa Pages or Folders to disallow (one per line):
Atavista Pages or Folders to disallow (one per line):
All the Rest Pages or Folders to disallow (one per line):

1 Comment »

  1. Xanax.

    Xanax valium. Xanax dosage. Xanax overnight. Pharmacy order generic xanax. Xanax. Drug interactions depression xanax. Xanax side effects. Buy xanax online without a prescription.

    Trackback by Xanax effect. — August 18, 2008 @ 2:13 am

RSS feed for comments on this post. TrackBack URI

Leave a comment


Powered by WordPress. Theme by H P Nadig