Robots.txt File Generator

February 27th, 2009 by Scott Hendison

I was editing some further details to the reporting of the SEO Automatic tool, and I realized that I never included an easy solution for users not having a robots.txt file. Sorry about that…

The folks over at SEOchat have been kind enough to share their code, which will allow you to instantly create a proper robots.txt file and upload it you your domain root…

Robots.txt Generator Tool © SEO Chat™ Allowed User Agent Select user agent or use default for all agents All Agents Alexa Agent AltaVista Agent AOL Netfind/Excite Agent Google Agent HotBot Agent InfoSeek Agent Lycos Agent MSN Search Crawler Northern Lights Agent Webcrawler Agent Enable All Webpages Yes No Exclude These URL’s Enter URLs you wish to exclude /cgi-bin/ Enter Captcha To Continue To prevent spamming, please enter in the numbers and letters in the box below Report Problem with Tool.