Robots.txt File Generator

27th February 2009

I was editing some further details to the reporting of the SEO Automatic tool, and I realized that I never included an easy solution for users not having a robots.txt file. Sorry about that…

The folks over at SEOchat have been kind enough to share their code, which will allow you to instantly create a proper robots.txt file and upload it you your domain root…

Robots.txt Generator Tool © SEO Chat™ Allowed User Agent Select user agent or use default for all agents All AgentsAlexa AgentAltaVista AgentAOL Netfind/Excite AgentGoogle AgentHotBot AgentInfoSeek AgentLycos AgentMSN Search CrawlerNorthern Lights AgentWebcrawler Agent Enable All Webpages Yes No Exclude These URL’s Enter URLs you wish to exclude /cgi-bin/ Enter Captcha To Continue To prevent spamming, please enter in the numbers and letters in the box below Report Problem with Tool.