Robots.txt Generator

Default for All Robots Allowed Refused

Crawl Delay None 5 Seconds 10 Seconds 20 Seconds 60 Seconds 120 Seconds

Sitemap

Google Allowed Refused

Google Images Allowed Refused

Google Mobile Allowed Refused

MSN Search Allowed Refused

Yahoo Allowed Refused

Yahoo MM Allowed Refused

Yahoo Blogs Allowed Refused

Ask/Teeoma Allowed Refused

GigaBlast Allowed Refused

DMOZ Checker Allowed Refused

Nutch Allowed Refused

Alexa / Wayback Allowed Refused

Baidu Allowed Refused

Naver Allowed Refused

MSN PicSearch Allowed Refused

Disallowed Directories