# good bots User-agent: Mediapartners-Google* Disallow: User-agent: Googlebot Disallow: User-agent: Googlebot-Image Disallow: User-agent: MSNBot Disallow: User-agent: Slurp Disallow: User-agent: Teoma Disallow: User-agent: yahoo-blogs/v3.9 Disallow: # bad bots User-Agent: almaden Disallow: / User-Agent: ASPSeek Disallow: / User-Agent: Axmo Disallow: / User-Agent: BaiduSpider Disallow: / User-Agent: booch Disallow: / User-Agent: DTS Agent Disallow: / User-Agent: Downloader Disallow: / User-Agent: EmailCollector Disallow: / User-Agent: EmailSiphon Disallow: / User-Agent: EmailWolf Disallow: / User-Agent: Expired Domain Sleuth Disallow: / User-Agent: Franklin Locator Disallow: / User-Agent: Gaisbot Disallow: / User-Agent: grub Disallow: / User-Agent: HughCrawler Disallow: / User-Agent: iaea.org Disallow: / User-Agent: lcabotAccept Disallow: / User-Agent: IconSurf Disallow: / User-Agent: Iltrovatore-Setaccio Disallow: / User-Agent: Indy Library Disallow: / User-Agent: IUPUI Disallow: / User-Agent: Kittiecentral Disallow: / User-Agent: iaea.org Disallow: / User-Agent: larbin Disallow: / User-Agent: lwp-trivial Disallow: / User-Agent: MetaTagRobot Disallow: / User-Agent: Missigua Locator Disallow: / User-Agent: NetResearchServer Disallow: / User-Agent: NextGenSearch Disallow: / User-Agent: NPbot Disallow: / User-Agent: Nutch Disallow: / User-Agent: ObjectsSearch Disallow: / User-Agent: Oracle Ultra Search Disallow: / User-Agent: PEERbot Disallow: / User-Agent: PictureOfInternet Disallow: / User-Agent: PlantyNet Disallow: / User-Agent: QuepasaCreep Disallow: / User-Agent: ScSpider Disallow: / User-Agent: SOFT411 Disallow: / User-Agent: spider.acont.de Disallow: / User-Agent: Sqworm Disallow: / User-Agent: SSM Agent Disallow: / User-Agent: TAMU Disallow: / User-Agent: TheUsefulbot Disallow: / User-Agent: TurnitinBot Disallow: / User-Agent: Tutorial Crawler Disallow: / User-Agent: TutorGig Disallow: / User-Agent: WebCopier Disallow: / User-Agent: WebZIP Disallow: / User-Agent: ZipppBot Disallow: / User-Agent: Xenu Disallow: / User-Agent: Wotbox Disallow: / User-Agent: Wget Disallow: / User-Agent: NaverBot Disallow: / User-Agent: mozDex Disallow: / User-Agent: twiceler Disallow: / User-Agent: Yeti Disallow: / User-Agent: PiplBot Disallow: / User-agent: * Disallow: Crawl-delay: 60 Disallow: /