# Provided courtesy of www.GaryKeith.com # Created on October 21, 2003 at 5:56:22 PM GMT # The bots in this section are asked not to spider any of this site. # Persistent unauthorized bots may be banned by host and/or IP. User-agent: CFM-SearchBot(http://www.cfm-search.com) Disallow: / User-agent: CJNetworkQuality Disallow: / User-agent: Comodo Disallow: / User-agent: eseek-crawler Disallow: / User-agent: Googlebot-Image Disallow: / User-agent: Googlebot Disallow: / User-agent: Hatena Antenna Disallow: / User-agent: Infoseek SideWinder Disallow: / User-agent: Infosniff Sniffer Disallow: / User-agent: MSNBOT Disallow: / User-agent: NPBot Disallow: / User-agent: Nutch Disallow: / User-agent: SearchSpider.com Disallow: / User-agent: semanticdiscovery Disallow: / User-agent: TutorGig Disallow: / User-agent: Tutorial Crawler Disallow: / User-agent: UbiCrawler Disallow: / User-agent: WebFilter Robot 1.0 Disallow: / User-agent: WebmasterWorldForumBot Disallow: / User-agent: YahooSeeker Disallow: / # everyone else is asked to avoid the following folders and files: User-agent: * Disallow: /