# Robots.txt file created by http://www.webtoolcentral.com # For domain: http://www.humidorhaven.com # All robots will spider the domain User-agent: * Disallow: /admin/ Disallow: /logs/ Disallow: /carts.asp Disallow: /orderstatus.asp Disallow: /cac/ User-agent: Missigua+Locator+1.9 Disallow: / User-agent: Missigua Locator 1.9 Disallow: / User-agent: e-societyrobot Disallow: / User-agent: NG/2.0 Disallow: / User-agent: BecomeBot Crawl-Delay: 1 User-agent: org.archive_bot Disallow: / User-agent: psbot/0.1 Disallow: / User-agent: aipbot/1.0 Disallow: / Sitemap: http://www.humidorhaven.com/sitemap.xml # libwww-perl (LWP) is a library for Perl now used by many script kiddie, crackers, and spam bots. User-agent: libwww-perl Disallow: /