# --------------------------------------------------------> # Robot Exclusion File -- robots.txt # Author: PNOOZ # Website URL: http://pnooz.com/ # File Name: http://pnooz.com/robots.txt # Last Updated: Monday, October 27, 2008 # --------------------------------------------------------> # Ordered as to avoid interpretation problems with bots. # Disallowed Robots --------------------------------------> # NameProtect Inc. # http://www.nameprotect.com/botinfo.html User-agent: NPBot Disallow: / # Picsearch # http://www.picsearch.com/bot.html User-agent: psbot Disallow: / # Allowed Robots / Disallowed Paths ----------------------> User-agent: * Disallow: /cp/ Disallow: /old/ Disallow: /archive/ Disallow: /images/ Disallow: /cgi-bin/ Disallow: /css/ Disallow: /java/ Disallow: /js/ Disallow: /rssjs/ Disallow: /demo/ Disallow: /private/ Disallow: /uploads/ Disallow: /downloads/ Disallow: /backup/ Disallow: /webalizer/ Disallow: /modlogan/ Disallow: /logs/ # Disallowed File Types ----------------------------------> Disallow: /*.css Disallow: /*.js Disallow: /*.zip Disallow: /*.exe Disallow: /*.pl Disallow: /*.cgi