# robots.txt file for web.ew.usna.edu # DO NOT delete this file # #lmb - blocking by User-agent isn't necessarily effective, # as it can easily be changed. Also, some bots do NOT # adher to robots.txt etiquette #User-agent: BadBot #Disallow: / User-agent: * Disallow: /cgi-bin/ Disallow: /docs/ Disallow: /AccessWatch/ Disallow: /Admin/ Disallow: /aerospace/ Disallow: /answers/ Disallow: /backup/ Disallow: /divhis/ Disallow: /god/ Disallow: /images/ Disallow: /misc/ Disallow: /pbbs/ Disallow: /temp/