# Tells robots where they are not welcome. # # Copyright (C) 2004 slady # # # User-agent: can also specify by name; "*" is for everyone # Disallow: disallow if this matches first part of requested path # # Disallow all the scripts. # User-agent: * Disallow: /cgi Disallow: /exe