# Robot exclusion file. For format see "A standard for robot exclusion" # at http://info.webcrawler.com/mak/projects/robots/norobots.html # # # Don't distinguish between robots User-agent: * # # Exclude all usage pages as they only cause trouble # Disallow: /cgi-bin/