# Good URL for reference: http://www.robotstxt.org/wc/faq.html # Validator: http://tool.motoricerca.info/robots-checker.phtml # Allow all robots to browse everywhere User-agent: * Disallow: /cgi-bin/