User-Agent: * Disallow: /cgi-bin/ Disallow: /htbin/ Disallow: /ch/d/gg/cr/ Disallow: /ch/f/gg/cr/ Disallow: /ch/i/gg/cr/ Disallow: /ch/d/sr/chr2/ Disallow: /ch/f/sr/chr2/ Disallow: /ch/i/sr/chr2/ Disallow: /ch/d/sr/chrono/ Disallow: /ch/f/sr/chrono/ Disallow: /ch/i/sr/chrono/ # Hat beim Robotstester Fehler gegeben, eliminiert: # Disallow: 217.84.119.131 # Crawl-delay: 10 # Visit-time: 1800-2400 # User-Agent: Xenu Link Sleuth 1.2g # Crawl-delay: 5 # Visit-time: 1800-2400