# robots.txt for http://www.steppenwolfgang.de/ User-agent: Microsoft.URL.Control Disallow: / User-agent: msnbot Disallow: / User-agent: msnbot-media Disallow: / User-agent: * Disallow: /logs/ # private # Massendownloader vom CGI Verzeichnis fernhalten User-agent: wget User-agent: webzip User-agent: webmirror User-agent: webcopy Disallow: /