User-agent: * Disallow: /cgi-bin/ Disallow: /Bzr/ Disallow: /tmp/ Disallow: /libsndfile/files/ Disallow: /CSS/ Disallow: /Debian/ Disallow: /Lists/ Disallow: /erikd/Blog/files/ # Msnbot seems to ignore this file altogether so I configured apache # to feed it rubbish when it strays. # User-agent: msnbot/2.0b* # Disallow: /