User-agent: * # directed to all spiders, not just Scooter Disallow: /cgi-bin/ Disallow: /images/ Disallow: /urchin/ Disallow: /admin/ Disallow: /sendmail/ Disallow: /local/