# shut off robots User-agent: * Disallow: /blog/2010/ Disallow: /blog/2009/ Disallow: /blog/2008/ Disallow: /blog/2007/ Disallow: /base_code/ Disallow: /bin/ Disallow: /cgi-bin/ Disallow: /demo/ Disallow: /fork_code/ Disallow: /java_code/ Disallow: /htbin/ Disallow: /proxy_code/ Disallow: /pvbin/ Disallow: /script_code/ Disallow: /serverdoc/ Disallow: /sysosf/ Disallow: /system/ Disallow: /$mapimage/ Disallow: /$omnimap/ Disallow: /$testcgi/ Disallow: /tarserv/ Disallow: /phonedir.html # Yahoo User-agent: Slurp Crawl-delay: 60.0