# CRELoaded Generated Robots.txt # Robot Exclusion File -- robots.txt # Author: CRELoaded Team # Last Updated : May 11th 2005 User-agent: Googlebot-Image #google's image bot Disallow: / #should ignore my site(s) User-agent: Yahoo-MMCrawler #Yahoo's image bot Disallow: / #should ignore my site(s) User-agent: * #any other bot Crawl-delay: 10 #wait 10 seconds between accesses