# robots.txt for http://www./ # permitting most crawling and scraping User-agent: * Disallow: # banning Google's robot from /geportal/* User-agent: googlebot Disallow: /geportal/* # banning Google's image index robot User-agent: Googlebot-Image Disallow: / # banning Yahoo! Image Search robot User-agent: Yahoo-MMCrawler Disallow: / # banning picsearch robot User-agent: psbot Disallow: /