User-agent: Googlebot Disallow: /*__ariadne* User-agent: ICCrawler - iCjobs Disallow: / User-agent: ICCrawler Disallow: / User-agent: iCCrawler Disallow: / User-agent: * Crawl-delay: 3