User-agent: * Disallow: User-agent: bingbot Crawl-delay: 1 User-agent: googlebot Crawl-delay: 5 User-agent: 2345explorer Crawl-delay: 5 User-agent: obot Crawl-delay: 5