User-agent: HTTPFetch Spider, contact spider@company.com for details Allow: / User-agent: * Disallow: /