#Allow access for Allianz Internal Search User-agent: allianz-internal-crawler Disallow: #Allow access for Google User-agent: Googlebot Disallow: /*/resources/ #Allow access for MSN User-agent: msnbot Disallow: /*/resources/ #Allow access for Yahoo (Slurp) User-agent: Slurp Disallow: /*/resources/ #Generally block everyone else User-agent: * Disallow: /