# All robots will spider the domain User-agent: ia_archiver Disallow: / User-agent: * Disallow: testper.htm Disallow: Events.htm Disallow: /pendants/ Disallow: /TastyGifts/ Disallow: /scripts/ Disallow: /Home/ Disallow: /orderdata/ Disallow: /orderinfo/ Disallow: /mof15/ Disallow: /webstats/