User-agent: * Disallow: /cgi-bin/ Disallow: /images/ Crawl-Delay: 10 Deny: CIDR 209.167.50.16/28 Deny: CIDR 216.94.13.120/29 Deny: http://juniper.net Deny: http://seventwentyfour.com User-agent: * Disallow: /adspy