# block all access to certain subsections of the site User-agent: * Disallow: /view/ Disallow: /view_email/ Disallow: /charts/ Disallow: /email/ Disallow: /sparktag/ Disallow: /sparkline/ Disallow: /sparksrch/ Disallow: /paddlepop/ Disallow: /paddlepops/ Disallow: /terms/ # block the dotbot http://www.dotnetdotcom.org/ User-agent: dotbot Disallow: / User-agent: Baiduspider Disallow: / User-agent: NAVER Disallow: / User-agent: Yeti Disallow: / User-agent: YodaoBot Disallow: /