User-agent: * Disallow: /kb/afmsendbyemail.aspx Disallow: /store/adm #Crawlers do not need access to your console, so this rule disallows all console pages for crawlers Disallow: /store/shopCa #Crawlers cannot add items to a shopping cart, so prevent them from viewing the cart page Disallow: /store/WriteR #Crawlers cannot submit product reviews, so there is no need for them to view this page. The content of product reviews is on a separate page that is allowed Disallow: /store/addtoc #is used in embedded commerce and allows items to be added to the cart. There is no content on this page and therefore crawlers do not need to see it. Disallow: /store/OnePageCh # generally contains no inherent SEO value, and crawlers cannot add items to their cart to be able to access this page, therefore it is disallowed Disallow: /store/checko #This page contains no content Disallow: /*Attrib= #If you use attributes, these rules allow you to avoid duplicate content warnings when customers filter by specific attributes. Disallow: /*?Attrib= #If you use attributes, these rules allow you to avoid duplicate content warnings when customers filter by specific attributes. Disallow: *attribs= #If you use attributes, these rules allow you to avoid duplicate content warnings when customers filter by specific attributes. Disallow: *Attribs= #If you use attributes, these rules allow you to avoid duplicate content warnings when customers filter by specific attributes. Disallow: /capital-one-may-2015-offer #Block crawlers from this email only promotional page. J.T.C per BRob's request 2015.420 Disallow: /store/admin/login.aspx Disallow: /americommerce2 Disallow: /securityawareness