yanknudtskov of YanCo ApS
6/25/2017 - 11:29 AM

Prevent robots from crawling WooCommerce add-to-cart links, which can create a huge performance hit. https://closte.com/blog/prevent-robots-

Prevent robots from crawling WooCommerce add-to-cart links, which can create a huge performance hit. https://closte.com/blog/prevent-robots-crawling-add-to-cart-links-on-woocommerce

robots.txt
content_copyfile_download
User-agent: *
Disallow: /*add-to-cart=*
Disallow: /cart/
Disallow: /checkout/
Disallow: /my-account/