# Prevent Crawling Unnecessary Endpoints - Dynamically added by BigScoots User-agent: * Disallow: /cdn-cgi/ Disallow: /wp-admin/ Disallow: /wp-json/ Disallow: /*?s= Disallow: /*?attachment_id= Disallow: /*?add-to-cart= Disallow: /*&add-to-cart= Disallow: /*?add_to_wishlist= Disallow: /*&add_to_wishlist= Disallow: /mvscripts/ #User-agent: * #Crawl-delay: 15 User-agent: test-bot Disallow: / # Basic Wordpress optimized robots.txt Crawl-delay: 60 User-agent: * Disallow: /cgi-bin Disallow: /wp-admin Disallow: /wp-includes Disallow: /wp-content/plugins/ Disallow: /wp-content/cache/ Disallow: /wp-content/themes/ Disallow: */trackback/ Disallow: /*? Disallow: /cart/ Disallow: /checkout/ Disallow: /my-account/