Guide To Blocking Unwanted Resources – SUSO Digital

Googlebot can index any resources on the site, including the ones that does not have much value for users and shouldn't be indexed. An example of such content could be a "Find out about the product" form where the form is generated under a different URL (eg. containing a product ID or a timestamp). It could result in the same number of form-only pages being indexed as the number of products in the store. Addressing this issue is therefore of a very high importance in terms of SEO.