Menu

Correct your meta-robots

You've just completed your site audit and found that a large number of non-strategic URLs, such as certain faceted pages, are being crawled. This is impacting your "crawl budget" by consuming resources on pages that provide no SEO value. Let's take a look at how to correct this in just a few minutes with the "SEO Recommendation" application.

The tutorial

Level: Easy.
Applications used: RecommendationSEO

Step 1: Create an SEO recommendation

1. Log on to the EdgeSEO console
2. Go to the "SEO Recommendations" application.


3. Click on the "Add a recommendation" button.


Step 2: Naming your recommendation

1. Give your recommendation an explicit name, e.g. "Modification of meta-robots".
2. Briefly describe the objective, e.g.: Optimize my site's crawl budget.

Step 3: Define the target

1. Target the pages where you wish to modify the attributes of the meta-robots tag.
2. Select the query URL option and then match a regex to target a subset of pages. For example, I want to target all URLs that have this pattern in the URL: prefn. You can also target individual URLs. For example, I want to target only this URL: https://www.exemple.fr

Step 4: Configuring the SEO recipe

1. Sélectionnez la recette SEO Balise <meta robot>

2. Select the attributes you're interested in: index / noindex and follow / nofollow.

Step 5: Validation and verification of results

Click validate to save your recommendation.

Go to a URL you've targeted and check that the tag's attributes are those you've set.

The meta-robots tag before applying the recommendation


The meta-robots tag after application of the recommendation

👉 Discover the "SEO Recommendation" application documentation