Menu

Challenge: Regain control over your robots.txt file

You're about to learn how to modify your site's robots.txt file without relying on your CMS. It's fast, simple and directly actionable from the Robots.txt application.

The challenge in video

Let's go! We guide you step by step

  1. Log in to the EdgeSEO console
  2. Click on the Robots.txt application
  3. Activate the "Replace robots.txt" button
  4. In the field that appears, enter the rules you wish to apply
  5. You can also add a custom ASCII key - e.g. # miaou =^.^= 🐱
  6. Click on "Save
  7. Check that the file can be accessed at the following URL: https: //www.url-de-mon-site.fr/robots.txt

Useful resources

You're now autonomous when it comes to managing your robots.txt file. You can start optimizing your crawl budget right away.