123 Reg logo Blog

What’s Robots.txt and How Do I Optimise it for WordPress?

By Thom Harrison - April 30, 2024

What is Robots.txt?

Links: To follow or not to follow

Do I need to worry about Robots.txt?

Why edit Robots.txt?

How does Robots.txt work?

Where do I find my Robots file in WordPress?

How do I add/optimise my Robots file?

Via Plugin


Check out Google’s Robots Testing Tool

How do I update WordPress permalinks?

For more, check out: SEO Essentials — The A-Z SEO Guide

Wrap Up