Robots.txt
The robots.txt is a text file located in the root directory of a website. It is used to tell search engine robots which pages they should not crawl. I tell you all about it in this SEO guide
Meta robots
What are meta robots in SEO? First episode of a series of posts and videos. Basic manuals to go deeper into the world of SEO.
