Website SEO Texas – Robots.txt

Website SEO

What is a Robots.txt file?

It is a text file that tells the search engine bots what files to index and what files to skip. It is a public file so it is not used to hide files. It is only used to tell the bots what files to skip indexing.

Why would I want to have some files not indexed?

One of the easiest examples would be your legal policies. There is not reason for them to be indexed by the search engines. There are many reasons why you should have them.

So How Do I Create a Robots.txt File?

If you are using a WordPress blog, find a plugin to use. Once activated all you need to do is to add the instructions. And for more information on how to write the instructions go to robotstxt.org.

So take action so your business can Get Found Online.

Until The Next Time,