Robots.txt :: for WordPress
If you are a regular user of our official blog, you might have introduced Mr. Robots.txt before. If you are not, read our archived article The Importance of robots.txt. After analyzing many well furnished robot for various different sites, I...
The importance of robots.txt
Although the robots.txt file is a very important file if you want to have a good ranking on search engines, many Web sites don’t offer this file. If your Web site doesn’t have a robots.txt file yet, read on to...