Increasing Search Engine Ranks
5 January 2008Short after I wrote about improving SEO for yahoo, I found additional tips that will works for any Search Engine including Yahoo. The optimization will be applied on robot.txt file located in your root directory. For you who didn’t know what is robot.txt I will give short description. The robots.txt is a simple text file used to tell search engine bots which pages on your web site should be crawled and indexed.
By regulating their behavior of how indexing the website/blog, we can increase our site’s position on Search Engine result. Irrelevant pages on your blog could be excluded from search engine index and therefore only relevant pages will included on their indexed. You only need to add several lines on your robot.txt file. If you couldn’t find this file on root folder, simply create one and save it on your server.
I found a ready made robot.txt from AskApache and applied it here and on Gadget Blog as well. The codes are as following.
User-agent: *
Disallow: /cgi-bin
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /wp-content/plugins
Disallow: /wp-content/cache
Disallow: /wp-content/themes
Disallow: /trackback
Disallow: /comments
Disallow: /category/*/*
Disallow: */trackback
Disallow: */comments
Disallow: /*?*
Disallow: /*?
Allow: /wp-content/uploads
# Google Image
User-agent: Googlebot-Image
Disallow:
Allow: /*
# Google AdSense
User-agent: Mediapartners-Google*
Disallow:
Allow: /*
# Internet Archiver Wayback Machine
User-agent: ia_archiver
Disallow: /
# digg mirror
User-agent: duggmirror
Disallow: /
Wait for 5 to 10 days to the result of this robot tweaks and enjoy your increased SERP position.
Perhaps if the new crawler from Tony Spencer visit this blog, it won’t have difficulties to crawl all pages. You can also read SEO tips on this post
Posted On robot txt, SEO, SERP Share ThisRelated Posts
- Free SEO for Yahoo
- Optimizing Your Site for Both Google and Yahoo!
- Sitemap Validation Problem
- A Short of SEO List You Can Add
- SEO friendly Blog
Random Posts
- 03/23/2007: Spam Protection For My Daily Thoughts
- 02/03/2007: How I write an “How to” article and easily gets attention
- 07/18/2007: Being Happy Is Easy
- 07/07/2007: Drug Rehab
- 05/23/2007: New E-Book Repository



on January 6th, 2008 at 12:06 pm
Thanks you, I will use it for my Blogs