« Free SEO for Yahoo - Tips To Get A Best Domain Name »

Increasing Search Engine Ranks

5 January 2008

Short after I wrote about improving SEO for yahoo, I found additional tips that will works for any Search Engine including Yahoo. The optimization will be applied on robot.txt file located in your root directory. For you who didn’t know what is robot.txt I will give short description. The robots.txt is a simple text file used to tell search engine bots which pages on your web site should be crawled and indexed.

By regulating their behavior of how indexing the website/blog, we can increase our site’s position on Search Engine result. Irrelevant pages on your blog could be excluded from search engine index and therefore only relevant pages will included on their indexed. You only need to add several lines on your robot.txt file. If you couldn’t find this file on root folder, simply create one and save it on your server.

I found a ready made robot.txt from AskApache and applied it here and on Gadget Blog as well. The codes are as following.

User-agent: *
Disallow: /cgi-bin
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /wp-content/plugins
Disallow: /wp-content/cache
Disallow: /wp-content/themes
Disallow: /trackback
Disallow: /comments
Disallow: /category/*/*
Disallow: */trackback
Disallow: */comments
Disallow: /*?*
Disallow: /*?
Allow: /wp-content/uploads

# Google Image
User-agent: Googlebot-Image
Disallow:
Allow: /*

# Google AdSense
User-agent: Mediapartners-Google*
Disallow:
Allow: /*

# Internet Archiver Wayback Machine
User-agent: ia_archiver
Disallow: /

# digg mirror
User-agent: duggmirror
Disallow: /

Wait for 5 to 10 days to the result of this robot tweaks and enjoy your increased SERP position.

Perhaps if the new crawler from Tony Spencer visit this blog, it won’t have difficulties to crawl all pages. You can also read SEO tips on this post

Posted On , ,

Share This

Related Posts

Random Posts

U COMMENT
I FOLLOW

One Response to ' Increasing Search Engine Ranks '

Subscribe to comments with RSS or TrackBack to ' Increasing Search Engine Ranks '.

  1. Jauhari said,

    on January 6th, 2008 at 12:06 pm

    Thanks you, I will use it for my Blogs ;)

Leave a reply

Search terms for this post   search (2),  robot.txt (1),  yahoo (1),