Imran Khan - imrank.org » robots.txt http://www.imrank.org real fun blog - something for everyone Sun, 21 Mar 2010 15:25:17 +0000 http://wordpress.org/?v=2.8 en hourly 1 Robots Exclusion Protocol http://www.imrank.org/computers-and-internet/robots-exclusion-protocol/ http://www.imrank.org/computers-and-internet/robots-exclusion-protocol/#comments Wed, 04 Jun 2008 17:41:58 +0000 Imran Khan http://www.imrank.org/?p=10 On 3rd June 2008, Google, Microsoft and Yahoo have announced a collaboration to support robots.txt and robot Meta tags. By the end of June 2008, Microsoft will be supporting wildcard * and the ALLOW directive in robots.txt file.

For more information, please visit the links below:

Post to Twitter Tweet This Post

]]> http://www.imrank.org/computers-and-internet/robots-exclusion-protocol/feed/ 0