Syindication
Robots.txt Search Improvements
Fri, 06/06/2008 - 00:50
Gadgetopia: "Google, Yahoo, and Microsoft have gotten together and actually agreed on extensions to the REP — the Robots Exclusion Protocol, otherwise known as your robots.txt file."
Complete Story
You have already tagged this post. Your tags:
Similar entries
- Do Open Source Robots Dream of Electric Sheep?
- Laser-guided French Robots Run Linux
- Gadgetopia: PureEdit
- SEO Issues with Duplicate Content: Htaccess, Robots and URLs - Part 1
- Personal robots coming, study finds
- Gadgetopia: A Case for Movable Type as your Intranet
- Gadgetopia: Composite Pages and Embeddable Content
- Firefox 3 Beta 5 Easter Egg [Easter Egg]
- Wordpress 2.5
- some more firefox stuff
