• Registered: 2006-05-03
  • Posts: 102

Topic: The new robots-nocontent tag

Thought this might be interesting for separating navigation stuff and content on forums.

For over a decade, search engines have supported standards allowing you to prevent pages from being spidered or included within a search index. Today, Yahoo now supports a new twist -- a way to flag that part of your page shouldn't be included in an index. It's called the robots-nocontent tag.

http://searchengineland.com/070502-132315.php

--Alan

AlanCollier's Website

2 Reply by naitkris (edited by naitkris 2007-05-03 11:37)

  • From: Cork, Ireland
  • Registered: 2007-01-18
  • Posts: 92

Re: The new robots-nocontent tag

cool. pity it is not a standard and is only for Yahoo! (currently) however.

the navigation bar that appears all over the place for example would be nice to not be indexed using this making the unique content stand out more.

EDIT - could also be used to make PunBB a less of a target for spammers, i.e. guests and users with less than # posts (say 3 posts) have all their posts wrapped in this tag so that they are not indexed. if this tag was a standard i'd implement it into the BB Spam Fighter mod which does these simple user checks already.

not being standard is quite annoying, but well done to Yahoo! for bringing it out, hopefully this or something similar will eventually become a standard.