1 (edited by Dwedit 2008-03-02 22:20)

Topic: Dummy index.html files are missing robots meta tag

The dummy index.html files really should have this tag, so that google doesn't pick up those pages.

<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">

I've already seen google pick up a few dummy pages from the Attachment Mod.

Re: Dummy index.html files are missing robots meta tag

Not only is someone linking to blank index.html files, but Google is indexing them as well? How odd. hmm

http://fluxbb.org

Free PunBB Hosting - lots of mods, easy to customize

Re: Dummy index.html files are missing robots meta tag

Yep, do a google search for "punbb img avatars" and you'll see a few dot pages on there.

Re: Dummy index.html files are missing robots meta tag

Interesting (from the search results, my guess would be that at some point the index.html wasn't being served as the directory index, so Google indexed the list of files in the directory and found the index.html). smile

http://fluxbb.org

Free PunBB Hosting - lots of mods, easy to customize