Re: tuning archive - posts getting into Google search results

Hi there,

I've discovered that some of the pages from the tuning archive
are getting into the Google search results. Sorry about this.

If you remember, I excluded the actual archive itself from
search engines in my robots.txt file, but made the index
page accessible. This is important as the informal
remarks in the archive aren't meant for "publication"
so not suitable for the first page one gets to in the
search results.

What I hadn't realised is that the root directory for
ftp upload isn't the same as the root directory for
the server, just a sub directory.

To work in permanent fashion, should be in the server root
directory, which I think wouldn't have been accessible for
a user, only to nbci themselves.

I tried the temporary deletion of all the search results, which one
can do even if the robots.txt isn't in the root directory,
but that didn't work either.

This may mean that the robots.txt file should have included
the tunesmithy subdirectory in all the paths.

At least, I'm pretty sure that's what has happened,
though I have just sent an e-mail to Google recently to find out more.

A possible solution is to add the exclude information individually to each
page in meta tags, which my archive program could easily do.

However, unfortunately, my nbci account has been closed for
ftp uploads (along with all the nbci accounts), and I can
no longer ftp to it. Presumably they will delete all the files
there eventually, but are taking a while to get round to doing so.

Once they are deleted, I can remove them immediately from Google
using their immediate removal tool - which one can use to update
the results and cached pages for pages that are no longer there,
if one so wishes.

Obviously Google have to protect web owners from anyone else
who wants to remove someone's pages from the web, and they
do this by making it dependent on the robots.txt file that
one uploads by ftp, or the page not being there at all.

Sorry about all this. I may see if I can get nbci to delete
the pages early, though this will mean the archive won't be
available on-line for a while as I haven't yet organised
another site for it.

Robert

Robert -- I consider that a VERY GOOD thing.

--- In tuning@y..., "Paul Erlich" <paul@s...> wrote:

> Robert -- I consider that a VERY GOOD thing.

It led me here; if that is a good or a bad thing I leave to
individual taste.

--- In tuning@y..., "Paul Erlich" <paul@s...> wrote:

/tuning/topicId_27726.html#27774

> Robert -- I consider that a VERY GOOD thing.

Actually, *I* have not problem with it either... I've noticed that a
few of mine have come up in searches under my name...

As long as one doesn't make libelous and ridiculous statements like
our favorite "nutty professor" there should be no problem with this...

_______ ______ ______
Joseph Pehrson