back to list

Re: FAQ entries from web sites

🔗Robert Walker <robert_walker@rcwalker.freeserve.co.uk>

3/4/2001 7:23:27 AM

I've renamed the url field to

Url to get new entry from - leave blank for new folder

If you have a web page for the FAQ on your web site,
then there is no need to upload it to the files
area, though of course you can if you want to.

One can just give the original url to the web page
in the url field of the database.

If it is a working draft, and one plans to delete it from
ones web site when it is complete, then you can exclude
it from (well behaved) search engines in your robots.txt
file.

For those who haven't made one of those, it looks like this:

User-agent: *
Disallow: /fts_beta/

You save it as robots.txt in the root folder of your web site.

This one will tell all well behaved search engines to ignore
files in the

/fts_beta/
folder

You can add as many folders as you like to it.

User-agent: *
says to disallow all search engines.

Robert