Sponsor Message:
Non Aviation Forum
My Starred Topics | Profile | New Topic | Forum Index | Help | Search 
How Do I Hide A Website From Google?  
User currently offlineLHMARK From United States of America, joined Jan 2000, 7255 posts, RR: 46
Posted (8 years 4 months 3 weeks 1 day 6 hours ago) and read 4475 times:

I have just built a website for a once very high-profile band. It's the media and contacts guide for their upcoming tour, and it's accessed as a subdirectory off their main URL (www.[bandsname].com/media).

The problem is, the band's fans are googling the band name and finding the media site which contains direct contact information, financials, and tour specifics. How can I stop this from happening?


"Sympathy is something that shouldn't be bestowed on the Yankees. Apparently it angers them." - Bob Feller
14 replies: All unread, jump to last
 
User currently offlineEWS From , joined Dec 1969, posts, RR:
Reply 1, posted (8 years 4 months 3 weeks 1 day 6 hours ago) and read 4474 times:

Quoting LHMARK (Thread starter):
The problem is, the band's fans are googling the band name and finding the media site which contains direct contact information, financials, and tour specifics. How can I stop this from happening?

Password protect the /media directory and give access to those only who need it?

Lew


User currently offlineLHMARK From United States of America, joined Jan 2000, 7255 posts, RR: 46
Reply 2, posted (8 years 4 months 3 weeks 1 day 6 hours ago) and read 4463 times:

Can't. We've got to make it accessible to journalists all over the world, not all of whom we'll have contact with.


"Sympathy is something that shouldn't be bestowed on the Yankees. Apparently it angers them." - Bob Feller
User currently offlineTrekster From , joined Dec 1969, posts, RR:
Reply 3, posted (8 years 4 months 3 weeks 1 day 6 hours ago) and read 4460 times:

how about put ur own ctc details on the site, and the info in the site create a pdf document then email it once a request is received

User currently offlineAirbusA346 From United Kingdom, joined Dec 2004, 7437 posts, RR: 2
Reply 4, posted (8 years 4 months 3 weeks 1 day 6 hours ago) and read 4448 times:

Quoting Trekster (Reply 3):

That is a very good Idea, and then the information wouldn't end up in anybodys hands.

Tom.



Tom Walker '086' First Officer of a A318/A319 for Air Lambert - Hours Flown: 17 hour 05 minutes (last updated 24/12/05).
User currently offlineTrekster From , joined Dec 1969, posts, RR:
Reply 5, posted (8 years 4 months 3 weeks 1 day 6 hours ago) and read 4443 times:

Exactly.

Someone would need to keep up to date with all the emails though.

How about sending the PDF to all the major news agencys, might work as well


User currently offlineLHMARK From United States of America, joined Jan 2000, 7255 posts, RR: 46
Reply 6, posted (8 years 4 months 3 weeks 1 day 6 hours ago) and read 4430 times:

I think I just found a meta tag that'll do the job [meta name="robots" content="none"]. Can anyone tell me if that will work?


"Sympathy is something that shouldn't be bestowed on the Yankees. Apparently it angers them." - Bob Feller
User currently offlineAeroWesty From United States of America, joined Oct 2004, 20822 posts, RR: 62
Reply 7, posted (8 years 4 months 3 weeks 1 day 5 hours ago) and read 4413 times:

In the upper level folder, create: robots.txt

Type in the text document and save -

User-agent: *
Disallow: /



International Homo of Mystery
User currently offlineDiamond From United States of America, joined Apr 2004, 3279 posts, RR: 63
Reply 8, posted (8 years 4 months 3 weeks 1 day 5 hours ago) and read 4411 times:

Isn't this the sort of thing that "Aircraft" specializes in?


Blank.
User currently offlineDrDeke From United States of America, joined Jun 2005, 830 posts, RR: 0
Reply 9, posted (8 years 4 months 3 weeks 1 day 5 hours ago) and read 4411 times:

Quoting AeroWesty (Reply 7):
In the upper level folder, create: robots.txt

Type in the text document and save -

User-agent: *
Disallow: /

 checkmark 

This will prevent all well-behaved search engines from indexing your site.

-DrDeke



If you don't want it known, don't say it on a phone.
User currently offlineZudnic From United States of America, joined Oct 2005, 65 posts, RR: 0
Reply 10, posted (8 years 4 months 3 weeks 1 day 4 hours ago) and read 4346 times:

Quoting AeroWesty (Reply 7):
In the upper level folder, create: robots.txt

Type in the text document and save -

User-agent: *
Disallow: /

Correct answer. Works like a charm.

However, it may be too late. You should put the directory you want to disallow on robots.txt BEFORE uploading the content.

Finally, it sounds like you have some rabid fans out there. If I were you I would password protect your content. Not sure if there are any hosting services out there that would do it for you, but it's a relatively simple Perl script to ask for a password then set an access cookie.

Edited: Content, clarity.

[Edited 2006-08-02 23:55:10]

User currently offlineNoUFO From Germany, joined Apr 2001, 7966 posts, RR: 12
Reply 11, posted (8 years 4 months 3 weeks 1 day 4 hours ago) and read 4319 times:

Quoting AeroWesty (Reply 7):
Type in the text document and save -

User-agent: *
Disallow: /

Better yet:

User-agent: *
Disallow: /media/

to keep spiders from indexing the media folder - as long as other content can be listed.



I support the right to arm bears
User currently offlineNoUFO From Germany, joined Apr 2001, 7966 posts, RR: 12
Reply 12, posted (8 years 4 months 3 weeks 1 day 4 hours ago) and read 4310 times:

Quoting LHMARK (Thread starter):
The problem is, the band's fans are googling the band name and finding the media site which contains direct contact information, financials, and tour specifics. How can I stop this from happening?

You definitely need to protect the folder with a password!!

As an interims measure, embed a flash movie where visitors need to enter a password first before proceeding AND use the AS Obfuscator to protect the code. Yes, I can be of assistance here.

Edit: Oh well, that way you could protect the folder itself. But no password = no protection, really.

Quoting LHMARK (Reply 2):
Can't. We've got to make it accessible to journalists all over the world, not all of whom we'll have contact with.

How so if none of the journalists knows of this little media-folder?
From what I know, journalists have to ask the management for additional information and then receive either a link with some log-in data or a CD-ROM.

[Edited 2006-08-03 00:32:29]


I support the right to arm bears
User currently offlineAircraft From France, joined Jan 2007, 0 posts, RR: 0
Reply 13, posted (8 years 4 months 3 weeks 1 day 1 hour ago) and read 4251 times:

Quoting AeroWesty (Reply 7):
In the upper level folder, create: robots.txt

Type in the text document and save -

User-agent: *
Disallow: /

 checkmark 

There are many other options you can mess with, but this is the quickest and easiest way.

If you want to restrict any current traffic that comes from search engines, you can make use of the Environment Variables of the web server. Grab the HTTP_REFERER (it's actually spelled 'referer, not 'referrer' in this case). If the HTTP_REFERER variable contains a url containing google.com, msn.com, ask.com, askjeeves.com, yahoo.com, etc., then you can take measures to prevent the page from showing, or you can choose to redirect the traffic elsewhere.

Send me a note if you need clarification.

Quoting Diamond (Reply 8):
Isn't this the sort of thing that "Aircraft" specializes in?

Yep  Smile


User currently offlineKlaus From Germany, joined Jul 2001, 21521 posts, RR: 53
Reply 14, posted (8 years 4 months 3 weeks 9 hours ago) and read 4148 times:

Simply keeping the sub-directory un-linked should do the trick already - disallow directory listing (should be standard anyway) and mail out the link but never place it on any link-reachable page.

Google et al "crawl" along existing links; If your pages are only linked among themselves, the crawlers shouldn't find them. You might want to refrain from using Google Mail to e-mail the link to be certain, however...


Top Of Page
Forum Index

This topic is archived and can not be replied to any more.

Printer friendly format

Similar topics:More similar topics...
How Do I Delete Tracks From Ipod posted Mon Aug 21 2006 19:33:14 by Cosec59
How Do We Learn From Our Mistakes? posted Fri Jan 27 2006 06:28:06 by Tbar220
How Do I Convert Pics From Gif Format To Jpg? posted Sat Oct 8 2005 08:06:57 by Jetmatt777
How Do I Post Drawing From MS Paint Here? posted Mon Jul 28 2003 14:02:48 by Airmale
How Do You Get From Jersey To JFK On The Train? posted Fri Dec 20 2002 04:31:08 by BizJets
How Do I Commute From IST To SAW? posted Mon Jun 5 2006 17:18:15 by GLA MD11
How Do I Get From DTW To University Of Michigan? posted Fri Sep 16 2005 18:58:23 by Chi-town
How Do You Generate Traffic/Hits On Your Website? posted Fri Apr 15 2005 18:47:27 by SignalOne
How Do You Create A Website? posted Wed Jan 12 2005 00:16:09 by AAplatnumflier
How Do You Remove Spywares From Your Computer? posted Sun Feb 16 2003 11:06:18 by Flying Belgian