Reply

Thread: Adsense, Privacy Policy and Robots.txt

 
Tools
  #1  
Old October 20th, 2009, 07:30 PM
suzie250 suzie250 is offline
suzie250's Avatar
Full Member
Join Date: May 5th, 2005
Posts: 415
I have always blocked certain pages (like the privacy page) with robots.txt so they are not indexed in the search engines.

With the new rules regarding privacy policies for Adsense, do I need to allow the bots access to them?

Do you think that being blocked is enough for Google to see that I have one, or do you think the bots will be checking for certain words within that file to see if we are in compliance?

I have just put up a new site and realized that even though privacy policies are in place for my other sites, I never unblocked them.
__________________
I disagree with Kay Jewelers. I would bet on any given Friday or Saturday night more kisses begin with Bud Lite than Kay.
  #2  
Old October 20th, 2009, 07:47 PM
Bill Bill is offline
Bill's Avatar
aka "Beachy"
Join Date: November 20th, 2005
Location: At the Beach (West Fenwick, DE) or TPA@0W3
Posts: 4,632
Ahhh...IMHO...best to unblock them. At the last Affiliate Summit West (Vegas last January) I learned that SERP ranking is also influenced a bit by having an "easy to find" Privacy Policy. I volunteered to have one of my main sites analyzed in a session - and that yielded three small recommended changes. I made those changes while still in Vegas and saw that travel site climb to second place for some great key words last summer. It had been in the third spot for more than a year.

That one position meant a several thousand dollars in increased hotel sales last season. One of those "tweaks" was to make the privacy policy more visible. I didn't have it blocked, but it was not linked to from the home page - just from internal pages. I can't say it was that particular change that made a difference, but all four panelists (SEO professionals) agreed that a direct link to a privacy policy is important. They did not say anything about blocking with robots.txt, however. YMMV
__________________
Bill Swartwout, Founder, Beaches and Towns Network, Inc.

NEW Checks Program on SAS: Girly Checks | Yes, YOU can sell checks: ShareASale Sign-Up.
Our Checks Business Provides Checks for Your Business.
ABW Support Forum | Twitter | Facebook
--
If you are too busy to laugh you are too busy.
  #3  
Old October 20th, 2009, 08:49 PM
writerguy writerguy is online now
writerguy's Avatar
ABW Ambassador
Join Date: January 17th, 2005
Location: Springfield, Missouri, USA
Posts: 2,554
In a related matter -- does anyone know if there's a well written, nicely compliant "Privacy Page" example anywhere that takes into account BOTH Google AdSense requirements AND the latest puzzle from the FTC?

I've been hoping some merchants I'm affiliated with might address this issue with some practical, usable examples or templates or something we could use.

Anybody know of anything like that?
__________________
Gary, also known by some as "Old Hoppy".
Join ABW to remove this sponsored message.
  #4  
Old October 20th, 2009, 09:09 PM
BurgerBoy BurgerBoy is offline
BurgerBoy's Avatar
Moderator
Join Date: January 18th, 2005
Location: Murray, KY
Posts: 6,408
Quote:
Originally Posted by writerguy
In a related matter -- does anyone know if there's a well written, nicely compliant "Privacy Page" example anywhere that takes into account BOTH Google AdSense requirements AND the latest puzzle from the FTC?

I've been hoping some merchants I'm affiliated with might address this issue with some practical, usable examples or templates or something we could use.

Anybody know of anything like that?
I sent you a PM Gary.
  #5  
Old October 20th, 2009, 09:43 PM
John Powell John Powell is online now
John Powell's Avatar
ABW Ambassador
Join Date: October 17th, 2005
Location: Bayou Country, LA
Posts: 2,763
If you do a G search for w3c privacy policy you will get the idea of the way I do it. I put up the P3P and the privacy page is normally not restricted to bots. I think on a couple of sites it's marked <meta name="robots" content="noindex,follow"></meta> but nothing in robots.txt

That P3P set up can be read by IE to see your policy, and I always do that. Seems someone here at ABW got me on to that.

I have a separate Disclosure page, but haven't got it rolled out to all sites yet. Gary if you want to take a look pm me.
__________________

  #6  
Old October 20th, 2009, 09:47 PM
RemodelingGuy RemodelingGuy is online now
RemodelingGuy's Avatar
Half a Bubble Off Plumb
Join Date: June 1st, 2007
Location: Katy, Texas
Posts: 2,877
Quote:
Originally Posted by BurgerBoy
I sent you a PM Gary.
You should share BB.

My privacy policy, as well as my disclaimer are over 10 years old and although they are Google compliant, I'm afraid they are out of date.

@ suzie. I would never block a PP page.
__________________

Jimmy McDonald - Your Local Hard Working RemodelingGuy!
StartRemodeling.com & ToxicMoldUSA.com ... We're Bettering YOUR Life by Improving Where YOU Live It ...
Do What You LOVE & LOVE What You Do! ....
Join ABW to remove this sponsored message.
  #7  
Old October 21st, 2009, 01:43 PM
suzie250 suzie250 is offline
suzie250's Avatar
Full Member
Join Date: May 5th, 2005
Posts: 415
Thanks guys. My privacy pages are accessible from almost every page on the site and I just didn't see any reason for this type of page to be indexed. I'll let 'em go and maybe I'll see some benefit out of it.

"Please release me, let me go......" Great, now I'll have that song stuck in my head all day.
__________________
I disagree with Kay Jewelers. I would bet on any given Friday or Saturday night more kisses begin with Bud Lite than Kay.
  #8  
Old October 21st, 2009, 02:11 PM
Mr. Sal Mr. Sal is offline
Mr. Sal's Avatar
ABW Veteran
Join Date: January 18th, 2005
Posts: 5,854
Quote:
Originally Posted by suzie250
Thanks guys. My privacy pages are accessible from almost every page on the site and I just didn't see any reason for this type of page to be indexed. I'll let 'em go and maybe I'll see some benefit out of it.

"Please release me, let me go......" Great, now I'll have that song stuck in my head all day.
Sure!

You mentioned, and now I am the one stuck on memory lane... ( Release Me )

I still have on old 45 record of that song.
  #9  
Old October 21st, 2009, 06:16 PM
2busy 2busy is online now
2busy's Avatar
ABW Ambassador
Join Date: January 17th, 2005
Location: Tropical Mountaintop
Posts: 2,538
Quote:
I still have on old 45 record of that song.
convert it to MP3 already.
__________________
Whether you think you can or think you can't - You will be right.
Join ABW to remove this sponsored message.
  #10  
Old October 21st, 2009, 06:18 PM
2busy 2busy is online now
2busy's Avatar
ABW Ambassador
Join Date: January 17th, 2005
Location: Tropical Mountaintop
Posts: 2,538
Quote:
Thanks guys. My privacy pages are accessible from almost every page on the site and I just didn't see any reason for this type of page to be indexed.
noindex them in your metatags, not in robots.txt That way the bots can see them fine but they won't be indexed,
__________________
Whether you think you can or think you can't - You will be right.
Reply

Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Restricted by robots.txt without robots.txt? mayfly Search Engine Insight 10 August 26th, 2009 05:13 PM
Robots.txt and MSN Packy Search Engine Insight 10 February 12th, 2006 03:06 PM
Google and robots.txt character limit John Powell Search Engine Insight 6 February 8th, 2006 01:00 PM
Google, Ask Jeeves ignoring robots.txt? ~Michelle Search Engine Insight 5 April 16th, 2005 06:05 PM
Do you use a robots.txt? Mr. Sal ABestWeb Voting Booth 11 November 12th, 2003 07:29 PM