Results 1 to 10 of 10
  1. #1
    Full Member suzie250's Avatar
    Join Date
    May 5th, 2005
    Posts
    416
    Adsense, Privacy Policy and Robots.txt
    I have always blocked certain pages (like the privacy page) with robots.txt so they are not indexed in the search engines.

    With the new rules regarding privacy policies for Adsense, do I need to allow the bots access to them?

    Do you think that being blocked is enough for Google to see that I have one, or do you think the bots will be checking for certain words within that file to see if we are in compliance?

    I have just put up a new site and realized that even though privacy policies are in place for my other sites, I never unblocked them.
    I disagree with Kay Jewelers. I would bet on any given Friday or Saturday night more kisses begin with Bud Lite than Kay.

  2. #2
    Beachy Bill's Avatar
    Join Date
    November 20th, 2005
    Posts
    8,266
    Ahhh...IMHO...best to unblock them. At the last Affiliate Summit West (Vegas last January) I learned that SERP ranking is also influenced a bit by having an "easy to find" Privacy Policy. I volunteered to have one of my main sites analyzed in a session - and that yielded three small recommended changes. I made those changes while still in Vegas and saw that travel site climb to second place for some great key words last summer. It had been in the third spot for more than a year.

    That one position meant a several thousand dollars in increased hotel sales last season. One of those "tweaks" was to make the privacy policy more visible. I didn't have it blocked, but it was not linked to from the home page - just from internal pages. I can't say it was that particular change that made a difference, but all four panelists (SEO professionals) agreed that a direct link to a privacy policy is important. They did not say anything about blocking with robots.txt, however. YMMV
    Bill / Marketing Blog @ 12PM - Current project: Resurrecting my "baby" at South Baltimore..
    Cute Personal Checks and Business Checks
    If you are too busy to laugh you are too busy.

  3. #3
    ABW Ambassador writerguy's Avatar
    Join Date
    January 17th, 2005
    Location
    Springfield, Missouri, USA
    Posts
    3,248
    In a related matter -- does anyone know if there's a well written, nicely compliant "Privacy Page" example anywhere that takes into account BOTH Google AdSense requirements AND the latest puzzle from the FTC?

    I've been hoping some merchants I'm affiliated with might address this issue with some practical, usable examples or templates or something we could use.

    Anybody know of anything like that?
    Generate more fake news.

  4. #4
    Moderator BurgerBoy's Avatar
    Join Date
    January 18th, 2005
    Location
    jacked by sylon www.sylonddos.weebly.com
    Posts
    9,618
    Quote Originally Posted by writerguy
    In a related matter -- does anyone know if there's a well written, nicely compliant "Privacy Page" example anywhere that takes into account BOTH Google AdSense requirements AND the latest puzzle from the FTC?

    I've been hoping some merchants I'm affiliated with might address this issue with some practical, usable examples or templates or something we could use.

    Anybody know of anything like that?
    I sent you a PM Gary.

    Vietnam Veteran 1966-1970 USASA
    ABW Forum Rules - Advertise At ABW

  5. #5
    Comfortably Numb John Powell's Avatar
    Join Date
    October 17th, 2005
    Location
    Bayou Country, LA
    Posts
    3,432
    If you do a G search for w3c privacy policy you will get the idea of the way I do it. I put up the P3P and the privacy page is normally not restricted to bots. I think on a couple of sites it's marked <meta name="robots" content="noindex,follow"></meta> but nothing in robots.txt

    That P3P set up can be read by IE to see your policy, and I always do that. Seems someone here at ABW got me on to that.

    I have a separate Disclosure page, but haven't got it rolled out to all sites yet. Gary if you want to take a look pm me.


  6. #6
    Half a Bubble Off Plumb RemodelingGuy's Avatar
    Join Date
    June 1st, 2007
    Location
    Katy, Texas
    Posts
    3,250
    Quote Originally Posted by BurgerBoy
    I sent you a PM Gary.
    You should share BB.

    My privacy policy, as well as my disclaimer are over 10 years old and although they are Google compliant, I'm afraid they are out of date.

    @ suzie. I would never block a PP page.

    Jimmy McDonald - Your Local Hard Working RemodelingGuy ( & SprinklerGuy - & GarageGuy )
    StartRemodeling.com .... MySprinklerGuy.com .... MyGarageGuy.com ....
    We're Bettering YOUR Life by Improving Where YOU Live It ...
    Do What You LOVE & LOVE What You Do! ....

  7. #7
    Full Member suzie250's Avatar
    Join Date
    May 5th, 2005
    Posts
    416
    Thanks guys. My privacy pages are accessible from almost every page on the site and I just didn't see any reason for this type of page to be indexed. I'll let 'em go and maybe I'll see some benefit out of it.

    "Please release me, let me go......" Great, now I'll have that song stuck in my head all day.
    I disagree with Kay Jewelers. I would bet on any given Friday or Saturday night more kisses begin with Bud Lite than Kay.

  8. #8
    ABW Veteran Mr. Sal's Avatar
    Join Date
    January 18th, 2005
    Posts
    6,795
    Talking
    Quote Originally Posted by suzie250
    Thanks guys. My privacy pages are accessible from almost every page on the site and I just didn't see any reason for this type of page to be indexed. I'll let 'em go and maybe I'll see some benefit out of it.

    "Please release me, let me go......" Great, now I'll have that song stuck in my head all day.
    Sure!

    You mentioned, and now I am the one stuck on memory lane... ( Release Me )

    I still have on old 45 record of that song.

  9. #9
    ABW Ambassador 2busy's Avatar
    Join Date
    January 17th, 2005
    Location
    Tropical Mountaintop
    Posts
    5,636
    I still have on old 45 record of that song.
    convert it to MP3 already.

  10. #10
    ABW Ambassador 2busy's Avatar
    Join Date
    January 17th, 2005
    Location
    Tropical Mountaintop
    Posts
    5,636
    Thanks guys. My privacy pages are accessible from almost every page on the site and I just didn't see any reason for this type of page to be indexed.
    noindex them in your metatags, not in robots.txt That way the bots can see them fine but they won't be indexed,

  11. Newsletter Signup

+ Reply to Thread

Similar Threads

  1. Restricted by robots.txt without robots.txt?
    By mayfly in forum Search Engine Optimization
    Replies: 10
    Last Post: August 26th, 2009, 05:13 PM
  2. Robots.txt
    By Rhia7 in forum Midnight Cafe'
    Replies: 0
    Last Post: April 18th, 2009, 12:34 AM
  3. Do you use a robots.txt?
    By Mr. Sal in forum Voting Booth
    Replies: 11
    Last Post: November 12th, 2003, 07:29 PM
  4. robots txt
    By reflections in forum Programming / Datafeeds / Tools
    Replies: 5
    Last Post: December 26th, 2002, 06:22 PM
  5. robots.txt file????? HELP
    By john dundas in forum Search Engine Optimization
    Replies: 4
    Last Post: August 18th, 2002, 05:36 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •