Results 1 to 5 of 5
  1. #1
    Full Member
    Join Date
    January 18th, 2005
    Location
    K&Y
    Posts
    448
    Arrow Google's Mediapartners-Google
    Normally I see "Mediapartners-Google" coming to my sites because of the AdSense on the pages, so every page view results in a visit from "Mediapartners-Google".

    But I just noticed "Mediapartners-Google" by itself, getting robots.txt and /index.html just like GoogleBot would do.

    I didn't know "Mediapartners-Google" was a spider as well. I thought it was just a content checker for AdSense.

    So is it something new?

  2. #2
    Not Verif-Lidated infoTim's Avatar
    Join Date
    January 18th, 2005
    Location
    Sunny Florida
    Posts
    1,021
    I've seen it grab those files on a few sites that don't have (and have never had) AdSense on them once in a while. Strange!
    Tim
    consultant by day, affiliate by night

  3. #3
    The Beer Hunter LearnAbout's Avatar
    Join Date
    June 1st, 2005
    Location
    usually 19th hole
    Posts
    281
    "While our bot (starting with 'Mediapartners-Google') does crawl content pages for the purpose of targeting ads, this crawl is not associated with our main index crawl."

    from Adsense support (https://www.google.com/support/adsen...9717&topic=139)


    "If you would like to grant our crawler access to your pages, you can do so without granting permission to any other bots. Simply add the following two lines of text to the top of your robots.txt file:

    User-agent: Mediapartners-Google*
    Disallow:

    This change will allow our crawler to index the content of your site and provide you with the most relevant Google ads for that content"

    from Adsense Support https://www.google.com/support/adsen...topic=0&type=f

    Hope this helps,

    Frank
    [URL=http://www.golfbeginnerguide.com/]Golf Beginner Guide[/URL] ; [URL=http://www.ladygolfersguide.com/]Lady Golfers Guide[/URL]

  4. #4
    Member
    Join Date
    January 18th, 2005
    Location
    Upstate SC
    Posts
    173
    The adsense bot will spider pages that don't have adsense on them, if an (free version) Opera user visits the site.

    Adsense ads are built into the browser, and they will spider during the visit to serve correct ads in the browser itself.

  5. #5
    Full Member
    Join Date
    January 18th, 2005
    Location
    K&Y
    Posts
    448
    Yes, but why is it getting my robots.txt file? Normally AdSense's bot doesn't ask for it. That's what is stranger than a stranger.

  6. Newsletter Signup

+ Reply to Thread

Similar Threads

  1. Replies: 1
    Last Post: May 18th, 2013, 01:28 PM
  2. Replies: 160
    Last Post: June 7th, 2010, 10:13 PM
  3. Google engines within the engine/Google Co-op/Google Custom Search
    By Alan Hamilton in forum Search Engine Optimization
    Replies: 12
    Last Post: October 27th, 2006, 03:31 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •