Results 1 to 19 of 19
  1. #1
    CPA Network Rep JP Sauve's Avatar
    Join Date
    January 18th, 2005
    Posts
    369
    If I want Google to index 1000 pages under one domain, I'm guessing it's not best to link all 1000 pages on a single webpage.... the Google Spider surely won't index them all.

    Anyone know how many links their Spider will follow on a page?
    [font=verdana][b][size=3][color=red]Are you familiar with [URL]MaxBounty.com[/URL] yet?[/color][/b][/size][/font][font=verdana][b][size=1][color=black]
    • Over 120 merchants with CPA/CPS programs seeking affiliates
    • Over 4500 network publishers seeking programs to advertise
    • Earn $100 per merchant and 5% per affiliate on the second tier [/b][/color][/size][/font]

  2. #2
    Troll Killer and best Snooper!
    I decide when the pigs fly!
    Rhea's Avatar
    Join Date
    January 18th, 2005
    Location
    New York, USA
    Posts
    6,195
    I can't cite a source for this JP, but I do remember reading (I think it was Google's own site) not to put more than 100 on a page.

  3. #3
    ABW Ambassador
    Join Date
    January 18th, 2005
    Posts
    545
    The latest word is 50 or less. I think 100 is fine though and I do 100 or more.

  4. #4
    Affiliate Manager AffiliateBuddha's Avatar
    Join Date
    January 18th, 2005
    Posts
    791
    Make sure the page is less then 101 KB
    Gift Shopping Zone Affiliate Program on SAS - 10% per sale with unlimited cookie duration, over 10,000 products.

  5. #5
    CPA Network Rep JP Sauve's Avatar
    Join Date
    January 18th, 2005
    Posts
    369
    <BLOCKQUOTE class="ip-ubbcode-quote"><font size="-1">quote:</font><HR>Originally posted by AffiliateBuddha:
    Make sure the page is less then 101 KB <HR></BLOCKQUOTE>


    That's without counting graphics, right?
    [font=verdana][b][size=3][color=red]Are you familiar with [URL]MaxBounty.com[/URL] yet?[/color][/b][/size][/font][font=verdana][b][size=1][color=black]
    • Over 120 merchants with CPA/CPS programs seeking affiliates
    • Over 4500 network publishers seeking programs to advertise
    • Earn $100 per merchant and 5% per affiliate on the second tier [/b][/color][/size][/font]

  6. #6
    Super Sh!t Stirrer SSanf's Avatar
    Join Date
    January 18th, 2005
    Posts
    9,944
    Buddah!

    I think this is the first post I have seen you make since the last storm. I was concerned. How did you do? And, are you ready to do it again?
    Comments are opinion unless otherwise noted. Remember, pillage first. Then burn. Half of all people in the world have IQs under 100. You best learn to trust ol' SSanf!

  7. #7
    http and a telephoto
    Join Date
    January 18th, 2005
    Location
    NYC
    Posts
    17,708
    Google likes my site maps that have 600+ links on a page. For a while the site map page was ranking higher and showing up in more actual searches than the pages it links to!

    Debbie
    Deborah Carney
    TeamLoxly.com BookGoodies.com ABCsPlus.com

  8. #8
    notary sojac Herb ΤΏΤ¬'s Avatar
    Join Date
    January 18th, 2005
    Location
    Central/Western NY State
    Posts
    7,741
    I have a site with references to over 450 pages on the index page and google has indexed them all.

    the index page has hardly any graphics so is relatively small.

  9. #9
    http and a telephoto
    Join Date
    January 18th, 2005
    Location
    NYC
    Posts
    17,708
    Custom 404 pages are a beautiful thing. Or an htaccess redirect for 404's. Both are very necessary things in our business....
    Deborah Carney
    TeamLoxly.com BookGoodies.com ABCsPlus.com

  10. #10
    Member
    Join Date
    January 18th, 2005
    Posts
    94
    Hi,

    I am bumping this thread from 2004 and wondering what people think of the original question now?

    How many would google spider from an index page?

    Just curious.

    mopek

  11. #11
    Full Member
    Join Date
    January 18th, 2005
    Posts
    396
    use a sitemap; each sitemap can have up to 50,000 URLs and you can nest sitemaps --- see http://www.google.com/support/webmas...&answer=156184

    In my experience I've had no problem with Google indexing a bunch (>20,000) it just takes time

    Charles

  12. #12
    15 years and counting
    Join Date
    January 18th, 2005
    Posts
    6,121
    .

  13. #13
    Member
    Join Date
    January 18th, 2005
    Posts
    94
    Thanks for that. For some reason I remember reading a thread years ago where people were complaining about google sitemaps and so never bothered. But if it works for you I'll look into it.


  14. #14
    http and a telephoto
    Join Date
    January 18th, 2005
    Location
    NYC
    Posts
    17,708
    Things have changed *a lot* since 2004.
    Deborah Carney
    TeamLoxly.com BookGoodies.com ABCsPlus.com

  15. #15
    Member
    Join Date
    January 18th, 2005
    Posts
    94
    LOL .... Thanks

  16. #16
    Newbie Akarin's Avatar
    Join Date
    August 26th, 2009
    Location
    Florida Keys
    Posts
    31
    Yeah as long as you split your site maps <50K pages you are fine. I have 78K pages in an index and two xml maps. when they are that size, make sure they are gzipped and submit them to G with the gz extension.

  17. #17
    Moderator leeann's Avatar
    Join Date
    January 18th, 2005
    Posts
    2,955
    They change about every 3 months. It's a big guessing game and a lot of people (well - I have anyway) spend hours - days- weeks--months--years-- trying to figure out what the magic mix is and as soon as we see positive results, they change. The latest thing I read, and I think I read it on Google's Webmaster Tools thingy, is that site maps are a good thing (for now anyway).......................
    leeann


    Shoppers determine what has value and they like coupons. Stop manipulating who set the cookie just because you do not like coupon and promotional sites.

  18. #18
    Full Member
    Join Date
    January 18th, 2005
    Posts
    396
    The other thing you can do when you create a sitemap is to add the following line to the top of your robots.txt file

    Sitemap:http://www.MySite.com/MySitesitemap.xml.gz

    This tells Google (and Yahoo/MSN...) where to find your sitemap (or main sitemap) so you don't need to resubmit the sitemaps for each domain to each major engine - they all subscribe to the same sitemap protocol

    Charles

  19. #19
    Moderator PDXreader's Avatar
    Join Date
    February 24th, 2009
    Location
    Hood River
    Posts
    852
    Bad link. Atleast for me.
    J. Duffield Affiliate Manager at Snow Consulting
    Let's Connect-PassTheSEO|#GSEG|Twitter|LinkedIn|Blog "Knowledge is Power."

  20. Newsletter Signup

+ Reply to Thread

Similar Threads

  1. Webrescuer Spider interfering with Google
    By darkstar7 in forum Search Engine Optimization
    Replies: 3
    Last Post: March 24th, 2004, 07:10 AM
  2. Dynamic Content Site, Google's scared to spider...
    By weisinator in forum Search Engine Optimization
    Replies: 18
    Last Post: December 9th, 2003, 05:11 PM
  3. does google spider web-protected files
    By oscar in forum Search Engine Optimization
    Replies: 5
    Last Post: December 1st, 2003, 03:03 PM
  4. Any Way To Block Just The Google Spider?
    By tlemke in forum Search Engine Optimization
    Replies: 10
    Last Post: April 3rd, 2003, 12:46 AM
  5. Google Spider
    By hershey in forum Search Engine Optimization
    Replies: 1
    Last Post: November 27th, 2001, 06:25 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •