Results 1 to 5 of 5
  1. #1
    ABW Ambassador superCool's Avatar
    Join Date
    April 23rd, 2008
    Location
    Texas
    Posts
    1,268
    Question List Pages in SE Index
    superCool has a few sites with some datafeed content and is thinking about all the list pages that end up in the search engines. There are list pages by category, by merchant, by brand, by color, by price, etc. and each can be sorted in different ways. These pages have a small image, product title and a few details about each product – 20 or so items per list page. So there are a LOT of these pages when you consider all the combinations.

    What are your thoughts on having these pages in the index? Do you think these pages are in any way a distraction to the spiders or do they interfere with the indexing of the more important product pages? Would it be any benefit to request that these pages not be indexed? <meta name="robots" content="noindex, follow">

    The reason superCool is asking is because he seems to be having some problems keeping all of his product pages indexed. He’s thinking that maybe these list pages are getting in the way somehow.

    What thinketh thou?
    Last edited by superCool; November 9th, 2010 at 11:45 AM.

  2. #2
    ABW Ambassador 2busy's Avatar
    Join Date
    January 17th, 2005
    Location
    Tropical Mountaintop
    Posts
    5,636
    I am thinkesting that you should take a look in GWT to see if there is any mention of duplication if the indexed pages are dynamically generated.

  3. #3
    Moderator MichaelColey's Avatar
    Join Date
    January 18th, 2005
    Location
    Mansfield, TX
    Posts
    16,232
    I have similar concerns about a site I have planned. What I plan to do is essentially to have two different "views" of the site. One, just straight HTML with the basics that would minimize duplicate content. One for users with JavaScript enabled that would use AJAX and similar technology to add more dynamic options to filter and sort the results. The search engines should just see the basic version, while normal visitors (including those who find the page from search results) will have a much more user-friendly option. Those users who have JavaScript disabled will still have a functional site, just with fewer options.
    Michael Coley
    Amazing-Bargains.com
     Affiliate Tips | Merchant Best Practices | Affiliate Friendly? | Couponing | CPA Networks? | ABW Tips | Activating Affiliates
    "Education is the most powerful weapon which you can use to change the world." Nelson Mandela

  4. #4
    ABW Ambassador superCool's Avatar
    Join Date
    April 23rd, 2008
    Location
    Texas
    Posts
    1,268
    Quote Originally Posted by 2busy View Post
    I am thinkesting that you should take a look in GWT to see if there is any mention of duplication if the indexed pages are dynamically generated.
    yes - the GWT duplicate meta descriptions list shows 3 or 4 pages with the same description (generated), and these are various versions of basically the same list pages (sorted differently for example). superCool could get rid of the duplicate descriptions with some code, but it seems like it might be best to get rid of the pages with noindex.

    is superCool seeing this issue right? would those pages provide any benefit or are they more likely to be trouble makers?

    now superCool is thinking about figuring out a way to keep one set of list pages and noindex the rest. thoughts?

    fankth!

  5. #5
    ABW Ambassador 2busy's Avatar
    Join Date
    January 17th, 2005
    Location
    Tropical Mountaintop
    Posts
    5,636
    Ideally there would be a way in your script to generate the noindex metatags for one set of results. If you have data on how people are using the search and results it should let you know which ones to not noindex.

    There is a way in GWT to keep them from following dynamic pages by entering the part of an URI that is unique to those results. If search by price is what you want indexed, don't noindex those pages, if search by color produces some unique string in the URI, enter that in GWT so they'll ignore it. GWT offers a pretty complete section of what/how to manage dynamic pages to avoid duplication issues. I don't have a link, but there should be one somewhere on the page where you found the duplicate description information. 3 or 4 notices show it is just beginning to show up for them. Nip it in the bud. Good luck.

  6. Newsletter Signup

+ Reply to Thread

Similar Threads

  1. Need Help with Index Pages!
    By gingercindy in forum WebMerge (Fourthworld.com)
    Replies: 5
    Last Post: September 28th, 2006, 10:36 AM
  2. Making an index page of index pages
    By Pierre (aka Terdef) in forum WebMerge (Fourthworld.com)
    Replies: 0
    Last Post: June 30th, 2005, 05:24 AM
  3. Use PHP for multiple Index pages when List is at 20 per page
    By dak142 in forum Programming / Datafeeds / Tools
    Replies: 5
    Last Post: June 29th, 2004, 08:29 AM
  4. Can pages have PR even if they're not in the index yet?
    By cjk in forum Search Engine Optimization
    Replies: 1
    Last Post: November 21st, 2003, 12:50 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •