Results 1 to 5 of 5
November 9th, 2010, 10:43 AM #1List Pages in SE Index
superCool has a few sites with some datafeed content and is thinking about all the list pages that end up in the search engines. There are list pages by category, by merchant, by brand, by color, by price, etc. and each can be sorted in different ways. These pages have a small image, product title and a few details about each product – 20 or so items per list page. So there are a LOT of these pages when you consider all the combinations.
What are your thoughts on having these pages in the index? Do you think these pages are in any way a distraction to the spiders or do they interfere with the indexing of the more important product pages? Would it be any benefit to request that these pages not be indexed? <meta name="robots" content="noindex, follow">
The reason superCool is asking is because he seems to be having some problems keeping all of his product pages indexed. He’s thinking that maybe these list pages are getting in the way somehow.
What thinketh thou?
Last edited by superCool; November 9th, 2010 at 10:45 AM.
November 9th, 2010, 10:52 AM #2
I am thinkesting that you should take a look in GWT to see if there is any mention of duplication if the indexed pages are dynamically generated.
November 9th, 2010, 11:06 AM #3
November 9th, 2010, 03:45 PM #4
is superCool seeing this issue right? would those pages provide any benefit or are they more likely to be trouble makers?
now superCool is thinking about figuring out a way to keep one set of list pages and noindex the rest. thoughts?
November 9th, 2010, 05:02 PM #5
Ideally there would be a way in your script to generate the noindex metatags for one set of results. If you have data on how people are using the search and results it should let you know which ones to not noindex.
There is a way in GWT to keep them from following dynamic pages by entering the part of an URI that is unique to those results. If search by price is what you want indexed, don't noindex those pages, if search by color produces some unique string in the URI, enter that in GWT so they'll ignore it. GWT offers a pretty complete section of what/how to manage dynamic pages to avoid duplication issues. I don't have a link, but there should be one somewhere on the page where you found the duplicate description information. 3 or 4 notices show it is just beginning to show up for them. Nip it in the bud. Good luck.
By gingercindy in forum WebMerge (Fourthworld.com)Replies: 5Last Post: September 28th, 2006, 09:36 AM
By Pierre (aka Terdef) in forum WebMerge (Fourthworld.com)Replies: 0Last Post: June 30th, 2005, 04:24 AM
By dak142 in forum Programming / Datafeeds / ToolsReplies: 5Last Post: June 29th, 2004, 07:29 AM
By cjk in forum Search Engine OptimizationReplies: 1Last Post: November 21st, 2003, 11:50 AM