Results 1 to 2 of 2
  1. #1
    Newbie
    Join Date
    July 15th, 2011
    Location
    London
    Posts
    24
    Question Wordpress with aggregated content
    I have a Wordpress based site, which aggregates lots of RSS feeds and then lets the user search them (as well as merging in search results from elsewhere). Essentially I'm using the Wordpress post database as an index for my own custom search engine. Once the content passes a certain age, I ditch it. For visitors this is a good specialised search engine and a nice aggregated feed of latest posts.

    Of course, aggregated and duplicate content is seriously going to pull down my Google index. I am bolstering the site with good original content to back things up. But I'm guessing its going to be an up hill struggle to work against the aggregated content I'm using.

    I was thinking, can I tell spiders to not index the aggregated content and only search the rest, with rel=nofollow, robots.txt etc. Is this likely to remedy the situation?
    Are there any other strategies I should pursue?

  2. #2
    ...and a Pirate's heart. Convergence's Avatar
    Join Date
    June 24th, 2005
    Posts
    6,918
    Quote Originally Posted by Arfa View Post
    I was thinking, can I tell spiders to not index the aggregated content and only search the rest, with rel=nofollow, robots.txt etc. Is this likely to remedy the situation?
    That would be very helpful. If the bots can't index it - it really doesn't exist.

    the Google also obeys googleon/googleoff tags. Search for those if you're not familiar.

    Also, if you can modify your header meta tags on those pages put in noarchive tags. The Google still archives pages without the noarchive tag, even if you have noindex tags or block them in robots.txt.

    Cheeky bastards, eh!?!...
    Salty kisses, Sandy toes, and a Pirate's heart...

  3. Newsletter Signup

+ Reply to Thread

Similar Threads

  1. Content/Essay-Style Content & Affiliate Sales
    By MicheleH in forum Newbie Affiliate FAQs & Helpful Articles
    Replies: 1
    Last Post: June 30th, 2011, 07:10 PM
  2. Migrating Content from Static Pages to WordPress
    By markwelch in forum Midnight Cafe'
    Replies: 8
    Last Post: May 25th, 2010, 09:33 PM
  3. Aggregated Affiliate reports
    By SOKRATES in forum Marketing Resources & Power Tools
    Replies: 1
    Last Post: March 20th, 2009, 01:09 PM
  4. Old Site, switching to Wordpress, duplicate content?
    By Hardaka in forum Newbie Affiliate FAQs & Helpful Articles
    Replies: 10
    Last Post: June 24th, 2008, 12:35 PM
  5. Replies: 11
    Last Post: October 15th, 2004, 02:15 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •