Results 1 to 11 of 11
  1. #1
    Affiliate Manager
    Join Date
    January 23rd, 2013
    Posts
    16
    Robots question?
    Open question about a meta tag.

    <meta name="robots" content="index, follow" />

    Merchants or publishers who create pages, do you use index & follow? And what circumstance use "no index, no follow?"

  2. #2
    ...and a Pirate's heart. Convergence's Avatar
    Join Date
    June 24th, 2005
    Posts
    6,918
    By general rule of thumb ALL pages are automatically "index, follow" - adding a meta tag for them is actually not necessary. However, it's such an old habit the majority of webmasters still do.

    We use a combination depending on the page.

    "noindex, nofollow" on all contact pages.
    "noindex, follow" on some category, some merchant, and some brand pages.

    Have even tested "nocache" - for pages we don't want previews/cached history.
    Salty kisses, Sandy toes, and a Pirate's heart...

  3. Thanks From:

  4. #3
    Affiliate Manager
    Join Date
    January 23rd, 2013
    Posts
    16
    What is your opinion on sale pages? I recently had a conversation with one of our IT guys. Marketing opinion vs. IT opinion... My (non-IT opinion) was to index/follow all promo pages, short (like a weekend President's Day Sale) or long (month +) - his - no index/no follow. I thought maybe it would be okay not on the short ones, but should be on the longer ones.
    Your thought?

  5. #4
    ...and a Pirate's heart. Convergence's Avatar
    Join Date
    June 24th, 2005
    Posts
    6,918
    I would look into using "nocache" for those pages.

    If a user clicks on a link from the SERPs, and the page is no longer there - that's no problem - just redirect them to a current promotion.

    However, if the user views the cached page, then they can still see what was there...
    Salty kisses, Sandy toes, and a Pirate's heart...

  6. #5
    Newbie
    Join Date
    February 12th, 2013
    Location
    India
    Posts
    11
    I think alternative you can do it from web master tool. You can removal request of non-existing pages or dead pages. I suggest to de-index the page and redirect it to updated page. Generally I don't use nofollow / noindex as i only include pages which are important.

  7. #6
    Marketing Manager
    Join Date
    January 24th, 2013
    Location
    Seattle, WA
    Posts
    130
    @JohnK@ifurn: If your sales are recurring (i.e. you have a President's day sale every year) I would keep a page live for it all year long, indexed with links followed. During the off-season for the promotion, add some placeholder text that says something like, "We have a great President's Day sale every year. If you would like to receive notifications about our sales, enter your email address here." Of course, this assumes that you want the entire world to know about your sale. If it's for a limited audience, I would noindex the page so people won't find it via search engines.

    I'm not sure when I would noindex, follow a page. In general, if a page isn't meant for search engines to serve as a result, they won't think much of the links on it either. Maybe someone else can give a good example of when you would not want a page to be indexed but you would want the links followed.

  8. Thanks From:

  9. #7
    ...and a Pirate's heart. Convergence's Avatar
    Join Date
    June 24th, 2005
    Posts
    6,918
    Quote Originally Posted by Nathan Grimm View Post
    I'm not sure when I would noindex, follow a page. In general, if a page isn't meant for search engines to serve as a result, they won't think much of the links on it either. Maybe someone else can give a good example of when you would not want a page to be indexed but you would want the links followed.
    We have merchant info pages and some merchants do not what those pages indexed as they risk losing out in the SEO battle. However, the bots need to access product links...
    Salty kisses, Sandy toes, and a Pirate's heart...

  10. #8
    Marketing Manager
    Join Date
    January 24th, 2013
    Location
    Seattle, WA
    Posts
    130
    I see, so the page ranks too high for the Merchant's brand name?

  11. #9
    Moderator
    Join Date
    April 6th, 2006
    Posts
    2,689
    I use "noindex, follow" if there is duplicate content - for example, on CMS category pages..

    This is to ensure the article itself receives the higher ranking.

  12. Thanks From:

  13. #10
    ...and a Pirate's heart. Convergence's Avatar
    Join Date
    June 24th, 2005
    Posts
    6,918
    Quote Originally Posted by Nathan Grimm View Post
    I see, so the page ranks too high for the Merchant's brand name?
    That's THEIR fear...
    Salty kisses, Sandy toes, and a Pirate's heart...

  14. #11
    Marketing Manager
    Join Date
    January 24th, 2013
    Location
    Seattle, WA
    Posts
    130
    Quote Originally Posted by Convergence View Post
    That's THEIR fear...
    I hear you. I would want as many neutral and positive pages in existence as possible. It crowds out the negative pages. Although I'm pretty confident that I can rank #1 for my brand name no matter what.

  15. Newsletter Signup

Closed Thread

Similar Threads

  1. Restricted by robots.txt without robots.txt?
    By mayfly in forum Search Engine Optimization
    Replies: 10
    Last Post: August 26th, 2009, 05:13 PM
  2. Robots.txt question.
    By Hardaka in forum Newbie Affiliate FAQs & Helpful Articles
    Replies: 11
    Last Post: December 20th, 2007, 08:49 PM
  3. robots.txt file question
    By Doc Sawyer in forum Search Engine Optimization
    Replies: 4
    Last Post: December 7th, 2002, 07:10 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •