Results 1 to 6 of 6
  1. #1
    "An Englishman In New York" TJ's Avatar
    Join Date
    January 18th, 2005
    Posts
    3,282
    All this talk of the googlebot has gotten me wondering why some of my newer pages haven't been indexed... I have this tag set to 30 days... will this impact the spiders?

  2. #2
    ABW Ambassador
    Join Date
    January 18th, 2005
    Location
    West Coast USA
    Posts
    3,043
    >will this impact the spiders?

    I'm told that tag has no value at this time.

  3. #3
    ABW Ambassador
    Join Date
    January 18th, 2005
    Location
    United Kingdom
    Posts
    1,797
    Yeah, it is ignored by all the major spiders - it would be nice if you could tell them when to return to your site; but everyone would have it set to 1 day.

    Take the tag out, it's only cluttering things up.

    Search Engine Positioning - 1 Design 4 Life

  4. #4
    "An Englishman In New York" TJ's Avatar
    Join Date
    January 18th, 2005
    Posts
    3,282
    ok thanks,

    I was also told today that there is no point adding the 'follow, index' tag, is this true?

  5. #5
    ABW Ambassador Andy's Avatar
    Join Date
    January 18th, 2005
    Posts
    4,178
    I've heard the same thing, the "return" tag is worthless now.

    But, last I heard, the "robots" tag is still recognized, and should be used in conjunction with a robots.txt file to help direct the bots through your site.

    Andy

  6. #6
    ABW Ambassador
    Join Date
    January 18th, 2005
    Location
    United Kingdom
    Posts
    1,797
    Almost. The robots meta tag is recognised by some search engines, notably Google. However, the default state for a spider is to follow and index everything it can, so a "follow, index" tag is unnecessary as you are telling the spiders to do what they were gonna do anyway.

    Search Engine Positioning - 1 Design 4 Life

  7. Newsletter Signup

+ Reply to Thread

Similar Threads

  1. NoCache meta tag
    By Convergence in forum Search Engine Optimization
    Replies: 10
    Last Post: June 21st, 2014, 01:28 AM
  2. What is meta google tag?
    By johnnight in forum Search Engine Optimization
    Replies: 2
    Last Post: July 5th, 2010, 08:35 AM
  3. Meta tag analyzers
    By Slandingo in forum Newbie Affiliate FAQs & Helpful Articles
    Replies: 2
    Last Post: July 13th, 2007, 07:12 AM
  4. Smart Tag Meta Tag Not Working?
    By gettnthar in forum Suspicious Activity!
    Replies: 5
    Last Post: January 29th, 2002, 06:41 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •