Results 1 to 5 of 5
  1. #1
    Newbie
    Join Date
    January 18th, 2005
    Posts
    49
    Can anybody explain what good or bad this tag does? I try to follow "those other boards" and am aware that the florida update has probably missed me. Also confused on what is exactly included in the robot.txt file. . . forgive me as I am still learning. White hat/Black hat, small hat, cat in the hat . . . Do you need a meta tag = robots for anything? or just a sneaky move . . .

    -gray day
    "Be really whole and all things will come to you"

    -Lao Tsu

  2. #2
    Full Member ellen-s4y's Avatar
    Join Date
    January 18th, 2005
    Posts
    489
    http://www.robotstxt.org/wc/faq.html has a lot of information.

    I always use robots.txt to stop good bot from accessing certain areas.

    Bad bots get banned through .htaccess.

    As far as the meta tags. I'm not sure if they are neccesary except for when you don't want a bot to index the page - noindex, or don't want it to follow links - nofollow.

  3. #3
    Newbie
    Join Date
    January 18th, 2005
    Posts
    49
    Thanks ellen, I will check it out. Always so excited when someone posts such a quick reply. I love this place!!!!

    -gray day
    "Be really whole and all things will come to you"

    -Lao Tsu

  4. #4
    Newbie
    Join Date
    January 18th, 2005
    Posts
    49
    I noticed Quepasacreep keeps visiting my site, any idea if this is good or bad?

    -gray day
    "Be really whole and all things will come to you"

    -Lao Tsu

  5. #5
    ABW Ambassador
    Join Date
    January 18th, 2005
    Posts
    804
    Hi,

    I don't think it's been definitively identified yet, but feeling is that it is an American search engine focusing on the Latin community. See it in action at http://www.quepasa.com/

  6. Newsletter Signup

+ Reply to Thread

Similar Threads

  1. Help - Should this meta name robots noindex, nofollow be in the header.php?
    By Trust in forum Blogging, Mobile and Social Media
    Replies: 6
    Last Post: November 15th, 2009, 08:40 AM
  2. Restricted by robots.txt without robots.txt?
    By mayfly in forum Search Engine Optimization
    Replies: 10
    Last Post: August 26th, 2009, 05:13 PM
  3. meta name "robots" has sth. changed?
    By Roland in forum Search Engine Optimization
    Replies: 0
    Last Post: July 8th, 2005, 03:29 PM
  4. Use of "Robots" Meta Tag on pages
    By Andy in forum Search Engine Optimization
    Replies: 8
    Last Post: October 3rd, 2002, 11:39 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •