Results 1 to 5 of 5
  1. #1
    Newbie
    Join Date
    January 18th, 2005
    Posts
    15
    does anyone know how i can check to see if a search engine bot is visiting my site or not. I would like to do some set of actions if it is a search bot and show the normal page if it is a normal user.

  2. #2
    Affiliate Miester my2cents's Avatar
    Join Date
    January 18th, 2005
    Location
    far far away....
    Posts
    2,161
    check your website stats which are in the back end of you hosting account...

    If your hosting company doesn't offer stats get a new hosting company... perferably one offering Cpanel...

    Joe

    And, that's the bottom line because it's my2cents!

  3. #3
    Newbie
    Join Date
    January 18th, 2005
    Posts
    22
    You can check the user agent with the variable
    <pre class="ip-ubbcode-code-pre">
    $_SERVER["HTTP_USER_AGENT"]
    </pre>
    A case-insensitive comparison to the following strings should weed out the most active spiders
    <UL TYPE=SQUARE>
    <LI>"bot"
    <LI>"spider"
    <LI>"crawler"
    <LI>"slurp"
    <LI>"scooter"
    <LI>"zyborg"
    <LI>"szukacz"
    <LI>"ia_archiver"
    <LI>"baidu"[/list]

  4. #4
    Full Member
    Join Date
    January 18th, 2005
    Posts
    379
    Your raw log file will show this information too. The nice thing about the raw files is that you can see which pages were spidered, not just how many like many of the stats packages show.

    In regards to my2cents comments about CPanel. Most CPanel implementations have a feature where you can view the last 300 entries in the raw logs files. It a great way to do quick checks.

    &lt;hr&gt;
    Leave the gun, take the cannolis.

  5. #5
    Full Member
    Join Date
    January 18th, 2005
    Posts
    88
    I wrote an article to block spambots and prevent email harvesting.
    The PHPCode is fully cross-platform and it can work on any server with PHP enabled.

    http://www.allthewebsites.org/articl...vesting,2.html


    Tell me your suggestions.

    http://www.procolleges.com - Professional Colleges USA

  6. Newsletter Signup

+ Reply to Thread

Similar Threads

  1. How to Block ALL Search Bots from Sub Domain?
    By Uncle Rico in forum Search Engine Optimization
    Replies: 7
    Last Post: December 5th, 2009, 02:33 AM
  2. php search and replace
    By dflsports in forum Programming / Datafeeds / Tools
    Replies: 2
    Last Post: February 23rd, 2006, 10:59 AM
  3. Search with PHP
    By wly in forum Programming / Datafeeds / Tools
    Replies: 14
    Last Post: December 10th, 2004, 10:48 AM
  4. PHP search Box
    By dak142 in forum Programming / Datafeeds / Tools
    Replies: 1
    Last Post: May 7th, 2004, 05:25 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •