Results 1 to 6 of 6
  1. #1
    Visual Artist & ABW Ambassador lostdeviant's Avatar
    Join Date
    September 7th, 2007
    Location
    Cuautitlán, Edo. de México
    Posts
    1,725
    Bad bod mod for .htaccess? "user-agent string: Java/1.4.1_04"
    I implemented a bot trap similar to one mentioned here in ABW and I noticed all of the bad bot user agent strings are showing "Java/1.4.1_04 "

    Would it be safe for me to add the following to my .htaccess?

    RewriteCond %{HTTP_USER_AGENT} ^Java
    RewriteRule .* - [F]

    if it is ok, would I add it before or after my wordpress rules?
    Sorry for the dumb question. Rewrite rules (and about anything else .htaccess ) are so confusing for me even after reading many web pages about them.

  2. #2
    Moderator BurgerBoy's Avatar
    Join Date
    January 18th, 2005
    Location
    jacked by sylon www.sylonddos.weebly.com
    Posts
    9,618
    I have this in my .htaccess file.

    Any bot you have on the list gets a 403 when it tries to access any thing on your site.

    Code:
    <Limit GET POST>
    #The next line modified by DenyIP
    order allow,deny
    #The next line modified by DenyIP
    #deny from all
    allow from all
    </Limit>
    
    <Files 403.shtml>
    order allow,deny
    allow from all
    </Files>
    
    SetEnvIfNoCase User-Agent .*Twiceler.* bad_bot
    SetEnvIfNoCase User-Agent .*Java/1.4.1_04.* bad_bot
    
    order allow,deny
    deny from env=bad_bot
    allow from all
    Just keep adding things you want blocked.

    Right now I'm blocking:

    Code:
    SetEnvIfNoCase User-Agent .*Twiceler.* bad_bot
    SetEnvIfNoCase User-Agent .*VoilaBot BETA 1.2.* bad_bot
    SetEnvIfNoCase User-Agent .*libwww-perl/5.805.* bad_bot
    SetEnvIfNoCase User-Agent .*Java/1.5.0_11.* bad_bot
    SetEnvIfNoCase User-Agent .*Sogou web spider/3.0.* bad_bot
    SetEnvIfNoCase User-Agent .*psbot.* bad_bot
    SetEnvIfNoCase User-Agent .*Exabot.* bad_bot
    SetEnvIfNoCase User-Agent .*Charlotte/1.0b.* bad_bot
    SetEnvIfNoCase User-Agent .*boitho.com-dc.* bad_bot
    SetEnvIfNoCase User-Agent .*ajSitemap.* bad_bot
    SetEnvIfNoCase User-Agent .*bot/1.0.* bad_bot
    SetEnvIfNoCase User-Agent .*panscient.com.* bad_bot
    SetEnvIfNoCase User-Agent .*WebDataCentreBot/1.0.* bad_bot
    SetEnvIfNoCase User-Agent .*Java/1.4.1_04.* bad_bot

    Vietnam Veteran 1966-1970 USASA
    ABW Forum Rules - Advertise At ABW

  3. #3
    Visual Artist & ABW Ambassador lostdeviant's Avatar
    Join Date
    September 7th, 2007
    Location
    Cuautitlán, Edo. de México
    Posts
    1,725
    Thank you.

  4. #4
    ABW Ambassador ladidah's Avatar
    Join Date
    October 15th, 2007
    Location
    MA
    Posts
    1,888
    Is there a way just to include the good bots instead of excluding the bad bots?

    My list of bots are so long and to think that there are all kinds of new ones creeping in every day.

  5. #5
    Moderator BurgerBoy's Avatar
    Join Date
    January 18th, 2005
    Location
    jacked by sylon www.sylonddos.weebly.com
    Posts
    9,618
    There probably is, but, I don't know the code. Maybe someone else here does.

    I just check my stats in cpanel every day and add any new ones I want banned.

    Vietnam Veteran 1966-1970 USASA
    ABW Forum Rules - Advertise At ABW

  6. #6
    ABW Ambassador 2busy's Avatar
    Join Date
    January 17th, 2005
    Location
    Tropical Mountaintop
    Posts
    5,636
    If your site is hosted on a Unix server John offered a great way to block the bad bots and it works.
    http://forum.abestweb.com/showthread.php?p=902504

  7. Newsletter Signup

+ Reply to Thread

Similar Threads

  1. CJ API: "Fault: java.lang.NullPointerException"
    By kekc in forum Commission Junction - CJ
    Replies: 3
    Last Post: November 23rd, 2007, 07:54 PM
  2. Replies: 2
    Last Post: July 29th, 2005, 01:51 PM
  3. Datafeeds & Google: bad "news" - Are you a "thin affiliate" ?
    By heisje in forum Programming / Datafeeds / Tools
    Replies: 4
    Last Post: June 29th, 2005, 08:52 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •