Results 1 to 3 of 3
  1. #1
    Roll Tide mobilebadboy's Avatar
    Join Date
    January 18th, 2005
    Location
    Mobile, Alabama
    Posts
    1,220
    Need wget alternative
    I'm absolutely sick of seeing constant Wget user-agents in my stats, and on most of my sites I can easily block Wget through my expanding list of htaccess blocks. However on some sites, since I could never get much else to work, I'm using wget for my cron jobs.

    But if I block wget through htaccess then my cron jobs get blocked as well.

    All the commands are in the form of:

    wget --delete-after http://mysite.com/blah.php

    I for sure want to keep the --delete-after (or something similar). I learned that command after 1000's of files appeared in root without it.

    Shawn Kerr (.com) | Disney World | SEC Football

  2. #2
    Newbie
    Join Date
    February 5th, 2007
    Posts
    21
    Probably you identify wget by its "user agent", when blocking it in .htaccess ? Then you can just change user agent for your own runs of wget, so it won't report who is it. Something like this:

    wget --user-agent="Mozilla/5.0 (Linux; en-US; rv:1.8.0.9) Gecko/20061206 Firefox/1.5.0.9"

    or just:
    wget --user-agent=""

  3. #3
    Roll Tide mobilebadboy's Avatar
    Join Date
    January 18th, 2005
    Location
    Mobile, Alabama
    Posts
    1,220
    Probably you identify wget by its "user agent", when blocking it in .htaccess ?
    Correct, my blocks are based on part of the UA.

    Never knew you could set a UA like that, I'll give it a try.

    Thanks.

    Shawn Kerr (.com) | Disney World | SEC Football

  4. Newsletter Signup

+ Reply to Thread

Similar Threads

  1. Problem with wget download
    By Alwin Augustin in forum Rakuten LinkShare - LS
    Replies: 3
    Last Post: February 24th, 2011, 06:06 PM
  2. alternative
    By tuff luck in forum ShareASale - SAS
    Replies: 1
    Last Post: March 4th, 2009, 10:09 PM
  3. Using Wget in PHP
    By bsnrjones in forum Programming / Datafeeds / Tools
    Replies: 4
    Last Post: March 2nd, 2004, 04:10 AM
  4. Help, wget is eating my bandwidth URGENT
    By tamalyn in forum Midnight Cafe'
    Replies: 12
    Last Post: August 11th, 2003, 05:45 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •