Results 1 to 7 of 7
  1. #1
    ...and a Pirate's heart. Convergence's Avatar
    Join Date
    June 24th, 2005
    Networks upgrade your datafeed systems!
    Unless we're missing something.

    This goes out to:


    We've been working trying to improve OUR feed processing procedures to decrease wasted bandwidth and server resources when grabbing feeds from networks where the feeds haven't been updated.

    It appears none of the above networks support If-Modified-Since. Don't know why. By supporting If-Modified-Since, the network saves bandwidth and server resources, too by allowing an affiliate's software to only download updated feeds.

    Again, if we're missing something here - let the world know, please.

    Let's step into the 21st Century...
    Salty kisses, Sandy toes, and a Pirate's heart...

  2. Thanks From:

  3. #2
    ...and a Pirate's heart. Convergence's Avatar
    Join Date
    June 24th, 2005
    Why isn't CJ listed?

    Because CJ allows affiliates to set up datafeed subscriptions where the network will SEND THE AFFILIATE a datafeed when it's been updated.

    Like that, we do...
    Salty kisses, Sandy toes, and a Pirate's heart...

  4. #3

  5. #4
    ...and a Pirate's heart. Convergence's Avatar
    Join Date
    June 24th, 2005
    Hi Gary,

    Unfortunately, don't think that will work for us. Downloading only changed items within a feed would essentially replace an existing feed with just those changed items.

    However, will contact our developer and share your suggestion.

    Thank you for the prompt response...
    Salty kisses, Sandy toes, and a Pirate's heart...

  6. #5
    The affiliate formerly known as ojmoo
    Join Date
    January 18th, 2005
    SAS's ftp has a date on the file, check the date before downloading...let me find the code. This should download everything that was uploaded since yesterday.

    function downloadfile($ftp_server, $ftp_user_name, $ftp_user_pass, $dir, $file) {

    //to be downloaded
    $remote_file = $file;

    // set up basic connection
    $conn_id = ftp_connect($ftp_server);

    // login with username and password
    $login_result = ftp_login($conn_id, $ftp_user_name, $ftp_user_pass);

    if (ftp_chdir($conn_id, $dir)) { echo "Current directory is now: " . ftp_pwd($conn_id) . "\n"; }
    else { echo "Couldn't change directory\n"; }

    $buff = ftp_mdtm($conn_id, "/$dir/$file");
    $fdate = date ("Y-m-d", $buff);
    $yesterday = date("Y-m-d", time() - 60 * 60 * 24);

    // download a file
    if ( $fdate > $yesterday ) {
    if (ftp_get($conn_id, $file, $remote_file, FTP_BINARY)) {
    echo "successfully downloaded $file\n"; }
    else { echo "There was a problem while uploading $file\n"; }

    // close the connection
    Expert who says Moo

    a.k.a. OJMOO

    Cow Dance

  7. Thanks From:

  8. #6
    ...and a Pirate's heart. Convergence's Avatar
    Join Date
    June 24th, 2005
    Thanks, Oranges -

    Appreciate the help. See what we can do with it
    Salty kisses, Sandy toes, and a Pirate's heart...

  9. #7
    ShareASale President/CEO and ABW Veteran Brian - ShareASale's Avatar
    Join Date
    January 18th, 2005

    A couple of things that might even simplify it from there for you...

    The feed itself does have a date on it, but that data is also included in a couple of places.

    1. In the root directory of FTP you'll find a readme file which says...

    Updated Datafeeds

    In the root directory you will find files that contain a list of datafeeds updated over the last seven days. These files are named in the following format:


    So, if you are looking for datafeeds updated on November 9th, 2009, you would look at the file named 20091109.txt. The file is a pipe delimited list of datafeeds updated. This file does not contain a header line. The format is:


    The DateTimeUpdated field is in the format yyyy-MM-dd HH:mm:ss. If a datafeed has not been updated in the last 7 days, you will need to use the modified date on the actual datafeed file to determine the date of the last update.

    2. In the API - the Datafeeds call returns:

    Merchant ID, Merchant, Apply Status, FTP Status, Number of Products, Last Updated

    Brian Littleton
    President/CEO -, Inc.

  10. Thanks From:

  11. Newsletter Signup

+ Reply to Thread

Similar Threads

  1. Affiliate Networks vs. In house Hosted Networks Linkjuice?
    By PDXreader in forum Merchant Best Practices Forum
    Replies: 16
    Last Post: April 23rd, 2009, 11:47 AM
  2. Hotels Datafeed Script - Merchants/Networks Please Note
    By John Jupp in forum Midnight Cafe'
    Replies: 2
    Last Post: February 1st, 2008, 06:19 AM
  3. [Split] Affiliate Networks vs. CPA Networks
    By Kymbrla in forum Affiliate Marketing Tracking Software and Networks
    Replies: 46
    Last Post: January 11th, 2007, 02:24 PM
  4. Any New CPA Networks or Affiliate Networks worth trying ?
    By Vrindavan in forum Other Affiliate Networks
    Replies: 10
    Last Post: September 17th, 2005, 12:51 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts