Results 1 to 7 of 7
  1. #1
    Newbie
    Join Date
    January 18th, 2005
    Posts
    9
    CJ, Linkshare feeds: can they be downloaded automatically?
    Hi,
    I'm thinking of adding feeds to enhance my site. Is it possible
    to download them (from CJ, Linkshare) automatically, let's say via cron or something similar? Doing it manually can be time consuming

    can it be done?

    thanks in advance

  2. #2
    Moderator MichaelColey's Avatar
    Join Date
    January 18th, 2005
    Location
    Mansfield, TX
    Posts
    16,232
    Sure. Many of us do that. Read through the posts on the datafeed forum here and you'll find some details.
    Michael Coley
    Amazing-Bargains.com
     Affiliate Tips | Merchant Best Practices | Affiliate Friendly? | Couponing | CPA Networks? | ABW Tips | Activating Affiliates
    "Education is the most powerful weapon which you can use to change the world." Nelson Mandela

  3. #3
    Not Verif-Lidated infoTim's Avatar
    Join Date
    January 18th, 2005
    Location
    Sunny Florida
    Posts
    1,021
    Yes. :-)
    Tim
    consultant by day, affiliate by night

  4. #4
    Moderator MichaelColey's Avatar
    Join Date
    January 18th, 2005
    Location
    Mansfield, TX
    Posts
    16,232
    Here's a poll showing that about half of datafeed users have automated the process:

    http://forum.abestweb.com/poll.php?d...lts&pollid=465

    Here's a link to the Datafeed Form:

    http://forum.abestweb.com/forumdisplay.php?f=193

    Linkshare is the hardest to automate due to their recent changes. Instead of having the files to download, they have macros that generate the datafeed file on the fly. The difficulty is that they're listed in the directory as macro files (with a .lmp extension) but you have to download them without the extension. This thread has two solutions, one using macros in a PC-based FTP package and mine using a Perl program and Net::FTP::Common, which works great on a Unix platform:

    http://forum.abestweb.com/showthread.php?t=5519

    Here's the basic flowchart I use:

    1) Download any new datafeeds to a local mirror directory.
    2) Analyze the datafeeds in the local mirror directory to see if any of them are new/changed, what merchants they are for, etc. For each new/changed file, do all of the following.
    3) See if there has been a substantial drop in the number of records. If so, skip the file. Incomplete datafeeds happen. Don't wipe out your database when you get an empty file.
    4) Flag all products in the database from that merchant as "pending". Process the datafeed, marking each product as "updated" or "inserted". After you're done, mark all the "pending" products for that merchant as "deleted".
    Michael Coley
    Amazing-Bargains.com
     Affiliate Tips | Merchant Best Practices | Affiliate Friendly? | Couponing | CPA Networks? | ABW Tips | Activating Affiliates
    "Education is the most powerful weapon which you can use to change the world." Nelson Mandela

  5. #5
    Newbie
    Join Date
    January 18th, 2005
    Posts
    9
    Cool. Thank you to both. When time come, I'll probbaly pay someone from here at least for the download and insert into mysql part.

    Can also choose to grab only a few fields for the products? Like just the name, URL, image, retail price, sale price...or do I download everthing and only have the script put those in the MySQL?

    thanks again,

  6. #6
    Moderator MichaelColey's Avatar
    Join Date
    January 18th, 2005
    Location
    Mansfield, TX
    Posts
    16,232
    You download everything and just put what you want into your database.
    Michael Coley
    Amazing-Bargains.com
     Affiliate Tips | Merchant Best Practices | Affiliate Friendly? | Couponing | CPA Networks? | ABW Tips | Activating Affiliates
    "Education is the most powerful weapon which you can use to change the world." Nelson Mandela

  7. #7
    Newbie
    Join Date
    January 18th, 2005
    Posts
    9
    Nice.
    Those datafeeds can be intimidating unless you get to know them .

    thank you!

  8. Newsletter Signup

+ Reply to Thread

Similar Threads

  1. Problems with LinkShare feeds
    By Convergence in forum Rakuten LinkShare - LS
    Replies: 24
    Last Post: August 26th, 2013, 02:57 PM
  2. Are LinkShare XML Feeds Broken Right Now?
    By ClickPimpsta in forum Rakuten LinkShare - LS
    Replies: 14
    Last Post: August 9th, 2012, 12:16 PM
  3. Linkshare coupon feeds?
    By MusicStack in forum Couponer's Corner
    Replies: 9
    Last Post: November 29th, 2009, 03:37 PM
  4. Requesting information to Upload data feeds through url to FTP automatically
    By gdi_fortune in forum Programming / Datafeeds / Tools
    Replies: 1
    Last Post: June 26th, 2007, 02:06 AM
  5. Replies: 6
    Last Post: August 7th, 2006, 10:15 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •