Results 1 to 14 of 14
  1. #1
    Newbie
    Join Date
    October 26th, 2006
    Posts
    25
    CJ Datafeed question
    I am currently creating a price comparison site and was wondering if there is any advantage with the datafeed format?

    I don't know if which would be the best answer if there is any to the questions below? Could anyone help explain any benefits/disadvantages for each question? Thanks

    1. What format would you like to use to receive your data? Choose from one of the following formats:
    a. TAB
    b. CSV
    c. PIPE
    d. XML
    e. EXCEL

    2. Which method of transfer would you like to use to receive your product data? Choose from one of the following:
    a. CJ FTP (you access to our FTP servers)
    b. Client FTP (we access to your FTP servers to push the file(s)) with any log-in and password information needed for access
    c. HTTP (you access our HTTP Web servers)

  2. #2
    ABW Veteran Mr. Sal's Avatar
    Join Date
    January 18th, 2005
    Posts
    6,795
    Quote Originally Posted by Davecore
    I am currently creating a price comparison site and was wondering if there is any advantage with the datafeed format?

    I don't know if which would be the best answer if there is any to the questions below? Could anyone help explain any benefits/disadvantages for each question? Thanks

    1. What format would you like to use to receive your data? Choose from one of the following formats:
    a. TAB
    b. CSV
    c. PIPE
    d. XML
    e. EXCEL

    2. Which method of transfer would you like to use to receive your product data? Choose from one of the following:
    a. CJ FTP (you access to our FTP servers)
    b. Client FTP (we access to your FTP servers to push the file(s)) with any log-in and password information needed for access
    c. HTTP (you access our HTTP Web servers)
    Dave, you say that you're creating a price comparison site, but I think that before you start to even think about creating a price comparison site, that at least you should be familiar on how datafeeds work...

    To me, only you should know what's best for you to use, because any of those examples you posted are going to work for what you're trying to do, so only you should know what works better for you...

    Anyway, I use the a. example on both examples you posted for my CJ datafeeds, but I don't see how that can help you decide...

  3. #3
    ABW Ambassador affninja's Avatar
    Join Date
    December 11th, 2005
    Location
    Nor-Cal
    Posts
    651
    I use XML feed files and HTTP access.

    Since the data is really the same no matter how you get it, I don't think it matters.

  4. #4
    Full Member iolaire's Avatar
    Join Date
    October 3rd, 2006
    Location
    Arlington, VA
    Posts
    229
    My feeling is that a. TAB, b. CSV, c. PIPE is the easiest to use, but then maybe I'm not doing the xml thing right.

  5. #5
    Newbie
    Join Date
    March 7th, 2009
    Posts
    9
    How do you get the datafeed from CJ.

    I don't find the way. Can anyone help?

  6. #6
    ABW Ambassador
    Join Date
    January 18th, 2005
    Location
    England
    Posts
    4,327
    Quote Originally Posted by sat_moonstruck
    How do you get the datafeed from CJ.

    I don't find the way. Can anyone help?
    you pay for them, unless you earn a ton of commissions, then they are free to access.

    Get in touch with cj.com and ask for datafeed access

  7. #7
    Newbie
    Join Date
    March 7th, 2009
    Posts
    9
    Can anyone tell me where exactly it is written how to start getting the feed ?
    My task is to get all the promotional coupon feeds of different merchants (thousands) in a combined way from CJ . Same goes for Linkshare and others.
    Can you tell me if I want to have feed from 6-10 Affiliate networks into my database, is it possible or not ? If yes, with a average programming skill how big task is it .. more than a week ? Is there a simpler solution ?

  8. #8
    Comfortably Numb John Powell's Avatar
    Join Date
    October 17th, 2005
    Location
    Bayou Country, LA
    Posts
    3,432
    I am currently creating a price comparison site and was wondering if there is any advantage with the datafeed format?
    The advantage is using the set up that you are most familiar with. That's why they have options. I like XML off the CJ ftp server.

  9. #9
    ABW Ambassador isellstuff's Avatar
    Join Date
    November 9th, 2005
    Location
    Virginia
    Posts
    1,659
    XML files can get pretty big and CJ doesn't deal well with really big datafeed files. You will have to have CJ chunk your feed files and maybe even chunk them while you process them, assuming you join a lot of programs. To give you an idea, I use tab format, which is more compact, and I am still pulling 11.4 GB uncompressed. Imagine the size with xml tags.

    I use xml format for Amazon when I ftp their data files and that's 17.1 GB compressed. I don't know how big uncompressed because I've never uncompressed them to disk or looked at the gzip stats. Instead I uncompress in memory and process in chunks. Its a huge pain.
    Merchants, any data you provide to Google Shopping should also be in your affiliate network datafeed. More data means more sales!

  10. #10
    Affiliate Manager
    Join Date
    January 18th, 2005
    Location
    Los Angeles, California
    Posts
    1,913
    Tab and Pipe are the most efficient to parse.

    CSV is not a single standard but rather an ad hoc collection of variants that is particularly onerous to work with and must die.

    XML is great for transferring data between applications that know little about one another, and/or when the data is inherently hierarchical by nature. Since product feeds tend to have a uniform structure well suited to a tabular format the overhead of parsing XML tags is an unnecessary expense, not to mention what those do to file size.

    So my vote: tab or pipe.
    Richard Gaskin
    Developer of WebMerge: Publish any data feed on any site
    http://www.fourthworld.com

  11. #11
    Full Member
    Join Date
    October 22nd, 2006
    Posts
    200
    Quote Originally Posted by FourthWorld
    CSV is not a single standard but rather an ad hoc collection of variants that is particularly onerous to work with and must die.
    lol

    I agree with Fourthworld.

    XML is great for smaller sets of data eg RSS feeds, podcasts etc but far too bulky for any reasonable sized product feed.

    I would choose pipe over tab. But that is just a personal preference.

    As to method of delivery I would go for a/ CJ FTP or c/ HTTP because those are the systems available for most networks and the same PHP functions can be used to download all the feeds.

    Bob

  12. #12
    Full Member iolaire's Avatar
    Join Date
    October 3rd, 2006
    Location
    Arlington, VA
    Posts
    229
    Quote Originally Posted by isellstuff
    I use xml format for Amazon when I ftp their data files and that's 17.1 GB compressed. I don't know how big uncompressed because I've never uncompressed them to disk or looked at the gzip stats. Instead I uncompress in memory and process in chunks. Its a huge pain.
    isellstuff - thank you, that is a good hint. I'm uncompressing the files then parsing them... I can see the advantage of working dirrectly with the compressed files - I did not know it was an option.

  13. #13
    Newbie
    Join Date
    April 23rd, 2009
    Posts
    2
    Quote Originally Posted by Donk
    lol

    I agree with Fourthworld.

    XML is great for smaller sets of data eg RSS feeds, podcasts etc but far too bulky for any reasonable sized product feed.

    I would choose pipe over tab. But that is just a personal preference.

    As to method of delivery I would go for a/ CJ FTP or c/ HTTP because those are the systems available for most networks and the same PHP functions can be used to download all the feeds.

    Bob
    I'd choose pipe over tab too.

  14. #14
    Newbie
    Join Date
    December 13th, 2008
    Posts
    13
    I'm sort of a newbie with datafeeds too. Is there a good resource on the internet or a good book that helps explains them in detail?

    BTW, My vote is for the pipe format.

  15. Newsletter Signup

+ Reply to Thread

Similar Threads

  1. Datafeed question
    By bbb in forum Programming / Datafeeds / Tools
    Replies: 4
    Last Post: January 23rd, 2007, 12:46 PM
  2. Datafeed question
    By bbb in forum Midnight Cafe'
    Replies: 3
    Last Post: January 23rd, 2007, 12:44 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •