Results 1 to 3 of 3
  1. #1
    Full Member iolaire's Avatar
    Join Date
    October 3rd, 2006
    Location
    Arlington, VA
    Posts
    229
    Language Suggestions For Huge XML Data Feeds?
    Does anyone have any suggestions on what language to work with huge XML Data Feeds? I have a import script set up in Ruby (XMLplarser and SAXDriver). But it looks like Ruby will not open files larger than about 2 GB. I'm thinking that I'll need to re-code my import script in say Perl. But before I do that can anyone provide any pro/cons on other languages?

  2. #2
    Full Member jollygoodpirate's Avatar
    Join Date
    January 18th, 2005
    Location
    NC
    Posts
    227
    This has been discussed before. You don't need to use a different language, just pipe the file chunks at a time and use your favorite language to process it:
    http://forum.abestweb.com/showthread.php?t=83881

  3. #3
    Full Member iolaire's Avatar
    Join Date
    October 3rd, 2006
    Location
    Arlington, VA
    Posts
    229
    Thanks, I've never poked around the programming thread, I'll look there in the future.

  4. Newsletter Signup

+ Reply to Thread

Similar Threads

  1. other (than English) language feeds
    By PetsWarehouse.com in forum Programming / Datafeeds / Tools
    Replies: 6
    Last Post: March 25th, 2008, 08:11 AM
  2. Ready to use XML/csv data feeds
    By myref in forum Starting an Affiliate Program & Merchant Q&A
    Replies: 0
    Last Post: November 23rd, 2004, 12:08 AM
  3. xml/csv data feeds
    By myref in forum Programming / Datafeeds / Tools
    Replies: 2
    Last Post: November 22nd, 2004, 10:20 AM
  4. Anyone managed to use webmerge with XML data feeds?
    By womanht in forum WebMerge (Fourthworld.com)
    Replies: 7
    Last Post: April 29th, 2003, 04:09 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •