Results 1 to 7 of 7
  1. #1
    Member
    Join Date
    March 16th, 2005
    Posts
    59
    How do you deal with large csvs
    Just wondering how you all deal with csv data feeds that are too large to simply open in excel.

  2. #2
    Affiliate Manager adambha's Avatar
    Join Date
    October 20th, 2006
    Posts
    301
    Quote Originally Posted by Babrees
    Just wondering how you all deal with csv data feeds that are too large to simply open in excel.
    An easy solution would be to open it with a text editor (Notepad will work until you run out of memory, I like Crimson Editor) and simply break it up into multiple files. That is, copy/paste chunks of the file into to new files and save each one as newfile1.csv, newfile2.csv, etc.

    Definitely a workaround, but as the name implies, it works!

  3. #3
    Crazy Cat Lady Heidi's Avatar
    Join Date
    January 18th, 2005
    Location
    Rochester, NY
    Posts
    1,685
    i use a file splitter to do it - i'd tell you which one i use but its no longer available to get.
    Heidi
    "Happy are those who dream dreams and are willing to pay the price to make them come true"

  4. #4
    Member
    Join Date
    March 16th, 2005
    Posts
    59
    Quote Originally Posted by Heidi
    i use a file splitter to do it - i'd tell you which one i use but its no longer available to get.
    hmm, thanks - that's really helpful

  5. #5
    Affiliate Manager
    Join Date
    January 18th, 2005
    Location
    Los Angeles, California
    Posts
    1,913
    Just curious, as I've been considering making a text processing tool for such things: Just how big is that file you're working on (file size, how many records, how many columns)?
    Richard Gaskin
    Developer of WebMerge: Publish any data feed on any site
    http://www.fourthworld.com

  6. #6
    Crazy Cat Lady Heidi's Avatar
    Join Date
    January 18th, 2005
    Location
    Rochester, NY
    Posts
    1,685
    there are some feeds with 500,000 products or more in them....

    Babrees - do a search on google for a text file splitter.. you'll find others
    Heidi
    "Happy are those who dream dreams and are willing to pay the price to make them come true"

  7. #7
    Full Member
    Join Date
    September 10th, 2005
    Posts
    369
    I use a file splitter (http://www.dekabyte.com/filesplitter/) and either notetab lite, crimson editor or editpad pro. Textpipe is a nice piece of software but expensive. They have a free trail though. There is also http://www.monkeyjob.com/

  8. Newsletter Signup

+ Reply to Thread

Similar Threads

  1. National deal list and Local deal
    By arunita in forum Groupon
    Replies: 1
    Last Post: May 5th, 2011, 10:16 AM
  2. ATTENTION! Calling all Daily Deal/Deal of the Day/Coupon/Savings/Gift/Jewelry Sites!!
    By Kim Salvino in forum Promotions, Sales, and Coupons on Affiliate Window
    Replies: 0
    Last Post: May 25th, 2010, 03:33 PM
  3. Replies: 0
    Last Post: May 25th, 2010, 03:33 PM
  4. Best Deal Magazines Deal of the Day Script Problem
    By ivorytklr in forum ShareASale - SAS
    Replies: 3
    Last Post: September 10th, 2007, 12:30 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •