Results 1 to 20 of 20
  1. #1
    ABW Ambassador
    Join Date
    January 4th, 2006
    Location
    USA
    Posts
    2,477
    Programs to Open Very Large Feeds?
    Does anybody know any programs that can open very large feeds? I've tried Excel and Notepad++, they wouldn't work.

  2. #2
    ABW Ambassador writerguy's Avatar
    Join Date
    January 17th, 2005
    Location
    Springfield, Missouri, USA
    Posts
    3,248
    Wow, really, Notepad++ wouldn't open it? I recently started using Notepad++ because it was the only thing I could find to open a couple of large feeds I was trying to work with.

    How large is the feed you're talking about, may I ask?

    Gary
    Generate more fake news.

  3. #3
    Moderator
    Join Date
    April 6th, 2006
    Posts
    2,689
    ConTEXT is amazing:

    Freeware Text Editor

    It opens files bigger than my developer pal thought was possible

  4. Thanks From:

  5. #4
    ABW Ambassador
    Join Date
    January 4th, 2006
    Location
    USA
    Posts
    2,477
    Quote Originally Posted by writerguy View Post
    Wow, really, Notepad++ wouldn't open it? I recently started using Notepad++ because it was the only thing I could find to open a couple of large feeds I was trying to work with.

    How large is the feed you're talking about, may I ask?

    Gary
    Gary, there are many feeds such as walmart, target, sears, overstock...are huge. I was planning to take a look at the feeds and decide if I want to use them on my sites.

  6. #5
    ABW Ambassador
    Join Date
    January 4th, 2006
    Location
    USA
    Posts
    2,477
    Quote Originally Posted by teezone View Post
    ConTEXT is amazing:

    Freeware Text Editor

    It opens files bigger than my developer pal thought was possible
    Thanks Teezone. I will take a look at ConTEXT.

  7. #6
    ABW Ambassador writerguy's Avatar
    Join Date
    January 17th, 2005
    Location
    Springfield, Missouri, USA
    Posts
    3,248
    I've opened Overstock.com with Notepad++. Haven't tried Target or Walmart, so I'll take your word for 'em. (I don't belong to either.)

    And thanks from me, too, teezone. I'll give ConTEXT a look.

    Gary
    Generate more fake news.

  8. #7
    ABW Ambassador
    Join Date
    January 4th, 2006
    Location
    USA
    Posts
    2,477
    I downloaded ConTEXT, amazing indeed. But I tested it on walmart feed(size 1.6GB). It still wouldn't open it. For merchants have giant feed like that, they should make sub-feeds by categories. Just a thought.

  9. #8
    ABW Ambassador
    Join Date
    January 4th, 2006
    Location
    USA
    Posts
    2,477
    Quote Originally Posted by writerguy View Post
    I've opened Overstock.com with Notepad++. Haven't tried Target or Walmart, so I'll take your word for 'em. (I don't belong to either.)
    Gary
    I just tested overstock feed on notepad++, got the message: "File is to big to be opened by Notepad++". Weird.

    But ConTEXT has no problem to open Overstock feed tho.

  10. #9
    ABW Ambassador writerguy's Avatar
    Join Date
    January 17th, 2005
    Location
    Springfield, Missouri, USA
    Posts
    3,248
    Maybe it also has something to do with your computer, i.e., the power of the processor and the amount of RAM.

    I know I upgraded my laptop three months ago to a setup with 8gb of RAM and a Quad-4 processor and I can handle larger feeds more quickly than I could before. I know just enough about some of that stuff to sort of understand what they mean -- and to be dangerous to myself!! LOL!!

    Gary
    Generate more fake news.

  11. #10
    ABW Ambassador
    Join Date
    January 4th, 2006
    Location
    USA
    Posts
    2,477
    My computer is Intel Core i3 with 6gb memory...shoud probably get a more advanced one later...

    I think I will bypass the huge feeds, really isn't worth the time to deal with them. I only plan to use part of the feeds(certain categories) anyway, I don't know why merchants with humongous feeds don't split their feed into categories.

  12. #11
    ABW Ambassador writerguy's Avatar
    Join Date
    January 17th, 2005
    Location
    Springfield, Missouri, USA
    Posts
    3,248
    Quote Originally Posted by mayfly View Post
    ... anyway, I don't know why merchants with humongous feeds don't split their feed into categories.
    I'll add a hearty "amen" to that one! I would love that myself.

    Gary
    Generate more fake news.

  13. #12
    Full Member
    Join Date
    November 21st, 2010
    Posts
    230
    Target's is over 800MB. Even if I could, I'm not sure I want to open it. basically what I did on my PC was to use the command prompt to type it and then immediately control-c it.

    Also when setting it up for first time (it was my first GAN feed), I just used a PHP script on the server to read and echo a few lines instead of trying to contend with the whole thing.

    Fortunately my LAMP server has zero problems with it (after I used setini commands to increase the memory limitations). Haven't tried working with Walmart yet. Forget iTunes.

  14. Thanks From:

  15. #13
    ABW Ambassador isellstuff's Avatar
    Join Date
    November 9th, 2005
    Location
    Virginia
    Posts
    1,659
    Merchants, any data you provide to Google Shopping should also be in your affiliate network datafeed. More data means more sales!

  16. Thanks From:

  17. #14
    Outsourced Program Manager Chris -  AMWSO's Avatar
    Join Date
    January 18th, 2005
    Location
    Bangkok
    Posts
    11,273
    Maybe try our old data cleaner, I never had any issues with file size, might be okay.

    Affiliate Tools, Data Cleaner Application Version 2.82

  18. #15
    ABW Ambassador
    Join Date
    January 4th, 2006
    Location
    USA
    Posts
    2,477
    Quote Originally Posted by Chris - AMWSO View Post
    Maybe try our old data cleaner, I never had any issues with file size, might be okay.

    Affiliate Tools, Data Cleaner Application Version 2.82
    Very nice tool. Thanks for sharing Chris. It won't open large feeds like walmart, but I like the cleaning rules setting.

    Not sure if it just me, It only shows part of the data on the source page. The screen won't move horizontally. It's kind of hard to apply cleaning rules without viewing the entire line of feeds.

  19. #16
    Outsourced Program Manager Chris -  AMWSO's Avatar
    Join Date
    January 18th, 2005
    Location
    Bangkok
    Posts
    11,273
    I'll take a look I didn't have scrolling issues previously, but the last update was some time back

  20. #17
    Member soda's Avatar
    Join Date
    March 26th, 2010
    Location
    Irvine, CA
    Posts
    36
    Use vi in console
    [URL="http://www.itemscope.com/"]Itemscope[/URL]

  21. #18
    ABW Ambassador
    Join Date
    January 18th, 2005
    Location
    United Kingdom
    Posts
    1,797
    I know this is an old thread but I'm surprised no one has mentioned OpenOffice (available for my favourite price of free at OpenOffice.org - The Free and Open Productivity Suite ). That (specifically OpenOffice Calc) seems to be able to handle feeds of any size.

  22. #19
    Newbie
    Join Date
    February 15th, 2012
    Posts
    11
    The V file viewer
    I use a program called the "V" file viewer that can open any file of any size in subsecond time. It smartly works with chunks at a time.
    Last edited by Chuck Hamrick; March 16th, 2012 at 09:56 PM. Reason: removed link

  23. #20
    ...and a Pirate's heart. Convergence's Avatar
    Join Date
    June 24th, 2005
    Posts
    6,918
    Quote Originally Posted by markymark View Post
    I know this is an old thread but I'm surprised no one has mentioned OpenOffice (available for my favourite price of free at OpenOffice.org - The Free and Open Productivity Suite ). That (specifically OpenOffice Calc) seems to be able to handle feeds of any size.
    Believe there's still a row limitation. How do you open feeds with 1MM+ rows?
    Salty kisses, Sandy toes, and a Pirate's heart...

  24. Newsletter Signup

+ Reply to Thread

Similar Threads

  1. Working with large feeds
    By FourthWorld in forum WebMerge (Fourthworld.com)
    Replies: 16
    Last Post: July 3rd, 2010, 01:36 PM
  2. Large site launch - trickle or open wide?
    By superCool in forum Midnight Cafe'
    Replies: 14
    Last Post: June 7th, 2010, 11:58 PM
  3. Open Office And cleaning feeds
    By Cursal in forum Programming / Datafeeds / Tools
    Replies: 10
    Last Post: August 3rd, 2006, 12:10 AM
  4. Open data feeds in spreadsheet?
    By SSanf in forum ShareASale - SAS
    Replies: 1
    Last Post: July 13th, 2003, 11:50 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •