Results 1 to 7 of 7
November 21st, 2009, 11:59 PM #1Selecting Products from a Big Datafeed
I'm looking for a little bit of help - I have a merchant who has a HUGE datafeed. It's 200+ MB when unzipped and has xxx,xxx products. I'm looking for a way to get 200 or so products out of that feed.
I have Excel 2003, which limits the number of rows to 60K. just looking at the plain text file kills my computer. Anyone willing to supply the way to do with with PHP and SQL? I can read code but not write it (if that makes any sense).
November 22nd, 2009, 08:15 AM #2
You can use and ODBC driver in excel to do a database query to pull out the records you need. Google for an odbc driver to match the data type you are working with. Also I've had good luck opening huge files with this old text editor: http://www.lancs.ac.uk/staff/steveb/cpaap/pfe/.
November 22nd, 2009, 08:29 AM #3
You probably would be better off downloading the file to your server and doing the work there.
There is a thread on this forum written by mobilebadboy. It is a great thread and very informative. You could just do a quick search for his name.
Let us know what you may need along the way.
November 23rd, 2009, 11:16 AM #4
- Join Date
- November 3rd, 2009
I am not sure opening it is enough, however you can use a lightweight editor like intype or notepad++ to open large files, it should handle it with no problems ( just give it some time to open the file )
if you just need to find 200 products it would be ok to do it manually
November 28th, 2009, 02:37 PM #5
Is notepad++ different than what ships with XP?
I am starting this project now... Thanks for the input so far.
November 28th, 2009, 04:41 PM #6"I know that you believe you understand what you think I said, but I'm not sure you realize that what you heard is not what I meant." - Richard Nixon
November 28th, 2009, 04:50 PM #7
I'd use grep. You can do it from either a Mac Terminal or your web host shell. The command is this:
grep "Category I want" datafeed.txt > filtered_datafeed.txt
- ScottHatred stirs up strife, But love covers all transgressions.
By Jon Nunez in forum AffiliateManager.comReplies: 0Last Post: August 27th, 2013, 10:32 AM
By Stefanie Tu in forum BettyMillsReplies: 0Last Post: July 3rd, 2012, 11:25 AM
By Victor Hanna in forum BettyMillsReplies: 0Last Post: March 13th, 2011, 07:33 PM
By Gingerbread in forum PopShopsReplies: 7Last Post: November 2nd, 2008, 05:40 PM
By webworker in forum Midnight Cafe'Replies: 11Last Post: July 5th, 2006, 12:39 PM