Results 1 to 7 of 7
  1. #1
    Affiliate Manager ProHealth's Avatar
    Join Date
    January 18th, 2005
    Location
    Santa Barbara!!
    Posts
    74
    Question Selecting Products from a Big Datafeed
    I'm looking for a little bit of help - I have a merchant who has a HUGE datafeed. It's 200+ MB when unzipped and has xxx,xxx products. I'm looking for a way to get 200 or so products out of that feed.

    I have Excel 2003, which limits the number of rows to 60K. just looking at the plain text file kills my computer. Anyone willing to supply the way to do with with PHP and SQL? I can read code but not write it (if that makes any sense).

    Many thanks.

  2. #2
    Full Member iolaire's Avatar
    Join Date
    October 3rd, 2006
    Location
    Arlington, VA
    Posts
    229
    You can use and ODBC driver in excel to do a database query to pull out the records you need. Google for an odbc driver to match the data type you are working with. Also I've had good luck opening huge files with this old text editor: http://www.lancs.ac.uk/staff/steveb/cpaap/pfe/.

  3. #3
    ABW Ambassador bettylou's Avatar
    Join Date
    December 27th, 2005
    Location
    Indiana
    Posts
    595
    You probably would be better off downloading the file to your server and doing the work there.

    There is a thread on this forum written by mobilebadboy. It is a great thread and very informative. You could just do a quick search for his name.

    Let us know what you may need along the way.

  4. #4
    Member
    Join Date
    November 3rd, 2009
    Posts
    50
    I am not sure opening it is enough, however you can use a lightweight editor like intype or notepad++ to open large files, it should handle it with no problems ( just give it some time to open the file )

    if you just need to find 200 products it would be ok to do it manually

  5. #5
    Affiliate Manager ProHealth's Avatar
    Join Date
    January 18th, 2005
    Location
    Santa Barbara!!
    Posts
    74
    Is notepad++ different than what ships with XP?

    I am starting this project now... Thanks for the input so far.

  6. #6
    The Seal of Aproval rematt's Avatar
    Join Date
    November 19th, 2006
    Location
    The Windy City
    Posts
    4,140
    Notepad++

    -rematt
    "I know that you believe you understand what you think I said, but I'm not sure you realize that what you heard is not what I meant." - Richard Nixon

  7. #7
    ABW Ambassador Snib's Avatar
    Join Date
    January 18th, 2005
    Location
    Virginia
    Posts
    5,303
    I'd use grep. You can do it from either a Mac Terminal or your web host shell. The command is this:

    grep "Category I want" datafeed.txt > filtered_datafeed.txt

    - Scott
    Hatred stirs up strife, But love covers all transgressions.

  8. Newsletter Signup

+ Reply to Thread

Similar Threads

  1. BudoVideos.com: Save Big of Martial Arts Products
    By Jon Nunez in forum AffiliateManager.com
    Replies: 0
    Last Post: August 27th, 2013, 11:32 AM
  2. Save Big on American Made Products
    By Stefanie Tu in forum BettyMills
    Replies: 0
    Last Post: July 3rd, 2012, 12:25 PM
  3. RubberMaid Products=Big Earnings.
    By Victor Hanna in forum BettyMills
    Replies: 0
    Last Post: March 13th, 2011, 08:33 PM
  4. Selecting items from a datafeed in PopShops?
    By Gingerbread in forum PopShops
    Replies: 7
    Last Post: November 2nd, 2008, 06:40 PM
  5. How big is a datafeed?
    By webworker in forum Midnight Cafe'
    Replies: 11
    Last Post: July 5th, 2006, 01:39 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •