Results 1 to 9 of 9
April 29th, 2006, 08:03 AM #1My First CJ Datafeed Blows Up My Computer
I don't know what I am doing wrong but I get the dreaded blue screen when I try to unzip the CJ datafeed I just received for the first time. I tried opening it on Excel, but ran out of room. I don't know what I'm doing (obviously)...although I've read and read and read. Is there something I can buy that will do all this for me?
April 29th, 2006, 09:44 AM #2
how close to full is your hard drive? How much ram do you have?
April 29th, 2006, 10:54 AM #3
I ran WebMerge on the Betty Mills datafeed (latest=58Kpages) and it is almost impossible to move around in the directory the pages are in, now. Celeron 850(?), lots of free space on drive, 800+ megs RAM.
I'm hinting to my kids that maybe I've reached a limit and it is time for them to pass down something faster.
perhaps the main question is: how large is the datafeed itself?
April 29th, 2006, 11:41 AM #4Originally Posted by leeann
The CJ collection of feeds comes as one monstrous file, and you mentioned that you 'tried to unzip' that file, did that work? You need something like WinZip or WINrar (which I prefer) to do so.
Once unzipped you get a collection of separate feeds in .txt format. If the feed is very big, and you try to simply open it with MS Excel it may not work as Excel has difficulties to open .txt files directly. A better way would be to start Excel, hit the 'Data' tab on the top bar, then 'Import external Data', then 'Import Data'. In the dialog box that opens look for your .txt file and click "Open" - you get to the import wizard.
CJ feeds are tab delimited, so the default settings in the import wizard are ok, just click 'Next', 'Next', 'Finish' and you should have succeeded in importing your feed.
This was the easy part, now comes the cleaning of your feed from unwanted characters like HTML etc. This is the real pain in the a$$...
As a side note, SAS feeds are pipe delimited (pipe is this: |), so you need to change the default delimiter in the second scree of the wizard.
Hope this helped a bit,
Cheers, Frank[URL=http://www.golfbeginnerguide.com/]Golf Beginner Guide[/URL] ; [URL=http://www.ladygolfersguide.com/]Lady Golfers Guide[/URL]
April 29th, 2006, 12:57 PM #5
"My First CJ Datafeed Blows Up My Computer"
Yeah, I've thought about that one in advance.
Makes me a little timid to stick my big toe into the water~Rhia7 -- Remember the 7
April 29th, 2006, 01:36 PM #6
- Join Date
- January 18th, 2005
Frank, they usually don't give you ALL the feeds when you first start out. So the question remains, which feed(s) did you get, did you unzip the file and open the individual feeds in excel? There are a few feeds at CJ that won't fit in excel, but they don't usually bring up the blue screen of death, they only load the first 65,000 (whatever the exact number is) rows and ditch the rest....
If you can't unzip it, then you have issues with space or processing power, I unzip the full feed fineDeborah Carney
TeamLoxly.com BookGoodies.com ABCsPlus.com
April 29th, 2006, 07:45 PM #7
I received five feeds at one time. I think like 90,000+ rows so excel couldn't load it all. I'm not sure I can split this. Maybe I need to tell CJ to send it differently? I think I said to send it all in one file.I realllllllllllly appreciate all of your feedback. I was trying to open it with winzip which did okay, but when I tried to import the text file in excel the blue screen showed up. Thanks!
April 29th, 2006, 08:37 PM #8
- Join Date
- January 18th, 2005
If you are going to work with datafeeds you will need lots of RAM, 1 gb at least. I would lose W98 (I assume this is the 'blue screen') and get XP. It is much more stable than 98 was.
I think Excel cuts the feed off around 75000. You can import it in to Access and segment it and export the parts or you can set it up in php and load it in a database. That is the best way.
PM me if you want to discuss a turnkey solution for your datafeed.
April 29th, 2006, 09:00 PM #9
For opening/working with feeds, mySQL rules all...you could probably put millions of records in there without a hiccup. Just install it locally (on your PC) and manipulate the data through that.
And, more RAM is indeed the "wonder drug" for computers. I've run feeds at various amounts of RAM, and in my experience, 1/2 GB will run 'em without driving you mad with waiting time and/or crashes, provided you don't have anything else running. But, different systems may have different results. And if you want to run a few RAM-using things at once, best to go for extra.
I have a full GB, but games seem to appreciate it a lot more than MySQL does.There is no knowledge that is not power. ~Hemingway
By Naffiliate in forum Midnight Cafe'Replies: 3Last Post: June 8th, 2005, 08:55 AM
By joeytomatoes in forum Midnight Cafe'Replies: 11Last Post: June 13th, 2004, 05:37 AM
By greentea in forum Programming / Datafeeds / ToolsReplies: 4Last Post: May 18th, 2004, 07:21 AM
By Snib in forum Midnight Cafe'Replies: 0Last Post: April 14th, 2004, 02:41 PM
By GDogX in forum Programming / Datafeeds / ToolsReplies: 1Last Post: January 21st, 2004, 08:54 PM