Thank you for the reply, I do know that some merchants like Buy.com provided 10+ feeds for each one of the categories that they carry, this make sense. But my issue is merchants like A1Books provide 4 feeds they are all close in size and have about the same number of items. From what I can tell is that they are identical feeds, my concern is that if I process them all as one merchant I’m going to have a DB that is 4 times larger then it should be since I have duplicate items, now multiply that by 20-30 merchants that do that and you DB is so much larger then it should be and then you start loosing performance and run in to other issue like DB maintenance.
But anyways, thanks for the feedback, its about the same as I got from
CJ themselves