Results 1 to 5 of 5
  1. #1
    Full Member
    Join Date
    January 18th, 2005
    Posts
    362
    for a mall type site is it better to use multiple databases for each datafeed/merchant or to try to incorporate all of them into one database?

    speed/efficiency/ease of use/server load/etc all in consideration here.

  2. #2
    ABW Ambassador
    Join Date
    January 18th, 2005
    Posts
    1,663
    I'm having good results in using a large number of (relatively) small Access databases on a single site. The main shopping site is about maxed out with about 200 megs of DB files. The ASP pages load quickly and I haven't seen a database call timeout yet. Putting some newer ones on some other sites now until I decide on the best plans for the future.

    When I started this site, I created a single db with a table for each merchant I used then. The ASP pages created by the various tables loaded fast enough but maintenance was a problem as the file took almost a half hour to upload over cable. All new merchant feeds since were uploaded as separate databases, though this does bloat the overall bytes. I've stripped out most of the original tables into stand-alone files.

    I don't yet know the best route to take. I may be rolling all this into a new SQL server sometime in the future but for now, multiple Access files seems to work just fine.

    My biggest database problem has been not with merchant feeds but with the huge amount of data I store for my book review site, with review and interview links for more than 30,000 titles. When traffic started to hit about 1000/day my inexperience started to shine through and file calls would timeout or the whole show would crash. The lesson learned was to tighten up the code, make the SQL statements efficient, and close all the damn connections when through.

    Wayne

  3. #3
    ABW Ambassador
    Join Date
    January 18th, 2005
    Posts
    4,423
    Raw data feeds loaded in separately, conversion programs converting them into one format.

    Chet

  4. #4
    Affiliate Manager Allen Nance's Avatar
    Join Date
    January 18th, 2005
    Location
    Colorado River, Bullhead City AZ
    Posts
    1,604
    <BLOCKQUOTE class="ip-ubbcode-quote"><font size="-1">quote:</font><HR>Originally posted by Chez Noir:
    Raw data feeds loaded in separately, conversion programs converting them into one format.

    Chet<HR></BLOCKQUOTE>

    Chet,

    What do you suggest for a good conversion program?

    Allen

  5. #5
    ABW Ambassador
    Join Date
    January 18th, 2005
    Posts
    4,423
    I write my own for each new merchant.

    I only pull the products I want for each site, convert categories to standardize them etc. For a new merchant, it takes me about 30 minutes to make the changes to scripts used for other merchants.

    Chet

  6. Newsletter Signup

+ Reply to Thread

Similar Threads

  1. Want to start your own quick chat?
    By Rhia7 in forum Midnight Cafe'
    Replies: 4
    Last Post: February 24th, 2013, 01:55 PM
  2. New to Data feeds! Where Do I start?
    By mandala in forum ShareASale - SAS
    Replies: 2
    Last Post: November 29th, 2009, 11:49 AM
  3. best choice for quick review site start up?
    By acid2004 in forum Midnight Cafe'
    Replies: 1
    Last Post: March 28th, 2009, 01:04 PM
  4. [SAS] Flora2000.com - $50 Quick Start Bonus
    By Jon Nunez in forum AffiliateManager.com
    Replies: 3
    Last Post: March 14th, 2008, 07:31 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •