3 messages in com.mysql.lists.mysqlRe: High-Speed/Volume Database
FromSent OnAttachments
Bob Smith06 May 2002 10:56 
Gabriel06 May 2002 11:11 
mos06 May 2002 11:50 
Subject:Re: High-Speed/Volume Database
From:Gabriel (gabr@dialupusa.net)
Date:05/06/2002 11:11:02 AM
List:com.mysql.lists.mysql

Over here, we're doing an average of 95 queries per second (that's about 8 mill daily), on a Pentium III @ 900MHz with 768MB of ram. We're working with smaller data sets, than 30 million records, tho. I imagine that you could do well with a high end intel system, or a medium-end Sun box.

A dual processor Athlon MP 1900+ system with 4GB of ram, and SCSI raid would probably serve you well.

This would run about $5k at most.

If you want to go with sun, a E450 would probably do the trick for ya. Figure 8GB of ram (more ram is good -- the more of the DB you can hold in memory, the better you'll do.) and 2 or 4 processors.

(Actually, I suspect than an E450 would exceed your needs by a lot.)

That sort of box would cost you about $20k, IIRC.

HTH, Gabriel.

Bob Smith wrote:

We are designing an application that needs to use a relational database to hold quite a large amount of data.

In particular there is one table that has about 33 fields, 18 indexes, and 120 bytes per record. Additionally, we are going to need to add about 2 million records per day to the table, delete about 2 million records per day from the table, hold 2 weeks worth of data within the database (approx. 30 million records), and sustain an average add rate of about 23 records per second while, at the same time, sustaining an average delete rate of 23 records per second.

My questions are, what database software should we use, what kind of hardware platform will be needed to support the specifications enumerated above, and what kind of average query performance can we expect?