Re: Efficient trimming of NDB??? - Kevin Burton - com.mysql.lists.cluster

3 messages in com.mysql.lists.clusterRe: Efficient trimming of NDB???

From	Sent On	Attachments
Kevin Burton	26 Oct 2006 15:08
Adam Dixon	26 Oct 2006 16:07
Kevin Burton	26 Oct 2006 17:32

Subject:	Re: Efficient trimming of NDB???
From:	Kevin Burton (bur...@tailrank.com)
Date:	10/26/2006 05:32:11 PM
List:	com.mysql.lists.cluster

On 10/26/06, Adam Dixon <adam...@gmail.com> wrote:

Hi Kevin, Could you not just have the one table, insert as you will, and then nightly trim off (DELETE) the rows which are deemed now too old.

Yeah.... I *could* but it's about 1M records per day..... If I'm using disk it could get expensive.... Not sure if it will be much faster because the indexes are in memory.

I do

this with my data, although I have a perl script that manually moves them to another db running MYISAM merge tables for storage and safe keeping. That way it keeps NDB simple, and I get to keep all the data.

The indexes after deleteing so many rows on NDB do get less than perfect, but I still get sub 200ms queries from a 26million row table. Rolling restarts of NDB refresh the indexes (but ive never actually needed to do this, as the system is lightning quick on the index hits)

Ah.... nice.

yeah.... if the deletes are fast enough I'll deal with it....... I did the math and on MyISAM I'd spend 1.5 hours per day JUST doing deletes...

I'm sure NDB would be faster but I guess I'll have to bench it.

Kevin