4 messages in net.sourceforge.lists.courier-maildrop[maildropl] HACK proposal - IMAP speedup
FromSent OnAttachments
Ross BeckerSep 8, 2004 3:38 pm 
Tom MetroSep 8, 2004 4:23 pm 
Ross BeckerSep 8, 2004 4:27 pm 
Sam VarshavchikSep 8, 2004 5:00 pm 
Actions with this message:
Paste this link in email or IM:
Paste this link in email or IM:
Atom feed for this thread
Paste this URL into your reader:
Subject:[maildropl] HACK proposal - IMAP speedupActions...
From:Ross Becker (ro@rbecker.org)
Date:Sep 8, 2004 3:38:00 pm
List:net.sourceforge.lists.courier-maildrop

I'm planning on throwing this together soon, but I wanted to do a sanity check with folks before doing so. Currently, the performance of free IMAP servers at certain operations is very bad for large folders. The primary reason is that maildir (and maildir++) has no indexing at all. This means that to sort a folder, you have to open every message, read the headers, locate the one(s) you need, and transform them into sortable format. Once you've read every message, then you can sort. This leads to woeful performance. On a Pentium 4 with 800mhz memory bus, I clocked Courier-IMAP taking ~14 seconds to sort a 12.5k message folder by date.

I'm looking at hacking maildrop and Courier-IMAP to maintain fixed-length record list files containing the message headers needed to support standard SEARCH, SORT, and THREAD operations. At a wild guess, this should provide an order of magnitude speed improvement.

Clearly, for a webmail system, you want the server to be able to sort the messages fast, because all sorts happen on the imap server. If anyone else here is interested in this hack, has thoughts, or feedback- I'm all ears.

Cheers Ross