atom feed22 messages in org.freebsd.freebsd-fsyou are in an fs with millions of sma...
FromSent OnAttachments
Randy BushJun 5, 2005 8:36 am 
Arne WörnerJun 5, 2005 8:43 am 
Randy BushJun 5, 2005 8:47 am 
Matt EmmertonJun 5, 2005 11:14 am 
Garance A DrosihnJun 5, 2005 11:16 am 
Scott LongJun 5, 2005 8:59 pm 
Randy BushJun 5, 2005 9:16 pm 
Julian ElischerJun 6, 2005 11:01 pm 
Randy BushJun 6, 2005 11:03 pm 
Eric AndersonJun 7, 2005 12:31 pm 
Robert WatsonJun 7, 2005 4:55 pm 
Dag-Erling SmørgravJun 8, 2005 7:25 am 
Giorgos KeramidasJun 8, 2005 7:46 am 
Dag-Erling SmørgravJun 8, 2005 7:50 am 
Colin PercivalJun 8, 2005 7:52 am 
Giorgos KeramidasJun 8, 2005 8:02 am 
Giorgos KeramidasJun 8, 2005 8:02 am 
Arne WörnerJun 8, 2005 8:13 am 
Arne WörnerJun 8, 2005 9:28 am 
Charles SwigerJun 8, 2005 4:06 pm 
Bakul ShahJun 9, 2005 7:10 pm 
Poul-Henning KampJun 9, 2005 7:15 pm 
Subject:you are in an fs with millions of small files
From:Poul-Henning Kamp (ph@phk.freebsd.dk)
Date:Jun 9, 2005 7:15:37 pm
List:org.freebsd.freebsd-fs

In message <2005@gate.bitblocks.com>, Bakul Shah writes:

Start with a small array. When it gets full double it (or grow by half if you want to waste less memory).

If I might make an observation...

You do not waste malloc'ed memory until you access it. You waste some page table entries etc in the kernel, but the actual pages do not become part of the memory-pressure mob-rule until you touch it the first time.

This is a very important point which people still (after 20 years of virtual memory systems and 10 years of phkmalloc) still do not seem to have fully understood.

I would advice a simple doubling and a terminal realloc to cut down to actual size.

-- Poul-Henning Kamp | UNIX since Zilog Zeus 3.20 ph@FreeBSD.ORG | TCP/IP since RFC 956 FreeBSD committer | BSD since 4.3-tahoe Never attribute to malice what can adequately be explained by incompetence.