atom feed33 messages in org.freebsd.freebsd-currentRe: dev.bce.X.com_no_buffers increasi...
FromSent OnAttachments
Ian FREISLICHMar 5, 2010 3:20 am 
Pyun YongHyeonMar 5, 2010 9:56 am 
Ian FREISLICHMar 5, 2010 10:16 am 
Pyun YongHyeonMar 5, 2010 10:40 am 
Ian FREISLICHMar 5, 2010 12:19 pm 
Pyun YongHyeonMar 5, 2010 1:04 pm 
Ian FREISLICHMar 5, 2010 1:16 pm 
Pyun YongHyeonMar 5, 2010 1:55 pm 
Ian FREISLICHMar 8, 2010 6:44 am 
Pyun YongHyeonMar 8, 2010 9:49 am 
Ian FREISLICHMar 9, 2010 12:26 am 
Ian FREISLICHMar 9, 2010 5:31 am 
Pyun YongHyeonMar 9, 2010 12:49 pm 
Pyun YongHyeonMar 9, 2010 1:21 pm 
David ChristensenMar 9, 2010 1:31 pm 
Pyun YongHyeonMar 9, 2010 1:39 pm 
Ian FREISLICHMar 9, 2010 1:55 pm 
David ChristensenMar 9, 2010 2:04 pm 
Pyun YongHyeonMar 9, 2010 2:12 pm 
Ryan StoneMar 9, 2010 2:30 pm 
Fabien ThomasMar 9, 2010 2:55 pm 
David ChristensenMar 9, 2010 3:00 pm 
Ryan StoneMar 9, 2010 3:07 pm 
Ian FREISLICHMar 9, 2010 9:47 pm 
Ian FREISLICHMar 10, 2010 1:04 am 
David ChristensenMar 10, 2010 11:10 am 
Pyun YongHyeonMar 10, 2010 11:51 am 
David ChristensenMar 10, 2010 2:45 pm 
Pyun YongHyeonMar 10, 2010 3:01 pm 
Ian FREISLICHMar 10, 2010 10:45 pm 
Ian FREISLICHMar 10, 2010 11:05 pm 
David ChristensenMar 12, 2010 3:58 pm 
Ian FREISLICHMar 13, 2010 9:05 am 
Subject:Re: dev.bce.X.com_no_buffers increasing and packet loss
From:Pyun YongHyeon (pyu@gmail.com)
Date:Mar 8, 2010 9:49:26 am
List:org.freebsd.freebsd-current

On Mon, Mar 08, 2010 at 04:45:20PM +0200, Ian FREISLICH wrote:

Pyun YongHyeon wrote:

On Fri, Mar 05, 2010 at 11:16:41PM +0200, Ian FREISLICH wrote:

Pyun YongHyeon wrote:

Thanks for the info. Frankly, I have no idea how to explain the issue given that you have no heavy load.

How many cores would be involved in handling the traffic and runnig PF rules on this machine? There are 4x CPU: Quad-Core AMD Opteron(tm) Processor 8354 (2194.51-MHz K8-class CPU) In this server. I'm also using carp extensively.

pf(4) uses a single lock for processing, number of core would have no much benefit.

What's interesting is the effect on CPU utilisation and interrupt generation that net.inet.ip.fastforwarding has:

net.inet.ip.fastforwarding=1 interrupt rate is around 10000/s per bce interface cpu 8.0% interrupt

Yes, this is one of intentional change of the patch. Stock bce(4) seems to generate too much interrupts on BCM5709 so I rewrote interrupt handling with the help of David. sysctl nodes are also exported to control interrupt moderation so you can change them if you want. Default value was tuned to generate interrupts less than 10k per second and try to minimize latencies.

net.inet.ip.fastforwarding=0 interrupt rate is around 5000/s per bce interface cpu 13.0% interrupt It also appears to not drop packets, but I'll have to watch it for longer.

Hmm, actually that's not what I originally expected. :-) The patch replaced some suspicious memory barrier instructions with bus_dmamap_sync(9) and you may see the effect.

_______________________________________________ free@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to "free@freebsd.org"