atom feed33 messages in org.freebsd.freebsd-currentRe: dev.bce.X.com_no_buffers increasi...
FromSent OnAttachments
Ian FREISLICHMar 5, 2010 3:20 am 
Pyun YongHyeonMar 5, 2010 9:56 am 
Ian FREISLICHMar 5, 2010 10:16 am 
Pyun YongHyeonMar 5, 2010 10:40 am 
Ian FREISLICHMar 5, 2010 12:19 pm 
Pyun YongHyeonMar 5, 2010 1:04 pm 
Ian FREISLICHMar 5, 2010 1:16 pm 
Pyun YongHyeonMar 5, 2010 1:55 pm 
Ian FREISLICHMar 8, 2010 6:44 am 
Pyun YongHyeonMar 8, 2010 9:49 am 
Ian FREISLICHMar 9, 2010 12:26 am 
Ian FREISLICHMar 9, 2010 5:31 am 
Pyun YongHyeonMar 9, 2010 12:49 pm 
Pyun YongHyeonMar 9, 2010 1:21 pm 
David ChristensenMar 9, 2010 1:31 pm 
Pyun YongHyeonMar 9, 2010 1:39 pm 
Ian FREISLICHMar 9, 2010 1:55 pm 
David ChristensenMar 9, 2010 2:04 pm 
Pyun YongHyeonMar 9, 2010 2:12 pm 
Ryan StoneMar 9, 2010 2:30 pm 
Fabien ThomasMar 9, 2010 2:55 pm 
David ChristensenMar 9, 2010 3:00 pm 
Ryan StoneMar 9, 2010 3:07 pm 
Ian FREISLICHMar 9, 2010 9:47 pm 
Ian FREISLICHMar 10, 2010 1:04 am 
David ChristensenMar 10, 2010 11:10 am 
Pyun YongHyeonMar 10, 2010 11:51 am 
David ChristensenMar 10, 2010 2:45 pm 
Pyun YongHyeonMar 10, 2010 3:01 pm 
Ian FREISLICHMar 10, 2010 10:45 pm 
Ian FREISLICHMar 10, 2010 11:05 pm 
David ChristensenMar 12, 2010 3:58 pm 
Ian FREISLICHMar 13, 2010 9:05 am 
Subject:Re: dev.bce.X.com_no_buffers increasing and packet loss
From:Pyun YongHyeon (pyu@gmail.com)
Date:Mar 5, 2010 9:56:16 am
List:org.freebsd.freebsd-current

On Fri, Mar 05, 2010 at 01:20:57PM +0200, Ian FREISLICH wrote:

Hi

I have a system that is experiencing mild to severe packet loss. The interfaces are configured as follows:

lagg0: bce0, bce1, bce2, bce3 lagproto lacp

lagg0 then is used as the hwdev for the vlan interfaces.

I have pf with a few queues for bandwidth management.

There isn't that much traffic on it (200-500Mbit/s).

I see only the following suspect for packet loss:

dev.bce.0.com_no_buffers: 140151466 dev.bce.1.com_no_buffers: 514723247 dev.bce.2.com_no_buffers: 10454050 dev.bce.3.com_no_buffers: 369371

Most of the time, these numbers are static, but every once in a while they increase massively by several thousand, but only on 2 interfaces. The 1 minute average rate on those interfaces is 266/s and 123/s.

Does anyone think this is related to the packet loss or are these counters just a red herring? Is there anything that can be done to reduce this count?

I think this sysctl node indicates number of dropped frames in completion processor of NetXtreme II. The counter is incremented when the processor received a frame successfully but it couldn't pass the frame to system as there are no available RX buffers so completion processor dopped the received frame. If you see mbuf shortage from netstat that would be normal. But if system has a lot of free mbuf resources it may indicate other issue. bce(4) may not be able to replenish controller with RX buffer if system is suffering from high load.