atom feed10 messages in net.launchpad.lists.openstackRe: [Openstack] Performance metrics
FromSent OnAttachments
Neelakantam GaddamJun 20, 2012 5:56 am 
Dan WendlandtJun 20, 2012 6:25 am 
Sandy WalshJun 20, 2012 6:54 am 
Rick JonesJun 20, 2012 9:36 am 
Huang ZhitengJun 20, 2012 8:09 pm 
Rick JonesJun 21, 2012 9:16 am 
Narayan DesaiJun 21, 2012 12:41 pm 
Rick JonesJun 21, 2012 2:21 pm 
Narayan DesaiJun 21, 2012 7:06 pm 
Rick JonesJun 29, 2012 2:35 pm 
Subject:Re: [Openstack] Performance metrics
From:Narayan Desai (
Date:Jun 21, 2012 12:41:10 pm

On Thu, Jun 21, 2012 at 11:16 AM, Rick Jones <> wrote:

On 06/20/2012 08:09 PM, Huang Zhiteng wrote:

By 'network scaling', do you mean the aggregated throughput (bandwidth, packets/sec) of the entire cloud (or part of it)? I think picking up 'netperf' as micro benchmark is just 1st step, there's more work needs to be done.

Indeed. A great deal more.

For OpenStack network, there's 'inter-cloud' and 'cloud-to-external-world' throughput.  If we care about the performance for end user, then reason numbers (for network scaling) should be captured inside VM instances.  For example, spawn 1,000 VM instances across cloud, then pair them to do 'netperf' tests in order to measure 'inter-cloud' network throughput.

That would certainly be an interesting test yes.

We did a bunch of similar tests to determine the overhead caused by kvm and limitations of the nova network architecture. We found that VMs themselves were able to consistently saturate the network link available to the host system, whether it was 1GE or 10GE, with relatively modern node and network hardware. With the default VLANManager network setup, there isn't much you can do to scale your outbound connectivity beyond the hardware you can reasonably drive with a single node, but using multi-host nova-network, we were able to run a bunch of nodes in parallel, scaling up our outbound bandwidth linearly. We managed to get 10 nodes, with a single VM per node, each running 4 TCP streams, up to 99 gigabits on a dedicated cross country link. There was a bunch of tuning that we needed to do, but it wasn't anything particularly outlandish compared with the tuning needed for doing this with bare metal. We've been meaning to do a full writeup, but haven't had time yet. -nld