Archive 1997–2024

10G Ethernet: More Than a Big Pipe

The Real Deal: Consolidated I/O

In the next scenario, we did a lot more thinking before configuring. We reconfigured our VMs as follows:

  • The iSCSI VM runs IOmeter as fast as it can
  • Two VMs are limited and guaranteed that they would get 2 Gbit/s all the time
  • One VM is tested with IxChariot and is allowed to absorb as much bandwidth as possible

It would make more sense to give the iSCSI a certain limited but guaranteed amount of bandwidth. That would avoid the non-restricted “network VM” choking the iSCSI VM. But as IxChariot allows us to plot the graphs over time and we want to create a contention situation, we decided to only limit the IxChariot VMs.

The Solarflare and Intel NICs used the VMware ESX 4.0 ingress and egress traffic shaping, while the Neterion chip uses the hardware QoS and "Multi Function" capabilities.

iSCSI & Network traffic, QoS

The Solarflare and Intel chip have done a better job from the throughput point of view, but it is only part of the story. The whole idea of Quality of Service and traffic shaping is to guarantee a certain level of performance. So we should also focus on how well the NIC made sure that the 2 QoS VMs got the guaranteed level of 2 Gbit/s.

Originally published at https://www.anandtech.com/show/4014/10g-more-than-a-big-pipe (Wayback Machine).