I/O using multiple NICs about fastclick HOT 5 CLOSED

Hi,
I'm not familiar with moongen, could you give me the configuration to simply send and receive packets using 2 ports? And the one to forward using 2 ports?

What I saw with my x540 dual ports NIC is that packets cannot be received at line rate, 31 out of 40 is more or less what I found out, yes. Both with Netmap and DPDK. TX at 40G is not a problem though. What you're saying is that MoonGen can forward packets at 40G, with one or two cores per NIC?

If you use only one port per dual-port, you can achieve line rate. So I guessed the problem is with the dual port NICs and therefore concluded that was the limitation of the NICs as any tools, including DPDK's and Netmap's one couldn't achive more than ~33G of forwarding.
So your results surprise me. In your FastClick configuration with batching, the virtual call should not be the problem. I'd guess there could be a difference of DPDK configuration : offloadings activated in the NIC, cache, packet pool size, ... I'll check that with your MoonGen configure files and compare. I may have miss to activate/deactivate some fancy feature of the NIC allowing to RX at that rate. I don't support GRO in FastClick, if the packets are aggregated at RX, it could explain the difference.

By default the FromDPDKDevice elements will share all available threads (so here, 4 per FromDPDKDevice for 2 elements) and they will use one queue per thread automatically. I guess it craches because you have more queue than core and I didn't protect something. I suggest letting FromDPDKDevice handle the good number of queue, and just change the amount of threads. In that configuration one core per NIC should be enough, 2 at max. Having more queue will just slow down things. The amount of core is not the problem here.

Tom

from fastclick.

Hi,

I do not forwards traffic with MoonGen. Machine 01 above has 4 NICs and I start one Tx and one Rx thread per NIC (in two different cores) so each NIC is sending packets to Click and getting packets back from Click.
All 4 NICs operate at the same time, on the same CPU socket and they can Tx/Rx at line rate.
In Click, when 2 NICs kick in at the same time, throughput decreases from 14.88 to 11.7 Mpps.

I can send you my MoonGen script offline :)

Georgios

from fastclick.

You achieved 40G with some configuration or not? I'm not sure to understand.

from fastclick.

Any news on this? Can I close?

from fastclick.

You can close it for now. It has been quite some time since I did these experiments so I need to repeat them in order to confirm. My findings when using FastClick from my experiments match completely with the reported throughput in your paper though.

from fastclick.