Towards Terabit/s Systems: Performance Evaluation of Multi-Rail Systems

Venkatram Vishwanath, Takashi Shimizu, Makoto Takizawa, Kazuaki Obana, Jason Leigh
2007 2007 High-Speed Networks Workshop  
Project Goals: Investigate end-system issues and design novel middleware for applications to scale to Terabit/s We present a novel multi-rail approach that is necessary for future E-Science applications to effectively exploit Terabit/s networks. This multi-rail approach consists of creating parallel "rails" through every aspect of an end-system: from processing on the multiple and many cores, generation of multiple application data flows, and streaming over multiple-lanes, multi-wavelength NICs
more » ... connected via a parallel interconnect. We present the evaluation of end-systems parameters that impact the efficiency of multi-rail systems such as interrupt, memory, thread, and core affinities. These evaluations were tested on the ability of individual cluster nodes to achieve TCP and UDP throughput at 10Gbps and 20Gbps rates. We analyze the additive effects of the parameters -a key property for achieving scalable performance towards Terabits/s. Thread and Interrupt affinity together was found to have an additive effect and plays a critical role in achieving maximum throughput.
doi:10.1109/hsnw.2007.4290545 fatcat:yjilbi5b3fgp3iyh6yqahm6voe