Infiniband Latency – Two-Socket Servers

Configuration Information:

2 x AMD Opteron™ processors Model 6276 in Supermicro H8DGT server, 64GB (8 x 8GB DDR3-1600) memory, SuSE Linux® Enterprise Server 11 SP1 64-bit, GCC 4.6.0 Compiler, OMPI 1.5.3
Argument: -mca mpi_leave_pinned_alone 1

2 x AMD Opteron™ processors Model 6380 in Supermicro H8DGT server, 64GB (8 x 8GB DDR3-1600) memory, SuSE Linux® Enterprise Server 11 SP2 64-bit, x86 Open64 4.5.2 Compiler, OMPI 1.6.0
Argument: -mca btl_sm_use_knem 1 -mca mpi_leave_pinned 1

2 x Intel Xeon processors Model E5-2690 in Supermicro X9DRT-HIBFF server, 64GB (8 x 8GB DDR3-1600) memory, SuSE Linux® Enterprise Server 11 SP2 64-bit, Intel Professional Compiler v12.1.3, OMPI 1.6.0
Argument: -mca btl_sm_use_knem 1 -mca mpi_leave_pinned 1

Footnotes