TY - JOUR AU - Low, Jonathan AU - Chrzeszczyk, Jakub AU - Howard, Andrew AU - Chrzeszczyk, Andrzej PY - 2015/11/02 Y2 - 2024/03/28 TI - Performance Assessment of InfiniBand HPC Cloud Instances on Intel Haswell and Intel Sandy Bridge Architectures JF - Supercomputing Frontiers and Innovations JA - superfri VL - 2 IS - 3 SE - Articles DO - 10.14529/jsfi150303 UR - https://superfri.org/index.php/superfri/article/view/74 SP - 28-40 AB - <p>This paper aims to establish a performance baseline of a HPC installation of OpenStack. We created InfiniCloud - a distributed High Performance Cloud hosted on remote nodes of InfiniCortex. InfiniCloud compute nodes use high performance Intel (R) Haswell and Sandy Bridge CPUs, SSD storage and 64-256GB RAM. All computational resources are connected by high performance IB interconnects and are capable of trans-continental IB communication using Obsidian Longbow range extenders.</p><p><br />We benchmark the performance of our test-beds using micro-benchmarks for TCP bandwidth, IB bandwidth and latency, file creation performance, MPI collectives and Linpack. This paper compares different CPU generations across virtual and bare-metal environments.</p><p><br />The results show modest improvements in TCP and IB bandwidth and latency on Haswell; performance being largely dependent on the IB hardware. Virtual overheads were minimal and near-native performance is possible for sufficiently large messages. From the Linpack testing, users can expect more than twice the performance in their applications on Haswell-provisioned VMs. On Haswell hardware, native and virtual performance differences is still significant for MPI collective operations. Finally, our parallel filesystem testing revealed virtual performance coming close to native only for non-sync/fsync file operations.</p> ER -