InfiniCloud 2.0: distributing High Performance Computing across continents.

Jakub Chrzeszczyk, Andrew Howard, Andrzej Chrzeszczyk, Ben Swift, Peter Davis, Jonathan Low, Tin Wee Tan, Kenneth Ban

Abstract


InfiniCloud 2.0 is World’s first native InfiniBand High Performance Cloud distributed across four continents, spanning Asia, Australia, Europe and North America. The project provides researchers with instant access to computational, storage and network resources distributed around the globe. These resources are then used to build a geographically distributed, virtual supercomputer, complete with globally-accessible parallel file system and job scheduling.This paper describes high level design and the implementation details of InfiniCloud 2.0. A gene sequencing pipeline as well as plasma physics simulation code are used to demonstrate system’s capabilities.


Full Text:

PDF

References


Marek Michalewicz, David Southwell, Tin Wee Tan, Andrew Howard. InfiniCortex: concurrent supercomputing across the globe utilising trans-continental InfiniBand and Galaxy of Supercomputers. Supercomputing 2014: The International Conference for High Performance Computing, Networking, Storage and Analysis, New Orleans, USA

Gabriel Noaje, Marek Michalewicz. Around The Globe Towards Exascale: InfiniCortex Past and Present.

Kenneth Ban, Tin Wee Tan, Jakub Chrzeszczyk, Andrew Howard, and Dongyang Li. InfiniCloud: Leveraging Global InfiniCortex Fabric and OpenStack Cloud for Borderless High Performance Computing of Genomic Data and Beyond. Supercomputing Frontiers and Innovations 2015, Vol 2, No 3, Singapore.

Jonathan Low, Jakub Chrzeszczyk, Andrew Howard, Andrzej Chrzeszczyk. Performance Assessment of Infiniband HPC Cloud Instances on Intel Haswell and Intel Sandy Bridge Architectures. Supercomputing Frontiers and Innovations 2015, Vol 2, No 3, Singapore.

Marius Hillenbrand, Viktor Mauch, Jan Stoess, Konrad Miller, and Frank Bellosa. Virtual InfiniBand clusters for HPC clouds. In Proceedings of the 2nd International Workshop on Cloud Computing Platforms, page 9. ACM, 2012.

Jerome Vienne, Md Wasi-ur- Rahman, Nusrat Sharmin Islam, Hari Subramoni, D.K. Panda. Performance Analysis and Evaluation of InfiniBand FDR and 40GigE RoCE on HPC and Cloud Computing Systems. Conference: IEEE Hot Interconnects (HOTI-2012).

http://www.openstack.org/

https://github.com/gc3-uzh-ch/elasticluster

http://extempore.moso.com.au/

https://forge.puppet.com/puppetlabs/openstack

http://www.beegfs.com/




Publishing Center of South Ural State University (454080, Lenin prospekt, 76, Chelyabinsk, Russia)