TY - JOUR AU - Noaje, Gabriel AU - Davis, Alan AU - Low, Jonathan AU - Lim, Seng AU - Tan, Geok Lian AU - Orłowski, Łukasz AU - Chien, Dominic AU - Liou, Sing-Wu AU - Tan, Tin Wee AU - Poppe, Yves AU - Ban Hon Kim, Kenneth AU - Howard, Andrew AU - Southwell, David AU - Gunthorpe, Jason AU - Michalewicz, Marek PY - 2017/05/12 Y2 - 2024/03/29 TI - InfiniCortex - From Proof-of-concept to Production JF - Supercomputing Frontiers and Innovations JA - superfri VL - 4 IS - 2 SE - Articles DO - 10.14529/jsfi170207 UR - https://superfri.org/index.php/superfri/article/view/139 SP - 87-102 AB - <div class="page" title="Page 1"><div class="layoutArea"><div class="column"><p><span style="font-size: 9.000000pt; font-family: 'SFRM0900';">The global effort to build ever more powerful supercomputers is faced with the challenge of ramping up High Performance Computing systems to ExaScale capabilities and, at the same time, keeping the electrical power consumption for a system of that scale at less than 20 MW level. One possible solution, bypassing this local energy limit, is to use distributed supercomputers to alleviate intense power requirements at any single location. The other critical challenge faced by the global computer industry and international scientific collaborations is the requirement of streaming colossal amounts of time-critical data. Examples abound: i) transfer of astrophysical data collected by the Square Kilometre Array to the international partners, ii) streaming of large facilities experimental data through the Pacific Research Platform collaboration of DoE, ESnet and other partners in the US and elsewhere, iii) the Superficilities vision expressed by DoE, iv) new architecture for CERN LHC data processing pipeline focussing on more powerful processing facilities connected by higher throughput connectivity. </span></p><p><span style="font-size: 9.000000pt; font-family: 'SFRM0900';">The InfiniCortex project led by A*STAR Computational Resource Centre demonstrates a worldwide InfiniBand fabric circumnavigating the globe and bringing together, as one concurrent globally distributer HPC system, several supercomputing facilities spanned across four continents (Asia, Australia, Europe and North America). Using global scale InfiniBand connections, with bandwidth utilisation approaching 98% link capacity, we have established a new architectural approach which might lead to the next generation supercomputing systems capable of solving the most complex problems through the aggregation and parallelisation of many globally distributed supercomputers into a single hive-mind of enormous scale. </span></p></div></div></div> ER -