Energy Measurement Tools for Ultrascale Computing: A Survey
DOI:
https://doi.org/10.14529/jsfi150204Abstract
With energy efficiency one of the main challenges on the way towards ultrascale systems, there is great need for access to high-quality energy consumption data. Such data would enable researchers and designers to pinpoint energy inefficiencies at all levels of the computing stack, from whole nodes down to critical regions of code. However, measurement capabilities are often missing, and significantly differ between platforms where they exist. A standard is yet to be established. To that end, this paper attempts an extensive survey of energy measurement tools currently available at both the hardware and software level, comparing their features with respect to energy monitoring.References
Advanced Micro Devices. AMD BIOS and Kernel Developer’s Guide (BKDG) for AMD Family 15h Models 00h-0Fh Processors, January 2013.
Pedro Alonso, Rosa M Badia, Jesus Labarta, Maria Barreda, Manuel F Dolz, Rafael Mayo, Enrique S Quintana-Orti, and Ruymán Reyes. Tools for power-energy modelling and analysis of parallel scientific applications. In Parallel Processing (ICPP), 2012 41st International Conference on, pages 420–429. IEEE, 2012. DOI: 10.1109/icpp.2012.57.
ARM Limited. ARM Energy Probe. http://ds.arm.com/ds-_5/optimize/arm-_energy-_probe/.
D. Bedard, Min Yeol Lim, R. Fowler, and A. Porterfield. Powermon: Fine-grained and integrated power monitoring for commodity computer systems. In IEEE SoutheastCon 2010 (SoutheastCon), Proceedings of the, pages 479–484, March 2010. DOI: 10.1109/secon.2010.5453824.
Daniel Bedard, R Fowler, M Linn, and Allan Porterfield. Powermon 2: Fine-grained, integrated power measurement. Renaissance Computing Institute, Tech. Rep. TR-09-04, 2009.
Shajulin Benedict. Energy-aware performance analysis methodologies for HPC architectures—an exploratory study. Journal of Network and Computer Applications, 35(6):1709 – 1719, 2012.
Shajulin Benedict, Ventsislav Petkov, and Michael Gerndt. Periscope: An online-based distributed performance analysis tool. In Tools for High Performance Computing 2009, pages 1–16. Springer, 2010. DOI: 10.1007/978-3-642-11261-4_1.
S. Browne, J. Dongarra, N. Garner, G. Ho, and P. Mucci. A portable programming interface for performance evaluation on modern processors. Int. J. High Perform. Comput. Appl., 14(3):189–204, August 2000.
Martin Burtscher, Ivan Zecena, and Ziliang Zong. Measuring GPU power with the K20 built-in sensor. In Proceedings of Workshop on General Purpose Processing Using GPUs, GPGPU-7, pages 28:28–28:36, New York, NY, USA, 2014. ACM. DOI: 10.1145/2576779.2576783.
APC by Schneider Elecric. Metered-by-outlet rack pdus, March 2013.
Alberto Cabrera, Francisco Almeida, Javier Arteaga, and Vicente Blanco. Measuring energy consumption using EML (Energy Measurement Library). Computer Science-Research and Development, pages 1–9, 2014.
Alberto Cabrera, Francisco Almeida, and Vicente Blanco. Eml, an energy measurement library. 31st International Symposium on Computer Performance, Modeling, Measurements and Evaluation 2013: Student Poster Abstracts, 2013.
Jason Flinn and Mahadev Satyanarayanan. Powerscope: A tool for profiling the energy usage of mobile applications. In WMCSA, pages 2–10. IEEE Computer Society, 1999. DOI: 10.1109/mcsa.1999.749272.
Rong Ge, Xizhou Feng, Shuaiwen Song, Hung-Ching Chang, Dong Li, and K.W. Cameron. Powerpack: Energy profiling and analysis of high-performance systems and applications. Parallel and Distributed Systems, IEEE Transactions on, 21(5):658–671, May 2010. DOI: 10.1109/TPDS.2009.76.
Markus Geimer, Felix Wolf, Brian JN Wylie, Erika Ábrahám, Daniel Becker, and Bernd Mohr. The scalasca performance toolset architecture. Concurrency and Computation: Practice and Experience, 22(6):702–719, 2010. DOI: 10.1002/cpe.1556.
D. Hackenberg, T. Ilsche, R. Schone, D. Molka, M. Schmidt, and W.E. Nagel. Power measurement techniques on standard compute nodes: A quantitative comparison. In Performance Analysis of Systems and Software (ISPASS), 2013 IEEE International Symposium on, pages 194–204, April 2013. DOI: 10.1109/ISPASS.2013.6557170.
Daniel Hackenberg, Thomas Ilsche, Joseph Schuchart, Robert chöne, Wolfgang E. Nagel, Marc Simon, and iannis Georgiou. Hdeem: High definition energy efficiency monitoring. In Proceedings of the 2Nd International Workshop on Energy Efficient upercomputing, E2SC ’14, pages 1–10, Piscataway, NJ, USA, 2014. IEEE Press.
Nicole Hemsoth. Are Supercomputing’s Elite Turning Backs on Accelerators? http://www.hpcwire.com/2014/06/26/accelerators-_hold/, June 2014.
Chung-Hsing Hsu and S.W. Poole. Power measurement for high performance computing: State of the art. In Green Computing Conference and Workshops (IGCC), 2011 International, pages 1–6, July 2011. DOI: 10.1109/IGCC.2011.6008596.
Intel Corporation. Data Center Manageability Interface Specification, August 2011.
Intel Corporation. Intelligent Platform Management Interface Spec, October 2013.
Intel Corporation. Determining the Idle Power of an Intel®; Xeon PhiTM Coprocessor. https://software.intel.com/en-_us/articles/determining-_the-_idle-_power-_of-_an-_intel-_xeon-_phi-_coprocessor, June 2014.
Intel Corporation. Intel®; Xeon PhiTM Coprocessor Datasheet. http://www.intel.com/content/www/us/en/processors/xeon/xeon-_phi-_coprocessor-_datasheet.html, April 2014.
Intel Corporation. Intel®; 64 and IA-32 Architectures Software Developer’s Manual. Number 253669-053US. January 2015.
Kiran Kasichayanula, Dan Terpstra, Piotr Luszczek, Stan Tomov, Shirley Moore, and Gregory D Peterson. Power aware computing on gpus. In Application Accelerators in High Performance Computing (SAAHPC), 2012 Symposium on, pages 64–73. IEEE, 2012. DOI: 10.1109/saahpc.2012.26.
kernel.org. Perf Wiki. Rlhttps://perf.wiki.kernel.org/index.php?title=Main_Page&oldid=3491, 2014.
Andreas Knüpfer, Christian Rössel, Dieter an Mey, Scott Biersdorff, Kai Diethelm, Dominic Eschweiler, Markus Geimer, Michael Gerndt, Daniel Lorenz, Allen Malony, et al. Score-p: A joint performance measurement run-time infrastructure for periscope, scalasca, tau, and vampir. In Tools for High Performance Computing 2011, pages 79–91. Springer, 2012. DOI: 10.1007/978-3-642-31476-6_7.
James H Laros, Phil Pokorny, and David DeBonis. Powerinsight-a commodity power measurement capability. In Green Computing Conference (IGCC), 2013 International, pages 1–6. IEEE, 2013. DOI: 10.1109/igcc.2013.6604485.
Heike McCraw, James Ralph, Anthony Danalis, and Jack Dongarra. Power monitoring with papi for extreme scale architectures and dataflow-based programming models. 2014. DOI: 10.1109/cluster.2014.6968672.
John Mellor-Crummey, Robert J Fowler, Gabriel Marin, and Nathan Tallent. Hpcview: A tool for top-down analysis of node performance. The Journal of Supercomputing, 23(1):81–104, 2002. DOI: 10.1023/a:1015789220266.
Wolfgang E Nagel, Alfred Arnold, Michael Weber, Hans-Christian Hoppe, and Karl Solchenbach. Vampir: Visualization and analysis of mpi resources. 1996.
National Instruments Corporation. What Is Data Acquisition? http://www.ni.com/data-_acquisition/what-_is/.
Adel Noureddine, Romain Rouvoy, and Lionel Seinturier. A review of energy measurement approaches. ACM SIGOPS Operating Systems Review, 47(3):42–49, 2013. DOI: 10.1145/2553070.2553077.
NVIDIA Corporation. NVML API Reference Guide, March 2014.
P3 International. Kill A Watt product page. http://www.p3international.com/products/p4400.html.
Vincent Pillet, Jesús Labarta, Toni Cortes, and Sergi Girona. Paraver: A tool to visualize and analyze parallel code. In Proceedings of WoTUG-18: Transputer and occam Developments, volume 44, pages 17–31. mar, 1995.
Sebastian Ryffel. Lea2p: The linux energy attribution and accounting platform. Master’s thesis, Swiss Federal Institute of Technology, 2009.
Sandia National Laboratories. High performance computing power application programming interface (api) specification. http://powerapi.sandia.gov/, 2014.
Schleifenbauer. Schleifenbauer operation manual. http://schleifenbauer.eu/dynamisch/bibliotheek/16_0_NL_usermanual_v2.1.pdf.
Alain Schuermans. Schleifenbauer products bv, March 2012.
Martin Schulz, Jim Galarowicz, Don Maghrak, William Hachfeld, David Montoya, and Scott Cranford. Open— speedshop: An open source infrastructure for parallel performance analysis. Scientific Programming, 16(2-3):105–121, 2008. DOI: 10.1155/2008/713705.
Sameer S Shende and Allen D Malony. The tau parallel performance system. International Journal of High Performance Computing Applications, 20(2):287–311, 2006. DOI: 10.1177/1094342006064482.
Thanos Stathopoulos, Dustin McIntire, and William J. Kaiser. The energy endoscope: Real-time detailed energy accounting for wireless sensor nodes. In IPSN, pages 383–394. IEEE Computer Society, 2008. DOI: 10.1109/ipsn.2008.36.
Luís Taniça, Aleksandar Ilic, Pedro Tomás, and Leonel Sousa. Schedmon: A performance and energy monitoring tool for modern multi-cores. In Euro-Par 2014: Parallel Processing Workshops, pages 230–241. Springer, 2014. DOI: 10.1007/978-3-319-14313-2_20.
Valerie E Taylor, Xingfu Wu, Jonathan Geisler, Xin Li, Zhiling n, Rick Stevens, Mark Hereld, and Ivan R Judson. Prophesy: An infrastructure for analyzing and modeling the performance parallel and distributed applications. In High-Performance Distributed Computing, 2000. Proceedings. The nth International Symposium on, pages 302–303. IEEE, 2000. DOI: 10.1109/hpdc.2000.868668.
J. Treibig, G. Hager, and G. Wellein. Likwid: A lightweight performance-oriented tool suite for x86 multicore environments. In Proceedings of PSTI2010, the First International Workshop on Parallel Software Tools and Tool Infrastructures, San Diego CA, 2010.
Unified EFI, Inc. Advanced Configuration and Power Interface Specification, July 2014.
Virtual Institute High Productivity Supercomputing. Score-E. http://www.vi-_hps.org/projects/score-_e/, 2013.
Watt’s Up Meters. Operators Manual. https://www.wattsupmeters.com/secure/downloads/manual_rev_9_corded0812.pdf.
Watt’s Up Meters. Watt’s Up product page. https://www.wattsupmeters.com/.
V. Weaver, M. Johnson, K. Kasichayanula, J. Ralph, P. Luszczek, D. Terpstra, and S. Moore. Measuring energy and power with papi. In International Workshop on Power-Aware Systems and Architectures, Pittsburgh, PA, September 2012. DOI: 10.1109/icppw.2012.39.
Vincent M Weaver, Daniel Terpstra, Heike McCraw, Matt Johnson, Kiran Kasichayanula, James Ralph, John Nelson, Philip Mucci, Tushar Mohan, and Shirley Moore. Papi 5: Measuring power, energy, and the cloud. In Performance Analysis of Systems and Software (ISPASS), 2013 IEEE International Symposium on, pages 124–125. IEEE, 2013. DOI: 10.1109/ispass.2013.6557155.
Xingfu Wu, Charles Lively, Valerie Taylor, Hung-Ching Chang, Chun-Yi Su, Kirk Cameron, Shirley Moore, Daniel Terpstra, and Vince Weaver. Mummi: multiple metrics modeling infrastructure. In Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD), 2013 14th ACIS International Conference on, pages 289–295. IEEE, 2013. DOI: 10.1109/snpd.2013.73.
Yokogawa Electric Corporation. Power Analyzers. http://tmi.yokogawa.com/products/digital-_power-_analyzers/.
K. Yoshii, K. Iskra, R. Gupta, P. Beckman, V. Vishwanath, Chenjie Yu, and S. Coghlan. Evaluating power-monitoring capabilities on ibm blue gene/p and blue gene/q. In Cluster Computing (CLUSTER), 2012 IEEE International Conference on, pages 36–44, September 2012. DOI: 10.1109/CLUSTER.2012.62.
ZES ZIMMER. Brochure LMG450. http://www.zes.com/en/content/download/286/2473/file/lmg450_prospekt_1002_e.pdf.
ZES ZIMMER Electronic Systems GmbH. Products: Precision Power Analyzer. http://www.zes.com/en/Products/Precision-_Power-_Analyzer.
Downloads
Published
How to Cite
License
Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution-Non Commercial 3.0 License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.