High Performance Computing Systems

This book constitutes the thoroughly refereed proceedings of the 5th International Workshop, PMBS 2014 in New Orleans, LA, USA in November 2014. The 12 full and 2 short papers presented in this volume were carefully reviewed and selected from 53 submissions. The papers cover topics on performance benchmarking and optimization; performance analysis and prediction; and power, energy and checkpointing.

This book constitutes selected revised and extended papers from the 10th International Conference on High-Performance Computing Systems and Technologies in Scientific Research, Automation of Control and Production, HPCST 2020, Barnaul, Russia, in May 2020. Due to the COVID-19 pancemic the conference was partly held in virtual mode. The 14 full papers presented in this volume were thoroughly reviewed and selected form 51 submissions. The papers are organized in topical sections on hardware for high-performance computing and its applications; information technologies and computer simulation of physical phenomena.

High Performance Computing Systems and Applications contains fully refereed papers from the 15th Annual Symposium on High Performance Computing. These papers cover both fundamental and applied topics in HPC: parallel algorithms, distributed systems and architectures, distributed memory and performance, high level applications, tools and solvers, numerical methods and simulation, advanced computing systems, and the emerging area of computational grids. High Performance Computing Systems and Applications is suitable as a secondary text for graduate level courses, and as a reference for researchers and practitioners in industry.

In view of the growing presence and popularity of multicore and manycore processors, accelerators, and coprocessors, as well as clusters using such computing devices, the development of efficient parallel applications has become a key challenge to be able to exploit the performance of such systems. This book covers the scope of parallel programming for modern high performance computing systems. It first discusses selected and popular state-of-the-art computing devices and systems available today, These include multicore CPUs, manycore (co)processors, such as Intel Xeon Phi, accelerators, such as GPUs, and clusters, as well as programming models supported on these platforms. It next introduces parallelization through important programming paradigms, such as master-slave, geometric Single Program Multiple Data (SPMD) and divide-and-conquer. The practical and useful elements of the most popular and important APIs for programming parallel HPC systems are discussed, including MPI, OpenMP, Pthreads, CUDA, OpenCL, and OpenACC. It also demonstrates, through selected code listings, how selected APIs can be used to implement important programming paradigms. Furthermore, it shows how the codes can be compiled and executed in a Linux environment. The book also presents hybrid codes that integrate selected APIs for potentially multi-level parallelization and utilization of heterogeneous resources, and it shows how to use modern elements of these APIs. Selected optimization techniques are also included, such as overlapping communication and computations implemented using various APIs. Features: Discusses the popular and currently available computing devices and cluster systems Includes typical paradigms used in parallel programs Explores popular APIs for programming parallel applications Provides code templates that can be used for implementation of paradigms Provides hybrid code examples allowing multi-level parallelization Covers the optimization of parallel programs

High Performance Computing: Modern Systems and Practices is a fully comprehensive and easily accessible treatment of high performance computing, covering fundamental concepts and essential knowledge while also providing key skills training. With this book, domain scientists will learn how to use supercomputers as a key tool in their quest for new knowledge. In addition, practicing engineers will discover how supercomputers can employ HPC systems and methods to the design and simulation of innovative products, and students will begin their careers with an understanding of possible directions for future research and development in HPC. Those who maintain and administer commodity clusters will find this textbook provides essential coverage of not only what HPC systems do, but how they are used. Covers enabling technologies, system architectures and operating systems, parallel programming languages and algorithms, scientific visualization, correctness and performance debugging tools and methods, GPU accelerators and big data problems Provides numerous examples that explore the basics of supercomputing, while also providing practical training in the real use of high-end computers Helps users with informative and practical examples that build knowledge and skills through incremental steps Features sidebars of background and context to present a live history and culture of this unique field Includes online resources, such as recorded lectures from the authors’ HPC courses

The book discusses the fundamentals of high-performance computing. The authors combine visualization, comprehensibility, and strictness in their material presentation, and thus influence the reader towards practical application and learning how to solve real computing problems. They address both key approaches to programming modern computing systems: multithreading-based parallelizing in shared memory systems, and applying message-passing technologies in distributed systems. The book is suitable for undergraduate and graduate students, and for researchers and practitioners engaged with high-performance computing systems. Each chapter begins with a theoretical part, where the relevant terminology is introduced along with the basic theoretical results and methods of parallel programming, and concludes with a list of test questions and problems of varying difficulty. The authors include many solutions and hints, and often sample code.

Because hardware technology appears unable to provide continuing speed increases, and because parallel architectures and software are not sufficiently developed to provide the practical solutions that have seemed tantalizingly close for some time, computing as a whole is at a crossroads. Even after more than a decade of commercial development, no standard or widely accepted systems have emerged. However, this text defines practical parallelism tests and suggests how they can be passed by giving specific technical suggestions and outlining policy steps that should be taken. Also suggested are methods for evolving better systems from those already in use and applying the definitions of what is needed as rules of selection.

This book constitutes the thoroughly refereed post-conference proceedings of the 23rd International Symposium on High Performance Computing Systems and Applications, HPCS 2009, held in Kingston, Canada, in June 2009. The 29 revised full papers presented - fully revised to incorporate reviewers' comments and discussions at the symposium - were carefully selected for inclusion in the book. The papers are organized in topical sections on turbulence, materials and life sciences, bringing HPC to industry, computing science, mathematics, and statistics, as well as HPC systems and methods.