Shared Memory Application Programming

Shared Memory Application Programming presents the key concepts and applications of parallel programming, in an accessible and engaging style applicable to developers across many domains. Multithreaded programming is today a core technology, at the basis of all software development projects in any branch of applied computer science. This book guides readers to develop insights about threaded programming and introduces two popular platforms for multicore development: OpenMP and Intel Threading Building Blocks (TBB). Author Victor Alessandrini leverages his rich experience to explain each platform’s design strategies, analyzing the focus and strengths underlying their often complementary capabilities, as well as their interoperability. The book is divided into two parts: the first develops the essential concepts of thread management and synchronization, discussing the way they are implemented in native multithreading libraries (Windows threads, Pthreads) as well as in the modern C++11 threads standard. The second provides an in-depth discussion of TBB and OpenMP including the latest features in OpenMP 4.0 extensions to ensure readers’ skills are fully up to date. Focus progressively shifts from traditional thread parallelism to modern task parallelism deployed by modern programming environments. Several chapter include examples drawn from a variety of disciplines, including molecular dynamics and image processing, with full source code and a software library incorporating a number of utilities that readers can adapt into their own projects. Designed to introduce threading and multicore programming to teach modern coding strategies for developers in applied computing Leverages author Victor Alessandrini's rich experience to explain each platform’s design strategies, analyzing the focus and strengths underlying their often complementary capabilities, as well as their interoperability Includes complete, up-to-date discussions of OpenMP 4.0 and TBB Based on the author’s training sessions, including information on source code and software libraries which can be repurposed

A comprehensive overview of OpenMP, the standard application programming interface for shared memory parallel computing—a reference for students and professionals. "I hope that readers will learn to use the full expressibility and power of OpenMP. This book should provide an excellent introduction to beginners, and the performance section should help those with some experience who want to push OpenMP to its limits." —from the foreword by David J. Kuck, Intel Fellow, Software and Solutions Group, and Director, Parallel and Distributed Solutions, Intel Corporation OpenMP, a portable programming interface for shared memory parallel computers, was adopted as an informal standard in 1997 by computer scientists who wanted a unified model on which to base programs for shared memory systems. OpenMP is now used by many software developers; it offers significant advantages over both hand-threading and MPI. Using OpenMP offers a comprehensive introduction to parallel programming concepts and a detailed overview of OpenMP. Using OpenMP discusses hardware developments, describes where OpenMP is applicable, and compares OpenMP to other programming interfaces for shared and distributed memory parallel architectures. It introduces the individual features of OpenMP, provides many source code examples that demonstrate the use and functionality of the language constructs, and offers tips on writing an efficient OpenMP program. It describes how to use OpenMP in full-scale applications to achieve high performance on large-scale architectures, discussing several case studies in detail, and offers in-depth troubleshooting advice. It explains how OpenMP is translated into explicitly multithreaded code, providing a valuable behind-the-scenes account of OpenMP program performance. Finally, Using OpenMP considers trends likely to influence OpenMP development, offering a glimpse of the possibilities of a future OpenMP 3.0 from the vantage point of the current OpenMP 2.5. With multicore computer use increasing, the need for a comprehensive introduction and overview of the standard interface is clear. Using OpenMP provides an essential reference not only for students at both undergraduate and graduate levels but also for professionals who intend to parallelize existing codes or develop new parallel programs for shared memory computer architectures.

This book provides a unified presentation of the basic concepts of shared memory application programming, underlining the universality of these concepts and discussing the way they are declined in major programming environments. The book focuses on the high level parallel and concurrency patterns that commonly occur in real applications, and explores useful programming idioms, pitfalls and best practices that are largely independent of the underlying programming environment.

This book contains the presentations given at the Workshop on OpenMP App- cations and Tools, WOMPAT 2001. The workshop was held on July 30 and 31, 2001 at Purdue University, West Lafayette, Indiana, USA. It brought together designers, users, and researchers of the OpenMP application programming int- face. OpenMP has emerged as the standard for shared memory parallel progr- ming. For the rst time, it is possible to write parallel programs that are portable across the majority of shared memory parallel computers. WOMPAT 2001 s- ved as a forum for all those interested in OpenMP and allowed them to meet, share ideas and experiences, and discuss the latest developments of OpenMP and its applications. WOMPAT 2001 was co-sponsored by the OpenMP Architecture Review Board (ARB). It followed a series of workshops on OpenMP, including WOMPAT 2000, EWOMP 2000, and WOMPEI 2000. For WOMPAT 2001, we solicited papers formally and published them in the form of this book. The authors submitted extended abstracts, which were reviewed by the program committee. All submitted papers were accepted. The authors were asked to prepare a nal paper in which they addressed the reviewers comments. The proceedings, in the form of this book, were created in time to be available at the workshop. In this way, we hope to have brought out a timely report of ongoing OpenMP-related research and development e orts as well as ideas for future improvements.

Zusammenfassung: This book offers a comprehensive survey of shared-memory synchronization, with an emphasis on "systems-level" issues. It includes sufficient coverage of architectural details to understand correctness and performance on modern multicore machines, and sufficient coverage of higher-level issues to understand how synchronization is embedded in modern programming languages. The primary intended audience for this book is "systems programmers"--the authors of operating systems, library packages, language run-time systems, concurrent data structures, and server and utility programs. Much of the discussion should also be of interest to application programmers who want to make good use of the synchronization mechanisms available to them, and to computer architects who want to understand the ramifications of their design decisions on systems-level code

This book contains the presentations given at the Workshop on OpenMP App- cations and Tools, WOMPAT 2001. The workshop was held on July 30 and 31, 2001 at Purdue University, West Lafayette, Indiana, USA. It brought together designers, users, and researchers of the OpenMP application programming int- face. OpenMP has emerged as the standard for shared memory parallel progr- ming. For the rst time, it is possible to write parallel programs that are portable across the majority of shared memory parallel computers. WOMPAT 2001 s- ved as a forum for all those interested in OpenMP and allowed them to meet, share ideas and experiences, and discuss the latest developments of OpenMP and its applications. WOMPAT 2001 was co-sponsored by the OpenMP Architecture Review Board (ARB). It followed a series of workshops on OpenMP, including WOMPAT 2000, EWOMP 2000, and WOMPEI 2000. For WOMPAT 2001, we solicited papers formally and published them in the form of this book. The authors submitted extended abstracts, which were reviewed by the program committee. All submitted papers were accepted. The authors were asked to prepare a nal paper in which they addressed the reviewers comments. The proceedings, in the form of this book, were created in time to be available at the workshop. In this way, we hope to have brought out a timely report of ongoing OpenMP-related research and development e orts as well as ideas for future improvements.

This book contains the Proceedings of the 5th Workshop on OpenMP Appli- tionsandTools(WOMPAT2004),whichtookplaceattheUniversityofHouston, Houston, Texas on May 17 and 18, 2004. Previous workshops in this series took place in Toronto, Canada, Fairbanks, Alaska, Purdue, Indiana, and San Diego, California.Thepurposeoftheworkshopwastobringtogetherusersanddevel- ers of the OpenMP API for shared memory parallel programming to disseminate their ideas and experiences and discuss the latest developments in OpenMP and its application. To support this aim, the program comprised a mixture of invited talks from research and industry, experience reports, and submitted papers, the last of which are presented in this volume. A tutorial introduction to OpenMP was held at the same location on May 18 by Ruud van der Pas from Sun Microsystems. Further, a two-day lab session called OMPlab was held immediately following the workshop and the tutorial on May 19 and 20, and was attended by both novice and advanced users. Many of the hardware vendors and several researchers gave in-depth tutorials on their softwareandmadetheirsystemsavailabletobothnoviceandadvancedattendees during OMPlab. Contributors to the WOMPAT 2004 OMPlab included IBM, Intel, Sun, the University of Tennessee, NASA, the University of Greenwich, Cornell University, the University of Oregon and the University of Houston. TheOpenMPAPIisawidelyacceptedstandardforhigh-levelsharedmemory parallel programming that was put forth by a consortium of vendors in 1997.

This is the first book to explain the language Unified Parallel C and its use. Authors El-Ghazawi, Carlson, and Sterling are among the developers of UPC, with close links with the industrial members of the UPC consortium. Their text covers background material on parallel architectures and algorithms, and includes UPC programming case studies. This book represents an invaluable resource for the growing number of UPC users and applications developers. More information about UPC can be found at: http://upc.gwu.edu/ An Instructor Support FTP site is available from the Wiley editorial department.