Using MPI: Portable Parallel Programming with the Message-Passing Interface

This book offers a thoroughly updated guide to the MPI (Message-Passing Interface) standard library for writing programs for parallel computers. Since the publication of the previous edition of Using MPI, parallel computing has become mainstream. Today, applications run on computers with millions of processors; multiple processors sharing memory and multicore processors with multiple hardware threads per core are common. The MPI-3 Forum recently brought the MPI standard up to date with respect to developments in hardware capabilities, core language evolution, the needs of applications, and experience gained over the years by vendors, implementers, and users. This third edition of Using MPI reflects these changes in both text and example code.

The book takes an informal, tutorial approach, introducing each concept through easy-to-understand examples, including actual code in C and Fortran. Topics include using MPI in simple programs, virtual topologies, MPI datatypes, parallel libraries, and a comparison of MPI with sockets. For the third edition, example code has been brought up to date; applications have been updated; and references reflect the recent attention MPI has received in the literature. A companion volume, Using Advanced MPI, covers more advanced topics, including hybrid programming and coping with large data.

Table of Contents

Chapter 1 Background
Chapter 2 Introduction to MPI
Chapter 3 Using MPI in Simple Programs
Chapter 4 Intermediate MPI
Chapter 5 Fun with Datatypes
Chapter 6 Parallel Libraries
Chapter 7 Other Features of MPI
Chapter 8 Understanding How MPI Implementations Work
Chapter 9 Comparing MPI with Sockets
Chapter 10 Wait! There’s More!
Appendix A The MPE Multiprocessing Environment
Appendix B MPI Resources Online
Appendix C Language Details