An Introduction to Parallel Programming with OpenMP, PThreads and MPI

The 2017 update includes a new Chapter on OpenMP applications, BLAS, Sparse BLAS, Graph BLAS and the Intel Math Kernel Library (MKL). Both the OpenMP and MPI presentations have been revised to include discussions and examples of the latest standards.

Topics include programming with Linux processes, OpenMP, concurrent programming with POSIX Threads, parallel and pipeline programming including vector processing and GPU programming, distributed programming including Berkeley sockets and MPI, and Cloud computing using Hadoop and BOINC. Optimizing execution for pipeline, vector and GPU architectures is also illustrated.

This is an introductory text. Familiarity with C and Java is assumed. There are numerous code examples, which are available free on request from [email protected].