MPI and OpenMP

The Message Passing Interface (MPI) is designed to enable parallel programming through process communication on distributed-memory machines such as networked clusters, shared-memory high-performance machines, and hybrid clusters.
 

---

OpenMP is an implementation of multithreading, a method of parallelizing implemented using pragmas whereby a master thread and slave threads, in parallel, jointly perform a task.

Documents

1. OpenMPI

2. The MPI Report

3. The OpenMP Specification

Overview

• Why Topologies

• Derived Datatypes

Topics

• Virtual Topologies