Beginner MPI Tutorial

Welcome to the MPI tutorial for beginners! In this tutorial, you will learn all of the basic concepts of MPI by going through various examples. The different parts of the tutorial are meant to build on top of one another. If you feel lost during any lesson, feel free to leave a comment on the post explaining your dilemma. Either myself or another MPI expert will likely be able to get back to you soon.

This beginning tutorial assumes that the reader has a general knowledge of how parallel programming works, has experience with working on a Linux system, and can also understand the C programming language.

Introduction

• MPI Introduction
• Installing MPICH2
• Running an MPI Hello World Application

Blocking Point-to-Point Communication

• MPI Send and Receive
• Dynamic Receiving with MPI_Probe (and MPI_Status)
• Point-to-Point Communication Application Example – Random Walk

Collective Communication

• MPI Broadcast and Collective Communication
• MPI Scatter, Gather, and Allgather

This site is constantly being updated. Stay tuned for more lessons!