Internode Parallelism: Introduction to MPI

The Message Passing Interface (MPI) is arguably the primary programming model used for applications internode parallelism. Developed by the NCI Training Team, the Introduction to MPI workshop demonstrates MPI procedures with the hands-on exercise.

In this workshop participants will be shown various MPI communication mechanisms to achieve data exchange between multiple nodes. Additionally, MPI profiling will also be discussed.

Prerequisites

1. Basic experience with C/C++ is required. Knowledge about C functions, pointers and memory management is sufficient.

2. Basic experience with bash or similar Unix shells. (Software Carpentry - The Unix Shell )

3. User experience on Gadi is ideal. (Seminar on Getting Started with Gadi)

Learning Outcomes

At the completion of this training session, you will be able to

• Know when to use MPI for parallelisation,

• How to prepare the buffer for communication calls,

• Distinguish and use blocking and non-blocking communications,

• Understand different communication modes,

• Overlap the communication and computation

If you have any questions regarding this training, please contact training.nci@anu.edu.au.