Parallel Programming of High-Performance Systems (PPHPS) is a comprehensive multi-day course jointly organized by NHR@FAU and the Leibniz Supercomputing Center (LRZ). It addresses the full parallel programming stack needed on modern HPC systems: shared-memory parallelism with OpenMP, distributed-memory parallelism with MPI, GPU acceleration via OpenMP target offloading, and hybrid combinations of these approaches. The course also covers HPC system usage, computer architecture fundamentals, performance optimization, and an introduction to profiling tools.
Level: Beginner
Language: English
Price and Eligibility: Refer to the registration page for each event (generally free of charge for members of academia from Europe).
Knowledge
- Proficiency in at least one HPC language: Fortran 95, C, or C++
- Familiarity with the Linux command line, including shell commands, SSH login, compiler usage, and a text editor
Technical
- Access to NHR@FAU or LRZ cluster systems (provided during the course)
After completing this course, you will be able to:
- Understand the architecture of modern HPC systems and how to use them effectively
- Parallelize applications for multi-core nodes using OpenMP
- Scale applications across multiple nodes using MPI
- Combine OpenMP and MPI in hybrid parallel programs
- Offload compute-intensive code to GPU accelerators via OpenMP target offloading
- Apply basic performance optimization strategies and avoid common parallel programming pitfalls
- Use profiling tools to analyze and improve application performance
- Introduction to HPC systems and the German HPC ecosystem
- Computer architecture fundamentals relevant to parallel performance
- Shared-memory parallelism with OpenMP: threads, parallel regions, loop parallelization, synchronization
- Distributed-memory parallelism with MPI: point-to-point and collective communication
- GPU offloading with OpenMP target directives
- Hybrid parallelization and performance optimization strategies
- 2026, Feb 24-26: three-day on-site course at NHR@FAU in collaboration with LRZ
- 2025, Feb 18: full-day on-site course at LRZ in collaboration with LRZ
- 2024, Feb 20: full-day on-site course at NHR@FAU in collaboration with LRZ
- 2023, Mar 7: full-day online course in collaboration with LRZ
- 2022, Mar 8: full-day online course in collaboration with LRZ
- 2021, Apr 13: full-day online course in collaboration with LRZ
- 2020, Mar 9: full-day on-site course at FAU in collaboration with LRZ
For an overview of all NHR@FAU courses, visit the course overview page.