Bootcamp
LRZ Bootcamp With NIVIDA on Accelerated Distributed Computing
Train Multiple Systems and Learn About New Tools
26.03.2025
9:00 am - 2:15 pm
LRZ, Boltzmannstr. 1, Garching
The LRZ (Leibniz Supercomputing Centre) BDAI Team, together with NVIDIA, is organizing a Bootcamp on Accelerated Distributed Computing - powered by NVIDIA on March 26, 2025, at 9 AM.
The key topics addressed are:
1. Training Parallelization - Various methods to split and optimize training across multiple systems, including data/model parallelism and advanced techniques like ZeRO and Mixture-of-Experts
2. Communication Systems - How components communicate within and between nodes using tools like NCCL
3. Implementation Tools - Frameworks like NeMo Megatron and Profiler
You can register yourself for the bootcamp under the following link, where you can also find a detailed agenda.
Related
Workshop • 16.07.2026 • ZEPP, Room M210, Geschwister-Scholl-Platz 1, 80539 München
Normative Ethics and Artificial Intelligence
On 16 July 2026, philosophers from LMU Munich and the University of Oxford will come together for a one-day pre-read workshop at LMU Munich.
Workshop • 13.08.2026 • Professor-Huber-Platz 2, W201 (LMU Munich)
5th MCML Workshop on Causal Machine Learning
Join us at the 5th MCML Workshop on Causal Machine Learning.
Certificate Course • 06.11.2026 • Online
Certificate Course on Responsible AI - Part 1
Preliminary announcement of the Responsible AI Certificate Course 2026, a joint online program by the German National AI Centers. Details to follow.