Bootcamp
LRZ Bootcamp With NIVIDA on Accelerated Distributed Computing
Train Multiple Systems and Learn About New Tools
26.03.2025
9:00 am - 2:15 pm
LRZ, Boltzmannstr. 1, Garching
The LRZ (Leibniz Supercomputing Centre) BDAI Team, together with NVIDIA, is organizing a Bootcamp on Accelerated Distributed Computing - powered by NVIDIA on March 26, 2025, at 9 AM.
The key topics addressed are:
1. Training Parallelization - Various methods to split and optimize training across multiple systems, including data/model parallelism and advanced techniques like ZeRO and Mixture-of-Experts
2. Communication Systems - How components communicate within and between nodes using tools like NCCL
3. Implementation Tools - Frameworks like NeMo Megatron and Profiler
You can register yourself for the bootcamp under the following link, where you can also find a detailed agenda.
Related
Workshop • 15.09.2026 - 18.09.2026 • TUM Garching Campus, Munich
ELLIS Summer School on Machine Learning & Computer Vision 2026
ELLIS Summer School on Machine Learning & Computer Vision 2026, taking place from September 15 to 18, 2026, at the TUM Garching Campus.
Workshop • 27.09.2026 • Strasbourg, France
MultiTab 2026 – MICCAI Workshop on Multimodal Learning With Medical Tabular Data
MCML PI Julia Schnabel co-organizes the MultiTab workshop at MICCAI 2026 on multimodal learning with medical tabular data.
Workshop • 01.10.2026 • Strasbourg, France
ASMUS 2026 – MICCAI Workshop on Medical Ultrasound
ASMUS 2026, the main MICCAI Workshop on Medical Ultrasound, will take place in Strasbourg, France, on October 1, 2026.
