Bootcamp
LRZ Bootcamp With NIVIDA on Accelerated Distributed Computing
Train Multiple Systems and Learn About New Tools
26.03.2025
9:00 am - 2:15 pm
LRZ, Boltzmannstr. 1, Garching
The LRZ (Leibniz Supercomputing Centre) BDAI Team, together with NVIDIA, is organizing a Bootcamp on Accelerated Distributed Computing - powered by NVIDIA on March 26, 2025, at 9 AM.
The key topics addressed are:
1. Training Parallelization - Various methods to split and optimize training across multiple systems, including data/model parallelism and advanced techniques like ZeRO and Mixture-of-Experts
2. Communication Systems - How components communicate within and between nodes using tools like NCCL
3. Implementation Tools - Frameworks like NeMo Megatron and Profiler
You can register yourself for the bootcamp under the following link, where you can also find a detailed agenda.
Related
Workshop • 04.05.2026 • LMU Munich, Center for Advanced Studies, Seestraße 13
LMU AI: Incubator for Startups
LMU startup workshop with founders and researchers sharing insights on launching ventures, legal frameworks, and key success factors for academics.
Tri-State Venture Sprint • 28.05.2026 - 29.05.2026 • Munich, Germany
From Frontier Research to Real-World Impact
A Tri-State Venture Sprint where AI researchers turn frontier research into startups, with mentorship, investors, and industry partners.
Workshop • 01.06.2026 • Vienna, Austria
4TH Robot-Assisted Medical Imaging
Workshop on robot-assisted medical imaging (AI, ultrasound, CT), bringing researchers and clinicians together.
