Can AI Help Solve Complex Physics Equations? Meet APEBench

Our Junior Member Felix Köhler, together with our PIs Rüdiger Westermann and Nils Thuerey, and collaborator Simon Niedermayr, have introduced APEBench, an innovative benchmark suite. APEBench sets a new standard for evaluating autoregressive neural emulators, which are designed to solve partial differential equations (PDEs)—the fundamental mathematical framework for modeling natural phenomena such as weather patterns, fluid dynamics, and chemical reactions.

What Is APEBench?

Partial Differential Equations (PDEs) are the backbone of many scientific fields, modeling everything from ocean currents to climate patterns. However, solving them accurately demands massive computational resources. Traditional numerical solvers provide precision but at a high cost, while AI-based alternatives offer speed but struggle with stability. To address this challenge, the authors introduce APEBench, a benchmark designed to evaluate and enhance AI-based PDE solvers.

APEBench is an open-source benchmark that evaluates neural emulators—AI models trained to approximate complex PDE solutions. Unlike traditional simulators, which compute every detail from first principles, emulators learn from data to make fast, step-by-step predictions. But how do we know if these AI models are reliable? That’s where APEBench’s key contributions come in.

Four Key Innovations of APEBench

1) a Large Selection of PDEs

APEBench includes 46 different PDE scenarios across 1D, 2D, and 3D, covering a wide range of real-world physics problems. This diversity allows researchers to compare AI models across simple and complex systems, ensuring that AI-driven solvers are tested under realistic conditions.

2) a Unique System for Identifying PDE Dynamics

Unlike previous benchmarks, APEBench provides a structured way to classify PDEs based on their mathematical properties. It introduces a unique identifier system that links each PDE to well-known stability criteria from classical numerical methods. This allows researchers to quantify the difficulty of solving a given PDE and compare how different AI models handle complex dynamics.

3) a Differentiable Simulation Suite

APEBench includes a JAX-based differentiable simulator, enabling AI models to interact directly with physics-based solvers during training. This means that instead of relying on precomputed datasets, models can be trained with real-time simulation feedback, improving their accuracy and adaptability. This feature is especially valuable for hybrid AI-solvers, which blend AI with traditional numerical techniques.

4) a New Approach to Evaluating Long-Term Accuracy

Traditional PDE benchmarks often focus on short-term performance, but in real-world applications, long-term stability is crucial. APEBench introduces rollout metrics, which track how well an AI model generalizes over extended simulations. By analyzing these metrics, researchers can identify which training methods lead to more stable and reliable AI solvers.

©Felix Köhler, Rüdiger Westermann and Nils Thuerey

Examples of the 46 PDE dynamics

Why Does This Matter?

Neural emulators have the potential to dramatically accelerate PDE simulations, making applications like weather prediction, climate modeling, and engineering simulations more efficient. APEBench provides a structured and rigorous way to evaluate these AI-driven solvers, ensuring that they are not only fast but also accurate and stable over time.

Discover More

Want to see APEBench in action? Check out the animated visual summary on the APEBench Project Page.

Felix Köhler also created a Quickstart Video to help you dive in—check it out on YouTube.

Explore the full paper, published at NeurIPS 2024, including its methodology, experiments, and future directions:

F. Köhler • S. Niedermayr • R. Westermann • N. Thuerey
APEBench: A Benchmark for Autoregressive Neural Emulators of PDEs.
NeurIPS 2024 - 38th Conference on Neural Information Processing Systems. Vancouver, Canada, Dec 10-15, 2024. DOI GitHub

©Felix Köhler

Behind the scenes: Snapshot from the poster session at NeurIPS 2024