Hybrid Bernstein Normalizing Flows for Flexible Multivariate Density Regression With Interpretable Marginals

MCML Authors

Thomas Nagler

Prof. Dr.

Principal Investigator

Computational Statistics & Data Science

David Rügamer

Prof. Dr.

Principal Investigator

Statistics, Data Science and Machine Learning

Abstract

Density regression models allow a comprehensive understanding of data by modeling the complete conditional probability distribution. While flexible estimation approaches such as normalizing flows (NF) work particularly well in multiple dimensions, interpreting the input-output relationship of such models is often difficult, due to the black-box character of deep learning models. In contrast, existing statistical methods for multivariate outcomes such as multivariate conditional transformation models (MCTM) are restricted in flexibility and are often not expressive enough to represent complex multivariate probability distributions. In this paper, we combine MCTM with state-of-the-art and autoregressive NF to leverage the transparency of MCTM for modeling interpretable feature effects on the marginal distributions in the first step and the flexibility of neural-network-based NF techniques to account for complex and non-linear relationships in the joint data distribution. We demonstrate our method's versatility in various numerical experiments and compare it with MCTM and other NF models on both simulated and real-world data.

inproceedings

---

UAI 2025

41st Conference on Uncertainty in Artificial Intelligence. Rio de Janeiro, Brazil, Jul 21-25, 2025.

---

Authors

M. Arpogaus • T. Kneib • T. Nagler • D. Rügamer

---

Links

URL

---

Research Area

 A1 | Statistical Foundations & Explainability