Beyond Interpretability: The Gains of Feature Monosemanticity on Model Robustness

MCML Authors

Stefanie Jegelka

Prof. Dr.

Principal Investigator

Foundations of Deep Neural Networks

Abstract

Deep learning models often suffer from a lack of interpretability due to polysemanticity, where individual neurons are activated by multiple unrelated semantics, resulting in unclear attributions of model behavior. Recent advances in monosemanticity, where neurons correspond to consistent and distinct semantics, have significantly improved interpretability but are commonly believed to compromise accuracy. In this work, we challenge the prevailing belief of the accuracy-interpretability tradeoff, showing that monosemantic features not only enhance interpretability but also bring concrete gains in model performance. Across multiple robust learning scenarios-including input and label noise, few-shot learning, and out-of-domain generalization-our results show that models leveraging monosemantic features significantly outperform those relying on polysemantic features. Furthermore, we provide empirical and theoretical understandings on the robustness gains of feature monosemanticity. Our preliminary analysis suggests that monosemanticity, by promoting better separation of feature representations, leads to more robust decision boundaries. This diverse evidence highlights the generality of monosemanticity in improving model robustness. As a first step in this new direction, we embark on exploring the learning benefits of monosemanticity beyond interpretability, supporting the long-standing hypothesis of linking interpretability and robustness.

inproceedings

---

ICLR 2025

13th International Conference on Learning Representations. Singapore, Apr 24-28, 2025.

---

Authors

Q. Zhang • Y. Wang • J. Cui • X. Pan • Q. Lei • S. Jegelka • Y. Wang

---

Links

URL

---

Research Area

 A3 | Computational Models