Optimal Privacy Guarantees for a Relaxed Threat Model: Addressing Sub-Optimal Adversaries in Differentially Private Machine Learning

MCML Authors

Georgios Kaissis

Dr.

Associate

* Former Associate

Daniel Rückert

Prof. Dr.

Director

Artificial Intelligence in Healthcare and Medicine

Abstract

Differentially private mechanisms restrict the membership inference capabilities of powerful (optimal) adversaries against machine learning models. Such adversaries are rarely encountered in practice. In this work, we examine a more realistic threat model relaxation, where (sub-optimal) adversaries lack access to the exact model training database, but may possess related or partial data. We then formally characterise and experimentally validate adversarial membership inference capabilities in this setting in terms of hypothesis testing errors. Our work helps users to interpret the privacy properties of sensitive data processing systems under realistic threat model relaxations and choose appropriate noise levels for their use-case.

inproceedings

---

NeurIPS 2023

37th Conference on Neural Information Processing Systems. New Orleans, LA, USA, Dec 10-16, 2023.

---

Authors

G. Kaissis • A. Ziller • S. Kolek • A. Riess • D. Rückert

---

Links

URL

---

Research Area

 C1 | Medicine