Optimal Privacy Guarantees for a Relaxed Threat Model: Addressing Sub-Optimal Adversaries in Differentially Private Machine Learning

MCML Authors

Georgios Kaissis

Dr.

Principal Investigator

* Former Principal Investigator

Stefan Kolek

→ Group Gitta Kutyniok
 Mathematical Foundations of Artificial Intelligence

Anneliese Riess

→ Group Julia Schnabel
 Computational Imaging and AI in Medicine

Daniel Rückert

Prof. Dr.

Director

Artificial Intelligence in Healthcare and Medicine

Abstract

Differentially private mechanisms restrict the membership inference capabilities of powerful (optimal) adversaries against machine learning models. Such adversaries are rarely encountered in practice. In this work, we examine a more realistic threat model relaxation, where (sub-optimal) adversaries lack access to the exact model training database, but may possess related or partial data. We then formally characterise and experimentally validate adversarial membership inference capabilities in this setting in terms of hypothesis testing errors. Our work helps users to interpret the privacy properties of sensitive data processing systems under realistic threat model relaxations and choose appropriate noise levels for their use-case.

inproceedings KZK+23

---

NeurIPS 2023

37th Conference on Neural Information Processing Systems. New Orleans, LA, USA, Dec 10-16, 2023.

---

Authors

G. Kaissis • A. Ziller • S. Kolek • A. Riess • D. Rückert

---

Links

DOI

---

Research Areas

 A2 | Mathematical Foundations

 C1 | Medicine