Learning to Read Xray: Applications to Heart Failure Monitoring

We propose a novel method for image classification using limited labels. Leveraging radiology reports, we create a multimodal embedding for classification, demonstrated in assessing pulmonary edema severity in congestive heart failure.