23.06.2024

MCML Researchers With One Paper at COLT 2024
37th Annual Conference on Learning Theory (COLT 2024). Edmonton, Canada, 30.06.2024–03.07.2024
We are happy to announce that MCML researchers are represented with one paper at COLT 2024. Congrats to our researchers!
Main Track (1 papers)
Fast, blind, and accurate: Tuning-free sparse regression with global linear convergence.
COLT 2024 - 37th Annual Conference on Learning Theory. Edmonton, Canada, Jun 30-Jul 03, 2024. URL
Abstract
Many algorithms for high-dimensional regression problems require the calibration of regularization hyperparameters. This, in turn, often requires the knowledge of the unknown noise variance in order to produce meaningful solutions. Recent works show, however, that there exist certain estimators that are pivotal, i.e., the regularization parameter does not depend on the noise level; the most remarkable example being the square-root lasso. Such estimators have also been shown to exhibit strong connections to distributionally robust optimization. Despite the progress in the design of pivotal estimators, the resulting minimization problem is challenging as both the loss function and the regularization term are non-smooth. To date, the design of fast, robust, and scalable algorithms with strong convergence rate guarantees is still an open problem. This work addresses this problem by showing that an iteratively reweighted least squares (IRLS) algorithm exhibits global linear convergence under the weakest assumption available in the literature. We expect our findings will also have implications for multi-task learning and distributionally robust optimization.
MCML Authors
23.06.2024
Related

20.05.2025
Call for Papers for NLPOR - First Workshop on Bridging NLP and Public Opinion Research
This interdisciplinary workshop explores the powerful connections between Natural Language Processing (NLP) and Public Opinion Research (POR).

02.05.2025
MCML Researchers With Five Papers at AISTATS 2025
28th International Conference on Artificial Intelligence and Statistics (AISTATS 2025). Mai Khao, Thailand, 29.04.2025 - 05.05.2024

28.04.2025
MCML Delegation Visit to the USA
MCML delegation visits top US institutions to foster AI research collaborations in Generative and Medical AI, May 19–23, 2025.

28.04.2025
MCML Researchers With Eleven Papers at NAACL 2025
Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL 2025). Albuquerque, NM, USA, 29.04.2025 - 04.05.2024