Position: Bayesian Deep Learning is Needed in the Age of Large-Scale AI

Papamarkou, Theodore and Skoularidou, Maria and Palla, Konstantina and Aitchison, Laurence and Arbel, Julyan and Dunson, David and Filippone, Maurizio and Fortuin, Vincent and Hennig, Philipp and Hernández-Lobato, José Miguel and Hubin, Aliaksandr and Immer, Alexander and Karaletsos, Theofanis and Khan, Mohammad Emtiyaz and Kristiadi, Agustinus and Li, Yingzhen and Mandt, Stephan and Nemeth, Christopher and Osborne, Michael A. and Rudner, Tim G. J. and Rügamer, David and Teh, Yee Whye and Welling, Max and Wilson, Andrew Gordon and Zhang, Ruqi (2024) Position: Bayesian Deep Learning is Needed in the Age of Large-Scale AI. Proceedings of Machine Learning Research. ISSN 1938-7228 (In Press)

[thumbnail of 2402.00809v4]
Text (2402.00809v4)
2402.00809v4.pdf

Download (731kB)
[thumbnail of ICML_2024_Position_Paper_On_Bayesian_Deep_Learning]
Text (ICML_2024_Position_Paper_On_Bayesian_Deep_Learning)
ICML_2024_Position_Paper_On_Bayesian_Deep_Learning.pdf - Accepted Version
Available under License Creative Commons Attribution.

Download (510kB)

Abstract

In the current landscape of deep learning research, there is a predominant emphasis on achieving high predictive accuracy in supervised tasks involving large image and language datasets. However, a broader perspective reveals a multitude of overlooked metrics, tasks, and data types, such as uncertainty, active and continual learning, and scientific data, that demand attention. Bayesian deep learning (BDL) constitutes a promising avenue, offering advantages across these diverse settings. This paper posits that BDL can elevate the capabilities of deep learning. It revisits the strengths of BDL, acknowledges existing challenges, and highlights some exciting research avenues aimed at addressing these obstacles. Looking ahead, the discussion focuses on possible ways to combine large-scale foundation models with BDL to unlock their full potential.

Item Type:
Journal Article
Journal or Publication Title:
Proceedings of Machine Learning Research
Additional Information:
In: Proceedings of the 41st International Conference on Machine Learning (ICML), Vienna, Austria.
Uncontrolled Keywords:
Research Output Funding/yes_externally_funded
Subjects:
?? cs.lgstat.mlyes - externally fundedyes ??
ID Code:
221146
Deposited By:
Deposited On:
06 Jun 2024 10:55
Refereed?:
Yes
Published?:
In Press
Last Modified:
17 Jun 2024 00:12