Semi-supervised Learning Guided by the Generalized Bayes Rule Under Soft Revision

Dietrich, Stefan and Rodemann, Julian and Jansen, Christoph (2024) Semi-supervised Learning Guided by the Generalized Bayes Rule Under Soft Revision. In: Combining, Modelling and Analyzing Imprecision, Randomness and Dependence :. Advances in Intelligent Systems and Computing (AISC) . Springer, Cham, pp. 110-117. ISBN 9783031659928

Abstract

We provide a theoretical and computational investigation of the Gamma-Maximin method with soft revision, which was recently proposed as a robust criterion for pseudo-label selection (PLS) in semi-supervised learning. Opposed to traditional methods for PLS we use credal sets of priors (“generalized Bayes”) to represent the epistemic modeling uncertainty. These latter are then updated by the Gamma-Maximin method with soft revision. We eventually select pseudo-labeled data that are most likely in light of the least favorable distribution from the so updated credal set. We formalize the task of finding optimal pseudo-labeled data w.r.t. the Gamma-Maximin method with soft revision as an optimization problem. A concrete implementation for the class of logistic models then allows us to compare the predictive power of the method with competing approaches. It is observed that the Gamma-Maximin method with soft revision can achieve very promising results, especially when the proportion of labeled data is low.