Home » Publication » 24731

Dettaglio pubblicazione

2021, International Joint Conference on Neural Networks, {IJCNN} 2021, Shenzhen,China, July 18-22, 2021, Pages 1-8

Concept Matching for Low-Resource Classification (04b Atto di convegno in volume)

Errica Federico, Silvestri Fabrizio, Edizel Bora, Denoyer Ludovic, Petroni Fabio, Plachouras Vassilis, Riedel Sebastian

In many applications that rely on machine learning, the availability of labelled data is a matter of primary importance. However, when tackling new tasks, labels are usually missing and must be collected from scratch by the users. In this work, we address the problem of learning classifiers when the amount of labels is very scarce. We do so by learning multiple vectors, called prototypes, that represent relevant semantic concepts for the task at hand. We propose a theoretically inspired mechanism that computes probabilities of matching between the prototypes and the input elements, and we combine these probabilities to increase the expressiveness of the classifier. Moreover, by leveraging low-cost extra annotations in the training data, a simple error-boosting technique guides the learning process and provides substantial performance improvements. Empirical results confirm the benefits of the proposed approach in both balanced and unbalanced datasets. Our methodology is thus of practical use when gathering and labelling new examples is more expensive than annotating what we already have.
Gruppo di ricerca: Algorithms and Data Science, Gruppo di ricerca: Theory of Deep Learning
© Università degli Studi di Roma "La Sapienza" - Piazzale Aldo Moro 5, 00185 Roma