Cookies

We use cookies to ensure that we give you the best experience on our website. By continuing to browse this repository, you give consent for essential cookies to be used. You can read more about our Privacy and Cookie Policy.


Durham Research Online
You are in:

Efficient Uncertainty Quantification for Multilabel Text Classification

Yu, Jialin and Cristea, Alexandra I. and Harit, Anoushka and Sun, Zhongtian and Aduragba, Olanrewaju Tahir and Shi, Lei and Al Moubayed, Noura (2022) 'Efficient Uncertainty Quantification for Multilabel Text Classification.', The 2022 International Joint Conference on Neural Networks (IJCNN) Padova, Italy, 18-23 July 2022.

Abstract

Despite rapid advances of modern artificial intelligence (AI), there is a growing concern regarding its capacity to be explainable, transparent, and accountable. One crucial step towards such AI systems involves reliable and efficient uncertainty quantification methods. Existing approaches to uncertainty quantification in natural language processing (NLP) take a Bayesian Deep Learning approach. However, the latter is known to not be computationally efficient in testing time, thus hindering its applicability in real-life scenarios. This paper proposes a new focus on the efficiency of uncertainty quantification methods, evaluating them on four multi-label text classification tasks. Our novel methods of representing epistemic and aleatoric uncertainties enable efficient uncertainty quantification (around 13 to 45 times faster than existing approaches, depending on architecture) with posterior analysis in the (approximated) latent- and data space. We conduct extensive experiments and studies on diverse neural network architectures (LSTM, CNN and Transformer) to analyse their power. Our results prove the benefits of explicitly modelling uncertainty in neural networks.

Item Type:Conference item (Paper)
Full text:(AM) Accepted Manuscript
Download PDF
(416Kb)
Status:Peer-reviewed
Publisher Web site:https://ieeexplore.ieee.org/xpl/conhome/1000500/all-proceedings
Date accepted:26 April 2022
Date deposited:01 September 2022
Date of first online publication:2022
Date first made open access:01 September 2022

Save or Share this output

Export:
Export
Look up in GoogleScholar