Al Moubayed, Noura and McGough, Stephen and Awwad Shiekh Hasan, Bashar (2020) 'Beyond the topics : how deep learning can improve the discriminability of probabilistic topic modelling.', PeerJ computer science., 6 . e252.
The article presents a discriminative approach to complement the unsupervised probabilistic nature of topic modelling. The framework transforms the probabilities of the topics per document into class-dependent deep learning models that extract highly discriminatory features suitable for classification. The framework is then used for sentiment analysis with minimum feature engineering. The approach transforms the sentiment analysis problem from the word/document domain to the topics domain making it more robust to noise and incorporating complex contextual information that are not represented otherwise. A stacked denoising autoencoder (SDA) is then used to model the complex relationship among the topics per sentiment with minimum assumptions. To achieve this, a distinct topic model and SDA per sentiment polarity is built with an additional decision layer for classification. The framework is tested on a comprehensive collection of benchmark datasets that vary in sample size, class bias and classification task. A significant improvement to the state of the art is achieved without the need for a sentiment lexica or over-engineered features. A further analysis is carried out to explain the observed improvement in accuracy.
|Full text:||(VoR) Version of Record|
Available under License - Creative Commons Attribution.
Download PDF (16619Kb)
|Publisher Web site:||https://doi.org/10.7717/peerj-cs.252|
|Publisher statement:||© 2020 Al Moubayed et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, reproduction and adaptation in any medium and for any purpose provided that it is properly attributed. For attribution, the original author(s), title, publication source (PeerJ Computer Science) and either DOI or URL of the article must be cited.|
|Date accepted:||23 December 2019|
|Date deposited:||04 March 2020|
|Date of first online publication:||27 January 2020|
|Date first made open access:||04 March 2020|
Save or Share this output
|Look up in GoogleScholar|