Zhang, Haofeng and Bai, Haoyue and Long, Yang and Liu, Li and Shao, Ling (2021) 'A plug-in attribute correction module for generalized zero-shot learning.', Pattern recognition., 112 .
While Zero Shot Learning models can recognize new classes without training examples, they often fails to incorporate both seen and unseen classes together at the test time, which is known as the Generalized Zero-shot Learning (GZSL) problem. This paper identifies a bottleneck issue when attributes are not well-defined, reliable, inaccurate in quantitative representations, or suffering from the visual-semantic discrepancy. We propose a Generic Plug-in Attribute Correction (GPAC) module which can effectively accommodate conventional ZSL in GZSL tasks. Different from existing embedding-based approaches which often lose the favor of transparency in attributes, our key challenge is to fully preserve the original meaning of the attributes and make it complementary and interpretable to upgrade existing ZSL models. To this end, we propose a novel nonnegative constraint with iterative Stochastic Gradient Descent toolbox to effectively fit our GPAC module into previous ZSL models. Extensive experiments on five popular datasets show that our method can effectively correct attributes and make conventional ZSL can achieve state-of-the-art performance on GZSL tasks. It is also a good practice for future models when incorporating prior human knowledge.
|Full text:||Publisher-imposed embargo until 05 December 2022. |
(AM) Accepted Manuscript
Available under License - Creative Commons Attribution Non-commercial No Derivatives 4.0.
File format - PDF (1038Kb)
|Publisher Web site:||https://doi.org/10.1016/j.patcog.2020.107767|
|Publisher statement:||© 2021 This manuscript version is made available under the CC-BY-NC-ND 4.0 license http://creativecommons.org/licenses/by-nc-nd/4.0/|
|Date accepted:||25 November 2020|
|Date deposited:||26 May 2021|
|Date of first online publication:||05 December 2020|
|Date first made open access:||05 December 2022|
Save or Share this output
|Look up in GoogleScholar|