Skip to main content

Research Repository

Advanced Search

A Joint Label Space for Generalized Zero-Shot Classification

Li, Jin; Lan, Xuguang; Long, Yang; Liu, Yang; Chen, Xingyu; Shao, Ling; Zheng, Nanning

A Joint Label Space for Generalized Zero-Shot Classification Thumbnail


Authors

Jin Li

Xuguang Lan

Yang Liu

Xingyu Chen

Ling Shao

Nanning Zheng



Abstract

The fundamental problem of Zero-Shot Learning (ZSL) is that the one-hot label space is discrete, which leads to a complete loss of the relationships between seen and unseen classes. Conventional approaches rely on using semantic auxiliary information, e.g. attributes, to re-encode each class so as to preserve the inter-class associations. However, existing learning algorithms only focus on unifying visual and semantic spaces without jointly considering the label space. More importantly, because the final classification is conducted in the label space through a compatibility function, the gap between attribute and label spaces leads to significant performance degradation. Therefore, this paper proposes a novel pathway that uses the label space to jointly reconcile visual and semantic spaces directly, which is named Attributing Label Space (ALS). In the training phase, one-hot labels of seen classes are directly used as prototypes in a common space, where both images and attributes are mapped. Since mappings can be optimized independently, the computational complexity is extremely low. In addition, the correlation between semantic attributes has less influence on visual embedding training because features are mapped into labels instead of attributes. In the testing phase, the discrete condition of label space is removed, and priori one-hot labels are used to denote seen classes and further compose labels of unseen classes. Therefore, the label space is very discriminative for the Generalized ZSL (GZSL), which is more reasonable and challenging for real-world applications. Extensive experiments on five benchmarks manifest improved performance over all of compared state-of-the-art methods.

Citation

Li, J., Lan, X., Long, Y., Liu, Y., Chen, X., Shao, L., & Zheng, N. (2020). A Joint Label Space for Generalized Zero-Shot Classification. IEEE Transactions on Image Processing, 29, 5817-5831. https://doi.org/10.1109/tip.2020.2986892

Journal Article Type Article
Online Publication Date Apr 15, 2020
Publication Date 2020
Deposit Date Apr 8, 2020
Publicly Available Date Mar 28, 2024
Journal IEEE Transactions on Image Processing
Print ISSN 1057-7149
Electronic ISSN 1941-0042
Publisher Institute of Electrical and Electronics Engineers
Peer Reviewed Peer Reviewed
Volume 29
Pages 5817-5831
DOI https://doi.org/10.1109/tip.2020.2986892

Files

Accepted Journal Article (1.9 Mb)
PDF

Copyright Statement
© 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.





You might also like



Downloadable Citations