Zhang, Haofeng and Mao, Huaqi and Long, Yang and Yang, Wankou and Shao, Ling (2020) 'A probabilistic zero-shot learning method via latent nonnegative prototype synthesis of unseen classes.', IEEE transactions on neural networks and learning systems., 31 (7). pp. 2361-2375.
Zero-shot learning (ZSL), a type of structured multioutput learning, has attracted much attention due to its requirement of no training data for target classes. Conventional ZSL methods usually project visual features into semantic space and assign labels by finding their nearest prototypes. However, this type of nearest neighbor search (NNS)-based method often suffers from great performance degradation because of the nonuniform variances between different categories. In this article, we propose a probabilistic framework by taking covariance into account to deal with the above-mentioned problem. In this framework, we define a new latent space, which has two characteristics. The first is that the features in this space should gather within the classes and scatter between the classes, which is implemented by triplet learning; the second is that the prototypes of unseen classes are synthesized with nonnegative coefficients, which are generated by nonnegative matrix factorization (NMF) of relations between the seen classes and the unseen classes in attribute space. During training, the learned parameters are the projection model for triplet network and the nonnegative coefficients between the unseen classes and the seen classes. In the testing phase, visual features are projected into latent space and assigned with the labels that have the maximum probability among unseen classes for classic ZSL or within all classes for generalized ZSL. Extensive experiments are conducted on four popular data sets, and the results show that the proposed method can outperform the state-of-the-art methods in most circumstances.
|Full text:||(AM) Accepted Manuscript|
Download PDF (3133Kb)
|Publisher Web site:||https://doi.org/10.1109/TNNLS.2019.2955157|
|Publisher statement:||© 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.|
|Date accepted:||19 November 2019|
|Date deposited:||23 July 2020|
|Date of first online publication:||20 December 2019|
|Date first made open access:||23 July 2020|
Save or Share this output
|Look up in GoogleScholar|