Cookies

We use cookies to ensure that we give you the best experience on our website. By continuing to browse this repository, you give consent for essential cookies to be used. You can read more about our Privacy and Cookie Policy.


Durham Research Online
You are in:

A probabilistic zero-shot learning method via latent nonnegative prototype synthesis of unseen classes.

Zhang, Haofeng and Mao, Huaqi and Long, Yang and Yang, Wankou and Shao, Ling (2020) 'A probabilistic zero-shot learning method via latent nonnegative prototype synthesis of unseen classes.', IEEE transactions on neural networks and learning systems., 31 (7). pp. 2361-2375.

Abstract

Zero-shot learning (ZSL), a type of structured multioutput learning, has attracted much attention due to its requirement of no training data for target classes. Conventional ZSL methods usually project visual features into semantic space and assign labels by finding their nearest prototypes. However, this type of nearest neighbor search (NNS)-based method often suffers from great performance degradation because of the nonuniform variances between different categories. In this article, we propose a probabilistic framework by taking covariance into account to deal with the above-mentioned problem. In this framework, we define a new latent space, which has two characteristics. The first is that the features in this space should gather within the classes and scatter between the classes, which is implemented by triplet learning; the second is that the prototypes of unseen classes are synthesized with nonnegative coefficients, which are generated by nonnegative matrix factorization (NMF) of relations between the seen classes and the unseen classes in attribute space. During training, the learned parameters are the projection model for triplet network and the nonnegative coefficients between the unseen classes and the seen classes. In the testing phase, visual features are projected into latent space and assigned with the labels that have the maximum probability among unseen classes for classic ZSL or within all classes for generalized ZSL. Extensive experiments are conducted on four popular data sets, and the results show that the proposed method can outperform the state-of-the-art methods in most circumstances.

Item Type:Article
Full text:(AM) Accepted Manuscript
Download PDF
(3133Kb)
Status:Peer-reviewed
Publisher Web site:https://doi.org/10.1109/TNNLS.2019.2955157
Publisher statement:© 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Date accepted:19 November 2019
Date deposited:23 July 2020
Date of first online publication:20 December 2019
Date first made open access:23 July 2020

Save or Share this output

Export:
Export
Look up in GoogleScholar