Kernelized distance learning for zero-shot recognition

Zarei, Mohammad Reza; Taheri, Mohammad; Long, Yang

Abstract

Zero-Shot Learning (ZSL) has gained growing attention over the past few years mostly because it provides a significant scalability to recognition models for classifying instances from new unobserved classes. This scalability is achieved by providing semantic information about new classes, which could be obtained remarkably easier with lower cost, compared to collecting a new training set. Because seen and unseen classes are completely disjoint, ZSL methods often suffer from domain shift problem that occurs in transferring the knowledge of seen classes to unseen ones. Moreover, hubness problem that usually arises in high-dimensional space is another challenge in most ZSL methods due to applying nearest neighbor search for classification. To address these issues, a kernelized distance function is learned in order to discriminate the classes with a customized large-margin loss function. Furthermore, a simple theoretical-based prototype learning approach is provided by defining a non-linear mapping function to learn the visual prototype of each class from associated semantic information. For classification task, the learned distance function is utilized to measure the distance between instances and class-related prototypes. The evaluation on five benchmarks demonstrates the superiority of the proposed method over the state-of-the-art approaches in both zero-shot and generalized zero-shot learning problems.

Citation

Zarei, M. R., Taheri, M., & Long, Y. (2021). Kernelized distance learning for zero-shot recognition. Information Sciences, 580, 801-818. https://doi.org/10.1016/j.ins.2021.09.032

• Journal Article Type: Article
• Acceptance Date: Sep 11, 2021
• Online Publication Date: Sep 14, 2021
• Publication Date: 2021-11
• Deposit Date: Nov 25, 2021
• Publicly Available Date: Sep 14, 2022
• Journal: Information Sciences
• Print ISSN: 0020-0255
• Publisher: Elsevier
• Peer Reviewed: Peer Reviewed
• Volume: 580
• Pages: 801-818
• DOI: https://doi.org/10.1016/j.ins.2021.09.032
• Public URL: https://durham-repository.worktribe.com/output/1220951