A plug-in attribute correction module for generalized zero-shot learning

Zhang, Haofeng; Bai, Haoyue; Long, Yang; Liu, Li; Shao, Ling

Abstract

While Zero Shot Learning models can recognize new classes without training examples, they often fails to incorporate both seen and unseen classes together at the test time, which is known as the Generalized Zero-shot Learning (GZSL) problem. This paper identifies a bottleneck issue when attributes are not well-defined, reliable, inaccurate in quantitative representations, or suffering from the visual-semantic discrepancy. We propose a Generic Plug-in Attribute Correction (GPAC) module which can effectively accommodate conventional ZSL in GZSL tasks. Different from existing embedding-based approaches which often lose the favor of transparency in attributes, our key challenge is to fully preserve the original meaning of the attributes and make it complementary and interpretable to upgrade existing ZSL models. To this end, we propose a novel nonnegative constraint with iterative Stochastic Gradient Descent toolbox to effectively fit our GPAC module into previous ZSL models. Extensive experiments on five popular datasets show that our method can effectively correct attributes and make conventional ZSL can achieve state-of-the-art performance on GZSL tasks. It is also a good practice for future models when incorporating prior human knowledge.

Citation

Zhang, H., Bai, H., Long, Y., Liu, L., & Shao, L. (2021). A plug-in attribute correction module for generalized zero-shot learning. Pattern Recognition, 112, Article 107767. https://doi.org/10.1016/j.patcog.2020.107767

• Journal Article Type: Article
• Acceptance Date: Nov 25, 2020
• Online Publication Date: Dec 5, 2020
• Publication Date: 2021-04
• Deposit Date: May 26, 2021
• Publicly Available Date: Dec 5, 2022
• Journal: Pattern Recognition
• Print ISSN: 0031-3203
• Publisher: Elsevier
• Peer Reviewed: Peer Reviewed
• Volume: 112
• Article Number: 107767
• DOI: https://doi.org/10.1016/j.patcog.2020.107767
• Public URL: https://durham-repository.worktribe.com/output/1247588