Skip to main content

Research Repository

Advanced Search

A Unified Deep Metric Representation for Mesh Saliency Detection and Non-rigid Shape Matching

Hu, Shanfeng; Shum, Hubert; Aslam, Nauman; Li, Frederick W.B.; Liang, Xiaohui

A Unified Deep Metric Representation for Mesh Saliency Detection and Non-rigid Shape Matching Thumbnail


Shanfeng Hu

Nauman Aslam

Xiaohui Liang


In this paper, we propose a deep metric for unifying the representation of mesh saliency detection and non-rigid shape matching. While saliency detection and shape matching are two closely related and fundamental tasks in shape analysis, previous methods approach them separately and independently, failing to exploit their mutually beneficial underlying relationship. In view of the existing gap between saliency and matching, we propose to solve them together using a unified metric representation of surface meshes. We show that saliency and matching can be rigorously derived from our representation as the principal eigenvector and the smoothed Laplacian eigenvectors respectively. Learning the representation jointly allows matching to improve the deformation-invariance of saliency while allowing saliency to improve the feature localization of matching. To parameterize the representation from a mesh, we also propose a deep recurrent neural network (RNN) for effectively integrating multi-scale shape features and a soft-thresholding operator for adaptively enhancing the sparsity of saliency. Results show that by jointly learning from a pair of saliency and matching datasets, matching improves the accuracy of detected salient regions on meshes, which is especially obvious for small-scale saliency datasets, such as those having one to two meshes. At the same time, saliency improves the accuracy of shape matchings among meshes with reduced matching errors on surfaces.


Hu, S., Shum, H., Aslam, N., Li, F. W., & Liang, X. (2020). A Unified Deep Metric Representation for Mesh Saliency Detection and Non-rigid Shape Matching. IEEE Transactions on Multimedia, 22(9), 2278-2292.

Journal Article Type Article
Acceptance Date Nov 4, 2019
Online Publication Date Nov 11, 2019
Publication Date 2020-09
Deposit Date Nov 12, 2019
Publicly Available Date Nov 12, 2019
Journal IEEE Transactions on Multimedia
Print ISSN 1520-9210
Publisher Institute of Electrical and Electronics Engineers
Peer Reviewed Peer Reviewed
Volume 22
Issue 9
Pages 2278-2292


Accepted Journal Article (8.5 Mb)

Copyright Statement
© 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.

You might also like

Downloadable Citations