Skip to main content

Research Repository

Advanced Search

An end-to-end dynamic point cloud geometry compression in latent space

Jiang, Zhaoyi; Wang, Guoliang; Tam, Gary K. L.; Song, Chao; Yang, Bailin; Li, Frederick W. B.

An end-to-end dynamic point cloud geometry compression in latent space Thumbnail


Authors

Zhaoyi Jiang

Guoliang Wang

Gary K. L. Tam

Chao Song

Bailin Yang



Abstract

Dynamic point clouds are widely used for 3D data representation in various applications such as immersive and mixed reality, robotics and autonomous driving. However, their irregularity and large scale make efficient compression and transmission a challenge. Existing methods require high bitrates to encode point clouds since temporal correlation is not well considered. This paper proposes an end-to-end dynamic point cloud compression network that operates in latent space, resulting in more accurate motion estimation and more effective motion compensation. Specifically, a multi-scale motion estimation network is introduced to obtain accurate motion vectors. Motion information computed at a coarser level is upsampled and warped to the finer level based on cost volume analysis for motion compensation. Additionally, a residual compression network is designed to mitigate the effects of noise and inaccurate predictions by encoding latent residuals, resulting in smaller conditional entropy and better results. The proposed method achieves an average 12.09% and 14.76% (D2) BD-Rate gain over state-of-the-art Deep Dynamic Point Cloud Compression (D-DPCC) in experimental results. Compared to V-PCC, our framework showed an average improvement of 81.29% (D1) and 77.57% (D2).

Citation

Jiang, Z., Wang, G., Tam, G. K. L., Song, C., Yang, B., & Li, F. W. B. (2023). An end-to-end dynamic point cloud geometry compression in latent space. Displays, 80, Article 102528. https://doi.org/10.1016/j.displa.2023.102528

Journal Article Type Article
Acceptance Date Aug 28, 2023
Online Publication Date Sep 14, 2023
Publication Date 2023-12
Deposit Date Sep 12, 2023
Publicly Available Date Sep 20, 2023
Journal Displays
Print ISSN 0141-9382
Publisher Elsevier
Peer Reviewed Peer Reviewed
Volume 80
Article Number 102528
DOI https://doi.org/10.1016/j.displa.2023.102528
Public URL https://durham-repository.worktribe.com/output/1735649

Files




You might also like



Downloadable Citations