An end-to-end dynamic point cloud geometry compression in latent space

Jiang, Zhaoyi; Wang, Guoliang; Tam, Gary K. L.; Song, Chao; Yang, Bailin; Li, Frederick W. B.

Abstract

Dynamic point clouds are widely used for 3D data representation in various applications such as immersive and mixed reality, robotics and autonomous driving. However, their irregularity and large scale make efficient compression and transmission a challenge. Existing methods require high bitrates to encode point clouds since temporal correlation is not well considered. This paper proposes an end-to-end dynamic point cloud compression network that operates in latent space, resulting in more accurate motion estimation and more effective motion compensation. Specifically, a multi-scale motion estimation network is introduced to obtain accurate motion vectors. Motion information computed at a coarser level is upsampled and warped to the finer level based on cost volume analysis for motion compensation. Additionally, a residual compression network is designed to mitigate the effects of noise and inaccurate predictions by encoding latent residuals, resulting in smaller conditional entropy and better results. The proposed method achieves an average 12.09% and 14.76% (D2) BD-Rate gain over state-of-the-art Deep Dynamic Point Cloud Compression (D-DPCC) in experimental results. Compared to V-PCC, our framework showed an average improvement of 81.29% (D1) and 77.57% (D2).

Citation

Jiang, Z., Wang, G., Tam, G. K. L., Song, C., Yang, B., & Li, F. W. B. (2023). An end-to-end dynamic point cloud geometry compression in latent space. Displays, 80, Article 102528. https://doi.org/10.1016/j.displa.2023.102528

• Journal Article Type: Article
• Acceptance Date: Aug 28, 2023
• Online Publication Date: Sep 14, 2023
• Publication Date: 2023-12
• Deposit Date: Sep 12, 2023
• Publicly Available Date: Sep 20, 2023
• Journal: Displays
• Print ISSN: 0141-9382
• Publisher: Elsevier
• Peer Reviewed: Peer Reviewed
• Volume: 80
• Article Number: 102528
• DOI: https://doi.org/10.1016/j.displa.2023.102528
• Public URL: https://durham-repository.worktribe.com/output/1735649