Dr Amir Atapour-Abarghouei amir.atapour-abarghouei@durham.ac.uk
Assistant Professor
Back to Butterworth - a Fourier Basis for 3D Surface Relief Hole Filling within RGB-D Imagery
Atapour-Abarghouei, Amir; de La Garanderie, Gregoire Payen; Breckon, Toby P.
Authors
Gregoire Payen de La Garanderie
Professor Toby Breckon toby.breckon@durham.ac.uk
Professor
Abstract
We address the problem of hole filling in RGB-D (color and depth) images, obtained from either active or stereo based sensing, for the purposes of object removal and missing depth estimation. This is performed independently on the low frequency depth information (surface shape) and the high frequency depth detail (relief) by way of a Fourier space transform and classical Butterworth high/low pass filtering. The high frequency detail is then filled using a texture synthesis method, whilst the low frequency shape information is inpainted using structural inpainting. Here, a classical non-parametric sampling approach is extended, using the concept of query expansion, to perform high frequency depth synthesis with the final output then recombined in Fourier space. In order to improve the overall depth relief (D) and edge detail accuracy, color information (RGB) is also used to constrain the sampling process within high frequency component completion. Experimental results demonstrate the efficacy of the proposed method outperforming prior work for generalized depth filling in the presence of high frequency surface relief detail.
Presentation Conference Type | Conference Paper (Published) |
---|---|
Conference Name | 2016 23rd International Conference on Pattern Recognition (ICPR) |
Start Date | Dec 4, 2016 |
End Date | Dec 8, 2016 |
Online Publication Date | Apr 24, 2017 |
Publication Date | 2016 |
Deposit Date | Oct 12, 2018 |
Publicly Available Date | Nov 29, 2021 |
Publisher | Institute of Electrical and Electronics Engineers |
Pages | 2813-2818 |
Book Title | Proc. Int. Conf. on Pattern Recognition |
DOI | https://doi.org/10.1109/ICPR.2016.7900062 |
Keywords | depth filling, RGB-D, surface relief, Fourier, DFT, hole filling, surface completion, frequency domain, 3D texture, depth completion, query expansion, depth map, texture synthesis, disparity hole filling, Butterworth filtering |
Public URL | https://durham-repository.worktribe.com/output/1143773 |
Files
Accepted Conference Proceeding
(3 Mb)
PDF
Copyright Statement
© 2016 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
You might also like
Region-based Appearance and Flow Characteristics for Anomaly Detection in Infrared Surveillance Imagery
(2023)
Presentation / Conference Contribution
Predicting the Performance of a Computing System with Deep Networks
(2023)
Presentation / Conference Contribution
Siamese Neural Networks for Skin Cancer Classification and New Class Detection using Clinical and Dermoscopic Image Datasets
(2022)
Presentation / Conference Contribution
A Feasibility Study on Image Inpainting for Non-cleft Lip Generation from Patients with Cleft Lip
(2022)
Presentation / Conference Contribution
Detecting Melanoma Fairly: Skin Tone Detection and Debiasing for Skin Lesion Classification
(2022)
Presentation / Conference Contribution
Downloadable Citations
About Durham Research Online (DRO)
Administrator e-mail: dro.admin@durham.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search