A multiscale optimisation algorithm for shape and material reconstruction from a single X-ray image

Westmacott, Henry; Ivrissimtzis, Ioannis; Weinzierl, Tobias

Abstract

We produce thickness and bone to soft tissue ratio estimations from a single, 2D medical X-ray image. For this, we simulate the scattering of the rays through a model of the object and embed this simulation into an optimiser which iteratively adjusts the model to match the X-ray simulation to the observed X-ray image. Utilising a combination of different techniques, first, a CNN-based image segmentation serves as a regularisation term to the underlying cost function to guide the descent, while domain knowledge about physical parameter correlations is injected by additional penalty terms. Next, the optimiser is embedded into a multilevel framework which, similar to multi-grid's philosophy, successively improves the model on varying resolutions while individual resolutions focus on particular terms of the cost function. Initial results suggest that we can obtain meaningful thickness and material estimations.

Citation

Westmacott, H., Ivrissimtzis, I., & Weinzierl, T. (2024, January). A multiscale optimisation algorithm for shape and material reconstruction from a single X-ray image. Presented at ICIGP 2024: The 7th International Conference on Image and Graphics Processing, Beijing, China

• Presentation Conference Type: Conference Paper (published)
• Conference Name: ICIGP 2024: The 7th International Conference on Image and Graphics Processing
• Start Date: Jan 19, 2024
• End Date: Jan 21, 2024
• Acceptance Date: Oct 27, 2023
• Online Publication Date: May 3, 2024
• Publication Date: 2024-01
• Deposit Date: Jan 4, 2024
• Publicly Available Date: May 8, 2024
• Publisher: Association for Computing Machinery (ACM)
• Peer Reviewed: Peer Reviewed
• Pages: 252-259
• Book Title: ICIGP '24: Proceedings of the 2024 7th International Conference on Image and Graphics Processing
• ISBN: 9798400716720
• DOI: https://doi.org/10.1145/3647649.3647690
• Keywords: CCS Concepts: • Mathematics of computing → Optimization with randomized search heuristics; • Computing methodologies → Regularization; Reconstruction Additional Key Words and Phrases: X-ray simulation, model reconstruction, material estimation, gr
• Public URL: https://durham-repository.worktribe.com/output/1929960