Sumit Singh
Smart Multimodal In-Bed Pose Estimation Framework Incorporating Generative Adversarial Neural Network
Singh, Sumit; Anisi, Mohammad Hossein; Jindal, Anish; Jarchi, Delaram
Authors
Abstract
Monitoring in-bed pose estimation based on the Internet of Medical Things (IoMT) and ambient technology has a significant impact on many applications such as sleep-related disorders including obstructive sleep apnea syndrome, assessment of sleep quality, and health risk of pressure ulcers. In this research, a new multimodal in-bed pose estimation has been proposed using a deep learning framework. The Simultaneously-collected multimodal Lying Pose (SLP) dataset has been used for performance evaluation of the proposed framework where two modalities including long wave infrared (LWIR) and depth images are used to train the proposed model. The main contribution of this research is the feature fusion network and the use of a generative model to generate RGB images having similar poses to other modalities (LWIR/depth). The inclusion of a generative model helps to improve the overall accuracy of the pose estimation algorithm. Moreover, the method can be generalized for situations to recover human pose both in home and hospital settings under various cover thickness levels. The proposed model is compared with other fusion-based models and shows an improved performance of 97.8% at PCKh@0.5. In addition, performance has been evaluated for different cover conditions, and under home and hospital environments which present improvements using our proposed model.
Citation
Singh, S., Anisi, M. H., Jindal, A., & Jarchi, D. (2024). Smart Multimodal In-Bed Pose Estimation Framework Incorporating Generative Adversarial Neural Network. IEEE Journal of Biomedical and Health Informatics, 28(6), 3379 - 3388. https://doi.org/10.1109/jbhi.2024.3384453
Journal Article Type | Article |
---|---|
Acceptance Date | Mar 29, 2024 |
Online Publication Date | Apr 4, 2024 |
Publication Date | 2024-06 |
Deposit Date | Apr 22, 2024 |
Publicly Available Date | Apr 22, 2024 |
Journal | IEEE Journal of Biomedical and Health Informatics |
Print ISSN | 2168-2194 |
Electronic ISSN | 2168-2208 |
Publisher | Institute of Electrical and Electronics Engineers |
Peer Reviewed | Peer Reviewed |
Volume | 28 |
Issue | 6 |
Pages | 3379 - 3388 |
DOI | https://doi.org/10.1109/jbhi.2024.3384453 |
Keywords | Health Information Management; Electrical and Electronic Engineering; Computer Science Applications; Health Informatics |
Public URL | https://durham-repository.worktribe.com/output/2392841 |
Files
Accepted Journal Article
(1.3 Mb)
PDF
Licence
http://creativecommons.org/licenses/by/4.0/
Copyright Statement
This accepted manuscript is licensed under the Creative Commons Attribution 4.0 licence. https://creativecommons.org/licenses/by/4.0/
You might also like
An accurate RSS/AoA-based localization method for internet of underwater things
(2023)
Journal Article
Health Monitoring and Diagnosis for Geo-Distributed Edge Ecosystem in Smart City
(2023)
Journal Article
TRUTH: Trust and Authentication Scheme in 5G-IIoT
(2022)
Journal Article
Downloadable Citations
About Durham Research Online (DRO)
Administrator e-mail: dro.admin@durham.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2025
Advanced Search