Skip to main content

Research Repository

Advanced Search

A Mixed Reality Training System for Hand-Object Interaction in Simulated Microgravity Environments

Zhou, Kanglei; Chen, Chen; Ma, Yue; Leng, Zhiying; Shum, Hubert P.H.; Li, Frederick W.B.; Liang, Xiaohui

A Mixed Reality Training System for Hand-Object Interaction in Simulated Microgravity Environments Thumbnail


Authors

Kanglei Zhou

Chen Chen

Yue Ma

Zhiying Leng

Xiaohui Liang



Abstract

As human exploration of space continues to progress, the use of Mixed Reality (MR) for simulating microgravity environments and facilitating training in hand-object interaction holds immense practical significance. However, hand-object interaction in microgravity presents distinct challenges compared to terrestrial environments due to the absence of gravity. This results in heightened agility and inherent unpredictability of movements that traditional methods struggle to simulate accurately. To this end, we propose a novel MR-based hand-object interaction system in simulated microgravity environments, leveraging physics-based simulations to enhance the interaction between the user’s real hand and virtual objects. Specifically, we introduce a physics-based hand-object interaction model that combines impulse-based simulation with penetration contact dynamics. This accurately captures the intricacies of hand-object interaction in microgravity. By considering forces and impulses during contact, our model ensures realistic collision responses and enables effective object manipulation in the absence of gravity. The proposed system presents a cost-effective solution for users to simulate object manipulation in microgravity. It also holds promise for training space travelers, equipping them with greater immersion to better adapt to space missions. The system reliability and fidelity test verifies the superior effectiveness of our system compared to the state-of-the-art CLAP system.

Citation

Zhou, K., Chen, C., Ma, Y., Leng, Z., Shum, H. P., Li, F. W., & Liang, X. (2023). A Mixed Reality Training System for Hand-Object Interaction in Simulated Microgravity Environments. In 2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). https://doi.org/10.1109/ISMAR59233.2023.00031

Conference Name ISMAR 23: International Symposium on Mixed and Augmented Reality
Conference Location Sydney, Australia
Start Date Oct 16, 2023
End Date Oct 20, 2023
Acceptance Date Aug 10, 2023
Online Publication Date Dec 4, 2023
Publication Date Dec 4, 2023
Deposit Date Aug 16, 2023
Publicly Available Date Dec 4, 2023
Publisher Institute of Electrical and Electronics Engineers
Series ISSN 1554-7868
Book Title 2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)
ISBN 9798350328394
DOI https://doi.org/10.1109/ISMAR59233.2023.00031
Public URL https://durham-repository.worktribe.com/output/1718617

Files

Accepted Conference Paper (17.7 Mb)
PDF

Copyright Statement
© 2023 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.




You might also like



Downloadable Citations