Hua Ma
Towards empathic medical conversation in Narrative Medicine: A visualization approach based on intelligence augmentation
Ma, Hua; Law, Effie Lai-Chong; Sun, Xu; Yang, Weili; He, Xiangjian; Lawson, Glyn; Zheng, Huizhong; Wang, Qingfeng; Li, Qiang; Yuan, Xiaoru
Authors
Professor Effie Law lai-chong.law@durham.ac.uk
Professor in Computer Science
Xu Sun
Weili Yang
Xiangjian He
Glyn Lawson
Huizhong Zheng
Qingfeng Wang
Qiang Li
Xiaoru Yuan
Abstract
Empathic medical conversation is central to patient-centered care within Narrative Medicine. However, difficulties, such as physicians’ limited empathic capabilities and lack of time, impede the practice. Research on real-time, on-site empathic medical exchanges has been limited in exploring technology to assist and enhance physicians’ capabilities. This paper proposed the Empathic Opportunity Perception and Distinction (EOPD) framework for building physician-AI collaboration based on Intelligence Augmentation (IA) for empathic conversations. The EOPD integrates two multi-modal machine learning (ML) models based on facial and verbal cues, presenting a physician-AI interaction framework and three distinctive visualization components: emotional reference, opportunity reminding and keyword collection, and situation understanding. To assess EOPD's effectiveness and gauge physicians’ and patients’ receptiveness, a prototype system named EMVIS (EMotional VISualization) was designed and developed. Results from the study demonstrated improvements in physicians’ empathy efforts and perceived empathy performance when using EMVIS, particularly for junior physicians. Physicians and patients held positive attitudes towards EMVIS, with patients expressing a high expectation that EMVIS would improve the physician-patient relationship. The research showed the efficacy of the multi-modal ML models in supporting complex affective empathy and EMVIS in facilitating and complementing empathy concerns. It highlighted the tailored support to junior and senior physicians and emphasized physician-AI collaboration to maintain user autonomy and mitigate potential biases. Future research should explore extensive system applications, tailor visual and interactive support for physicians, and implement adaptive and reflective ML models to improve the effectiveness and efficiency of empathy communications.
Citation
Ma, H., Law, E. L.-C., Sun, X., Yang, W., He, X., Lawson, G., Zheng, H., Wang, Q., Li, Q., & Yuan, X. (2025). Towards empathic medical conversation in Narrative Medicine: A visualization approach based on intelligence augmentation. International Journal of Human-Computer Studies, 199, Article 103506. https://doi.org/10.1016/j.ijhcs.2025.103506
Journal Article Type | Article |
---|---|
Acceptance Date | Mar 25, 2025 |
Online Publication Date | Apr 4, 2025 |
Publication Date | 2025-05 |
Deposit Date | Apr 26, 2025 |
Publicly Available Date | May 9, 2025 |
Journal | International Journal of Human Computer Studies |
Print ISSN | 1071-5819 |
Publisher | Elsevier |
Peer Reviewed | Peer Reviewed |
Volume | 199 |
Article Number | 103506 |
DOI | https://doi.org/10.1016/j.ijhcs.2025.103506 |
Public URL | https://durham-repository.worktribe.com/output/3804413 |
Files
Published Journal Article
(5.9 Mb)
PDF
Publisher Licence URL
http://creativecommons.org/licenses/by-nc/4.0/
You might also like
Trustworthy Autonomous Systems Through Verifiability
(2023)
Journal Article
Building a three-level multimodal emotion recognition framework
(2022)
Journal Article
Future directions for chatbot research: an interdisciplinary research agenda
(2021)
Journal Article
How easy is it to eXtend Reality? A Usability Study of Authoring Toolkits
(2022)
Book Chapter