Chatbots and Art Critique: A Comparative Study of Chatbot and Human Experts in Traditional Chinese Painting Education

Liu, Jinyu; Law, Effie Lai-Chong; Shum, Hubert P. H.

Abstract

Driven by the recent incorporation of chatbots into art education, art critique as a key factor in this realm poses distinct challenges and opportunities for this technology intervention. This study investigates the efficacy of chatbot-generated critiques in art education and compares them to critiques from human specialists. We conducted an empirical analysis by evaluating both chatbot and human critiques of traditional Chinese paintings, focusing on "The Four Gentlemen", plum, orchid, bamboo, and chrysanthemum, representative themes in traditional Chinese art (Figure 1). Traditional Chinese paintings provide an ideal subject for this research owing to their metaphorical meanings and cultural depth, which provides a complex context for evaluating the nuanced capabilities of chatbots and human critiques. Our analysis looked into several critical dimensions of critique quality. The preliminary results suggest that while chatbot critiques are detailed and relevant, they lack the depth and emotional engagement that are characteristic in human critiques. Human critiques appeared to be way more nuanced and contextual with more emphasis on the symbolic and cultural layers of the artwork. The findings of this research signify that chatbots can play a role in art education and elevate the learning experience through immediate and structured critique. However, they are not able to replace the deeper insights offered from human critiques. Accordingly, this study recommends a hybrid approach: chatbots act as a supplementary pedagogical role, enriching art education and critique. The conclusions suggest further research into the integration of chatbots within art educational settings is needed, encouraging refinement of the design and application of chatbots in creative domains.

Citation

Liu, J., Law, E. L.-C., & Shum, H. P. H. (2024, October). Chatbots and Art Critique: A Comparative Study of Chatbot and Human Experts in Traditional Chinese Painting Education. Presented at NordiCHI 2024: Nordic Conference on Human-Computer Interaction, Uppsala Sweden

• Presentation Conference Type: Conference Paper (published)
• Conference Name: NordiCHI 2024: Nordic Conference on Human-Computer Interaction
• Start Date: Oct 13, 2024
• End Date: Oct 16, 2024
• Acceptance Date: Sep 13, 2024
• Online Publication Date: Oct 13, 2024
• Publication Date: 2024-10
• Deposit Date: Dec 9, 2024
• Publicly Available Date: Dec 9, 2024
• Publisher: Association for Computing Machinery (ACM)
• Peer Reviewed: Peer Reviewed
• Pages: 1-13
• Book Title: NordiCHI '24: Proceedings of the 13th Nordic Conference on Human-Computer Interaction
• ISBN: 9798400709661
• DOI: https://doi.org/10.1145/3679318.3685385
• Public URL: https://durham-repository.worktribe.com/output/3212323
• Publisher URL: https://dl.acm.org/doi/proceedings/10.1145/3679318