Chatbots for Active Learning: A Case of Phishing Email Identification

Hobert, Sebastian; Følstad, Asbjørn; Law, Effie Lai-Chong

Abstract

Chatbots represent a promising approach to provide instructional content and facilitate active learning processes. However, there is a lack of knowledge as how to design chatbot interactions for active learning. In response to this knowledge gap, we conducted an experimental study (n = 164) comparing four modes for providing instructional content in chatbots, with varying demands for cognitive engagement. The four modes – passive, active, constructive, and interactive – were based on the ICAP framework of active learning. The learning content concerned identification of phishing emails and the four modes were distinguished by how the participants were invited to engage with the content during their chatbot interaction. The ICAP modes of higher cognitive engagement required participants to spend more time on the interaction and led to perceptions of higher subjective learning outcome. However, the effects of the different ICAP modes were not found to be significantly different in terms of user engagement, social presence, intention to use, or objective learning outcomes. The study represents an important first step towards understanding the design of chatbots for active learning.

Citation

Hobert, S., Følstad, A., & Law, E. L. (2023). Chatbots for Active Learning: A Case of Phishing Email Identification. International Journal of Human-Computer Studies, 179, Article 103108. https://doi.org/10.1016/j.ijhcs.2023.103108

• Journal Article Type: Article
• Acceptance Date: Jul 12, 2023
• Online Publication Date: Jul 19, 2023
• Publication Date: 2023-11
• Deposit Date: Aug 2, 2023
• Publicly Available Date: Aug 2, 2023
• Journal: International Journal of Human-Computer Studies
• Print ISSN: 1071-5819
• Publisher: Elsevier
• Peer Reviewed: Peer Reviewed
• Volume: 179
• Article Number: 103108
• DOI: https://doi.org/10.1016/j.ijhcs.2023.103108
• Keywords: Hardware and Architecture; Human-Computer Interaction; General Engineering; Education; Human Factors and Ergonomics; Software
• Public URL: https://durham-repository.worktribe.com/output/1709965