Tangible progress: Employing visual metaphors and physical interfaces in AI-based English language learning

In this study, we aim to explore an interactive system that integrates visual metaphors, AI-powered essay scoring techniques, and tangible feedback to enhance students' English language learning experience. Over the past decade, AI has made significant strides across various domains, including education. A prominent example of this is the integration of AI-driven language learning tools featuring Automated Essay Scoring (AES) systems. Traditionally, AES relied on predefined criteria and provided scores in simple text formats, which often lack depth and fail to engage students in understanding their progress or areas for improvement. To address these limitations and enhance learnability, we propose a system that harnesses AI-powered AES with a visualization approach. Our system includes three main components: an AI-driven scoring algorithm, a visualization interface translating scoring outcomes into visual metaphors, and tangible postcards for presenting scores. To evaluate the usage of our visualization system and tangible-formatted feedback in practice, we conducted domain expert interviews and a three-stage user study. The results indicate that the progressive visual feedback and tangible postcards increased practice frequency and significantly boosted study motivation. Tangible visual feedback showed positive effects on fostering progressive learning. Through this study, we recognized the potential of combining AI, visual metaphors, and tangible feedback in English education to encourage continuous and active learning.