Charting Beyond Sight with DataStory: Sensory Substitution and Storytelling in Visual Literacy Education for Visually Impaired Children

  • Yu, L. (Speaker)
  • Shuqi He (Speaker)

Activity: Talk or presentationPresentation at conference/workshop/seminar

Description

Visualizations transform raw data into accessible insights. However, they often exclude the visually impaired community. Despite tools like alt-texts and screen readers for translating visual information, visual literacy remains a fundamental barrier to interpreting visual data. Standard visual literacy education is less accessible to visually impaired learners. Our study explores visualization education through alternative sensory channels for visually impaired students. This work has three main contributions: examining educational practices for visually impaired students at a special education school; defining design requirements focused on sensory substitution; and developing a storytelling-based assistive learning prototype. The final design, DataStory, is a tactile storybook with embedded visualizations and sonified data narratives. To evaluate its feasibility, we conducted a pilot study with proxy students and a special education teacher. The paper concludes with a discussion on limitations and future directions in assistive visualization education, promoting further research into equitable educational tools for visually impaired children.
Period15 May 2024
Event title2024 ACM CHI Conference on Human Factors in Computing Systems (CHI 2024)
Event typeConference
LocationHonolulu, United States, HawaiiShow on map
Degree of RecognitionInternational