Charting Beyond Sight with DataStory: Sensory Substitution and Storytelling in Visual Literacy Education for Visually Impaired Children

Shuqi He, Lingyun Yu*

*Corresponding author for this work

Research output: Chapter in Book or Report/Conference proceedingConference Proceedingpeer-review

Abstract

Visualizations transform raw data into accessible insights. However, they often exclude the visually impaired community. Despite tools like alt-texts and screen readers for translating visual information, visual literacy remains a fundamental barrier to interpreting visual data. Standard visual literacy education is less accessible to visually impaired learners. Our study explores visualization education through alternative sensory channels for visually impaired students. This work has three main contributions: examining educational practices for visually impaired students at a special education school; defining design requirements focused on sensory substitution; and developing a storytelling-based assistive learning prototype. The final design, DataStory, is a tactile storybook with embedded visualizations and sonified data narratives. To evaluate its feasibility, we conducted a pilot study with proxy students and
a special education teacher. The paper concludes with a discussion on limitations and future directions in assistive visualization education, promoting further research into equitable educational tools for visually impaired children.
Original languageEnglish
Title of host publicationCHI 2024 - Extended Abstracts of the 2024 CHI Conference on Human Factors in Computing Sytems
PublisherAssociation for Computing Machinery
ISBN (Electronic)9798400703317
DOIs
Publication statusPublished - 11 May 2024
Event2024 CHI Conference on Human Factors in Computing Systems: CHI'24 - Honolulu, United States
Duration: 11 May 202416 May 2024

Publication series

NameConference on Human Factors in Computing Systems - Proceedings

Conference

Conference2024 CHI Conference on Human Factors in Computing Systems
Country/TerritoryUnited States
CityHonolulu
Period11/05/2416/05/24

Keywords

  • Assistive learning technologies
  • Sensory substitution
  • Storytelling
  • Visually impaired education

Fingerprint

Dive into the research topics of 'Charting Beyond Sight with DataStory: Sensory Substitution and Storytelling in Visual Literacy Education for Visually Impaired Children'. Together they form a unique fingerprint.

Cite this