Skip to main navigation Skip to search Skip to main content

Charting Beyond Sight with DataStory: Sensory Substitution and Storytelling in Visual Literacy Education for Visually Impaired Children

  • Shuqi He
  • , Lingyun Yu*
  • *Corresponding author for this work
    • Xi'an Jiaotong-Liverpool University

    Research output: Chapter in Book or Report/Conference proceedingConference Proceedingpeer-review

    3 Citations (Scopus)

    Abstract

    Visualizations transform raw data into accessible insights. However, they often exclude the visually impaired community. Despite tools like alt-texts and screen readers for translating visual information, visual literacy remains a fundamental barrier to interpreting visual data. Standard visual literacy education is less accessible to visually impaired learners. Our study explores visualization education through alternative sensory channels for visually impaired students. This work has three main contributions: examining educational practices for visually impaired students at a special education school; defining design requirements focused on sensory substitution; and developing a storytelling-based assistive learning prototype. The final design, DataStory, is a tactile storybook with embedded visualizations and sonified data narratives. To evaluate its feasibility, we conducted a pilot study with proxy students and
    a special education teacher. The paper concludes with a discussion on limitations and future directions in assistive visualization education, promoting further research into equitable educational tools for visually impaired children.
    Original languageEnglish
    Title of host publicationCHI 2024 - Extended Abstracts of the 2024 CHI Conference on Human Factors in Computing Sytems
    PublisherAssociation for Computing Machinery
    ISBN (Electronic)9798400703317
    DOIs
    Publication statusPublished - 11 May 2024
    Event2024 CHI Conference on Human Factors in Computing Systems: CHI'24 - Honolulu, United States
    Duration: 11 May 202416 May 2024

    Publication series

    NameConference on Human Factors in Computing Systems - Proceedings

    Conference

    Conference2024 CHI Conference on Human Factors in Computing Systems
    Country/TerritoryUnited States
    CityHonolulu
    Period11/05/2416/05/24

    Keywords

    • Assistive learning technologies
    • Sensory substitution
    • Storytelling
    • Visually impaired education

    Fingerprint

    Dive into the research topics of 'Charting Beyond Sight with DataStory: Sensory Substitution and Storytelling in Visual Literacy Education for Visually Impaired Children'. Together they form a unique fingerprint.

    Cite this