See-Shop System: An Assistive Outdoor Navigation System for the Visual Impaired Based on Deep Learning Methods

Junjie Wang, Shanshan Zhao*

*Corresponding author for this work

Research output: Chapter in Book or Report/Conference proceedingConference Proceedingpeer-review

Abstract

Visually impaired and blind individuals often encounter challenges in locating stores on the street, requiring guidance to ensure their daily activities are safe and effective. The objective of this study is to develop an assisted navigation system based on real-time semantic segmentation and Chinese text recognition. The proposed system aims to assist visually impaired individuals in obtaining information about the relative location of stores. It is highly user-friendly and can provide coordinate references in unfamiliar environments, aiding them in various activities like navigation and purchasing. In this work, we utilize the BiseNet v2 network, a real-time semantic segmentation model, to identify and detect shop sign objects. Additionally, we employ PP-OCR v3, an ultra-lightweight Optical Character Recognition (OCR) network, for Chinese text recognition. Furthermore, the system incorporates a speech broadcast function to convert visual information into auditory feedback. By providing real -time support for visually impaired individuals, this assistive navigation application demonstrates great potential in promoting public welfare.

Original languageEnglish
Title of host publicationProceedings - 2023 International Conference on Advanced Enterprise Information System, AEIS 2023
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages16-20
Number of pages5
ISBN (Electronic)9798350359268
DOIs
Publication statusPublished - 2023
Event3rd International Conference on Advanced Enterprise Information System, AEIS 2023 - Hybrid, London, United Kingdom
Duration: 1 Dec 20233 Dec 2023

Publication series

NameProceedings - 2023 International Conference on Advanced Enterprise Information System, AEIS 2023

Conference

Conference3rd International Conference on Advanced Enterprise Information System, AEIS 2023
Country/TerritoryUnited Kingdom
CityHybrid, London
Period1/12/233/12/23

Keywords

  • Assistive Navigation
  • BiseNet v2
  • Computer Vision
  • PP-OCR v3
  • Segmantation
  • Shop sign recognition
  • Visually impaired and blind people
  • morphological operations

Fingerprint

Dive into the research topics of 'See-Shop System: An Assistive Outdoor Navigation System for the Visual Impaired Based on Deep Learning Methods'. Together they form a unique fingerprint.

Cite this