Semi-Automated Annotation of Audible Home Activities

M. Garcia-Constantino*, J. Beltran-Marquez, D. Cruz-Sandoval, I. H. Lopez-Nava, J. Favela, A. Ennis, C. Nugent, J. Rafferty, I. Cleland, J. Synnott, N. Hernandez-Cruz

*Corresponding author for this work

Research output: Chapter in Book or Report/Conference proceedingConference Proceedingpeer-review

3 Citations (Scopus)

Abstract

Data annotation is the process of segmenting and labelling any type of data (images, audio or text). It is an important task for producing reliable datasets that can be used to train machine learning algorithms for the purpose of Activity Recognition. This paper presents the work in progress towards a semi-automated approach for collecting and annotating audio data from simple sounds that are typically produced at home when people perform daily activities, for example the sound of running water when a tap is open. We propose the use of an app called ISSA (Intelligent System for Sound Annotation) running on smart microphones to facilitate the semi-automated annotation of audible activities. When a sound is produced, the app tries to classify the activity and notifies the user, who can correct the classification and/or provide additional information such as the location of the sound. To illustrate the feasibility of the approach, an initial version of ISSA was implemented to train an audio classifier in a one-bedroom apartment.

Original languageEnglish
Title of host publication2019 IEEE International Conference on Pervasive Computing and Communications Workshops, PerCom Workshops 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages40-45
Number of pages6
ISBN (Electronic)9781538691519
DOIs
Publication statusPublished - Mar 2019
Externally publishedYes
Event2019 IEEE International Conference on Pervasive Computing and Communications Workshops, PerCom Workshops 2019 - Kyoto, Japan
Duration: 11 Mar 201915 Mar 2019

Publication series

Name2019 IEEE International Conference on Pervasive Computing and Communications Workshops, PerCom Workshops 2019

Conference

Conference2019 IEEE International Conference on Pervasive Computing and Communications Workshops, PerCom Workshops 2019
Country/TerritoryJapan
CityKyoto
Period11/03/1915/03/19

Keywords

  • Activity Recognition
  • Data Annotation
  • Data Collection
  • Smart Microphones

Fingerprint

Dive into the research topics of 'Semi-Automated Annotation of Audible Home Activities'. Together they form a unique fingerprint.

Cite this