User-defined surface+motion gestures for 3D manipulation of objects at a distance through a mobile device

Hai Ning Liang*, Cary Williams, Myron Semegen, Wolfgang Stuerzlinger, Pourang Irani

*Corresponding author for this work

Research output: Chapter in Book or Report/Conference proceedingConference Proceedingpeer-review

32 Citations (Scopus)

Abstract

One form of input for interacting with large shared surfaces is through mobile devices. These personal devices provide interactive displays as well as numerous sensors to effectuate gestures for input. We examine the possibility of using surface and motion gestures on mobile devices for interacting with 3D objects on large surfaces. If effective use of such devices is possible over large displays, then users can collaborate and carry out complex 3D manipulation tasks, which are not trivial to do. In an attempt to generate design guidelines for this type of interaction, we conducted a guessability study with a dual-surface concept device, which provides users access to information through both its front and back. We elicited a set of end-user surface- and motion-based gestures. Based on our results, we demonstrate reasonably good agreement between gestures for choice of sensory (i.e. tilt), multi-touch and dual-surface input. In this paper we report the results of the guessability study and the design of the gesture-based interface for 3D manipulation.

Original languageEnglish
Title of host publicationAPCHI'12 - Proceedings of the 2012 Asia Pacific Conference on Computer-Human Interaction
PublisherAssociation for Computing Machinery
Pages299-308
Number of pages10
ISBN (Print)9781450314961
DOIs
Publication statusPublished - 2012
Event10th Asia-Pacific Conference on Computer-Human Interaction, APCHI 2012 - Matsue-city, Shimane, Japan
Duration: 28 Aug 201231 Aug 2012

Publication series

NameAPCHI'12 - Proceedings of the 2012 Asia Pacific Conference on Computer-Human Interaction

Conference

Conference10th Asia-Pacific Conference on Computer-Human Interaction, APCHI 2012
Country/TerritoryJapan
CityMatsue-city, Shimane
Period28/08/1231/08/12

Keywords

  • 3D visualizations
  • Collaboration interfaces
  • Input devices
  • Interaction techniques
  • Mobile devices
  • Motion gestures
  • Multi-display environments
  • Surface gestures

Cite this