AirTouch (2010) | Seungyon Claire Lee

Previous Next 1 of 3

AirTouch (2010)


Wearable Computing
Synchronizing in-air hand gesture and on-body tactile feedback for on-the-go interaction

AirTouch is designed to compensate limited visual attention on mobile gesture interaction by synchronizing gestural input and tactile feedback on a wristwatch interface. AirTouch is supported by a push-to-gesture mechanism (PTG) to allow more control to the users: preview and cancel/confirm the gesture through the sense of touch before executing the command.

The effect of the new PTG mechanism and tactile feedback are evaluated through two experiments. The first experiment compares AirTouch’s PTG mechanism (new) to that of existing wrist-worn gesture interface, the Gesture Watch (old), both with and without visual access to the watch. The second experiment examines mobile gesture interaction with the new PTG mechanism in four conditions (with and without tactile feedback and with and without visual restriction).

The result shows that the new PTG mechanism enabled more accurate and faster interaction in the fully visible condition. Additionally, tactile feedback in the limited visual access condition successfully compensated for the lack of visual feedback, enabling similar performance times and perceived difficulties as in the fully visible condition without tactile feedback.

Additionally, the binary perception of the tactile feedback on the gestural input guides the design iteration for the watch interface (e.g., sensor and vibrating motor layout).

Design/Prototyping

Synchronous sensors-motor layout, 3D printing, rubber molding

Implementation/Programming

Java with Gesture and Activity Recognition Toolkit (GART)

Evaluation

In-lab experiment with on-the-go setting, observation, interview, statistical analysis

Related Publications
  • AirTouch: Synchronizing In-air Hand Gesture and On-body Tactile Feedback to Augment Mobile Gesture Interaction, Lee, S. C., Li, B., and Starner, T., In Proceedings of the IEEE International Symposium on Wearable Computers, ISWC’11, June, 2011.
  • Improving Form Factor Design of Mobile Gesture Interface on the Wrist, Deen, J., Lee, S. C., Li, B., and Starner, T., In Proceedings of the ACM SIGCHI Conference Extended Abstracts on Human Factors in Computing Systems, CHI EA’10, April, 2010.
  • Mobile Gesture Interaction Using Wearable Tactile Displays, Lee, S. C. and Starner, T., In Proceedings of the ACM SIGCHI Conference Extended Abstracts on Human Factors in Computing Systems, CHI EA’09, April, 2009.
Close

Sorry, your browser is not supported. Please try with other version or browser.