CopyCat (2005) | Seungyon Claire Lee

Previous Next 1 of 3

CopyCat (2005)

Wearable Computing
Gesture-based American Sign Language (ASL) game for Deaf children

90% of deaf children are born to hearing parents who may not be fluent in sign language. These children’s first expose to their first language (American Sign Language) often occues at preschool, not at home from birth. Since early childhood is a critical period for language acquisition, this linguistic delay is known as a serious issues on deaf childrens’ linguistic development.

CopyCat is a gesture-based American Sign Language (ASL) game designed to support deaf children’s ASL learning while they play the game. Player’s signed gesture, which is captured by the colored-gloves and wrist-mounted accelerometers, is the main input method to direct the game. In collaboration with Atlanta Area School for the Deaf (AASD), deaf children participated in the user studies to provide feedback and gesture data to train the gesture recognition engine through the Wizard of Oz method.


Iterate game design by on-site experiment




On-site experiment with Wizard of Oz method, focus group discussion, observation

Related publications
  • American sign language recognition in game development for deaf children. Brashear, H., Henderson, V., Park, K., Hamilton, H., Lee, S., and Starner, T. 2006. . In Proceedings of the ACM SIGACCESS Conference on Computers and Accessibility, ASSETS’06, October, 2006.
  • A Gesture-based American Sign Language (ASL) Tutor for Deaf Children. Lee, S., Henderson, V., Hamilton, H., Starner, T., Brashear, H. In Proceedings of the ACM SIGCHI Conference Extended Abstracts on Human Factors in Computing Systems, CHI’05, April, 2005.
  • User-Centered Development of a Gesture-Based American sign Language (ASL) Game. Lee, S., Henderson, V., Brashear, H., Starner, T., and Hamilton, H. In Proceedings of Instructional Technology and Education of the Deaf Symposium, NTID, June, 2005.
  • Development of American Sign Language (ASL) Game for Deaf Children. Henderson, V., Lee, S., Hamilton, H., Starner, T., and Brashear, H. In Proceedings of the ACM Interaction Design & Children, IDC’05, June 2005.

Sorry, your browser is not supported. Please try with other version or browser.