Sign language (SL) recognition, although it has been explored for many years, is still a challenging problem for real practice. The complex background and illumination conditions affect the hand tracking and make the SL recognition very difficult. Fortunately, Kinect is able to provide depth and color data simultaneously, based on which the hand and body action can be tracked more accurate and easier. This demo will show our primary efforts on sign language recognition and translation with Kinect.
Sign Language Recognition and Translation with Kinect. FG 2013, IEEE conference on Automatic Face and Gesture Recognition
MSRA Best Social Impact Project Award in 2012
MSRA Best Demo Student TechFest Award 2012 (3/26)