Transcript He Zhou - College of Engineering | UMass Amherst

ASLLENGE
Comprehensive Design Review
Feb 16 2012
He Zhou
Hui Zheng
William Mai
Xiang Guo
Advisor: Professor Patrick Kelly
Department of Electrical and Computer Engineering
Outline






Introduction
Timeline/Progress
Future Work
FPR Goals
Demonstration
Q/A
Department of Electrical and Computer Engineering
Introduction
Project Objective: Gesture Recognition
• Unfamiliarity with ASL (lack of data)
• Wide Implications
• CHALEARN Gesture Challenge (By Kaggle)
 Design changes
• New Record Function
• Hierarchical Search
• Pattern marching
Department of Electrical and Computer Engineering
CHALEARN Gesture Challenge By Kaggle
 “The challenge focuses on hand gestures.
Applications include man-machine
communication, translating sign languages for
the deaf, video surveillance, and computer
gaming”
 “learning to recognize new categories of
gestures from a single video clip of each
gesture.”
Department of Electrical and Computer Engineering
Team Roles
 He Zhou(CSE): test and integrate software
prototype
 Hui Zheng(CSE): database development and
programming
 William Mai (EE): build microcontroller to detect
finger and palm movements
 Xiang (EE): build Arduino board, overall testing,
building ASL database, and website
administration
Department of Electrical and Computer Engineering
5
Demonstration
Department of Electrical and Computer Engineering
Kinect Environment For Integration Afterward
 Two Hand tracking (able to tell left hand from
right hand)
 Grid Size change according to body size
 More refined Grid recognition
Department of Electrical and Computer Engineering
Planned Timeline
10/16/2011
12/5/2011
1/24/2012
3/14/2012
5/3/2012
PDR
Purchase Parts
Planning
GUI
Interface with the Sensors
Build Finger Sensors
Build Test Database
Prototype 1
MileStone MDR Deliverables
System Integration
Winter Break
Expand Database
Prototype 2
MileStone CDR Deliverables
Alpha Testing
Update
Beta Testing
Spring Break
Finalize Project
MileStone FRP Deliverables
Department of Electrical and Computer Engineering
8
Progress Timeline
7/26/2011 11/3/2011 2/11/2012 5/21/2012
PDR
Purchase Parts
planning
GUI
Interface with sensors
Prototype 1
MDR
planning 2
Finger Tracker Building/Program
Database
Kinect Enviroment for…
System Integreation
CDR
FRP
Department of Electrical and Computer Engineering
9
To Do




Complete Database and Database Interface
Complete Finger Tracking Module
Refine Kinect Environment
Integration
Department of Electrical and Computer Engineering
Q&A
Department of Electrical and Computer Engineering
11