A rhythm game that teaches you sign language. Letters scroll down the screen like falling notes, and you score points by making each hand sign in time with the music while your webcam checks you got it right.

Over 48 million Americans are deaf or hard of hearing, yet ASL literacy remains low among the hearing population. We wanted to make learning ASL fingerspelling fun, accessible, and engaging -the same way Guitar Hero made learning rhythm patterns addictive. The breakthrough idea: What if we could gamify sign language learning with real-time AI detection and rhythm-based gameplay? SignHero is a rhythm game that teaches ASL fingerspelling through webcam-powered gameplay: The AI watches your webcam, detects which ASL letter you're signing in real-time (~30-50ms latency), and scores your accuracy with combo multipliers, streak celebrations, and visual effects. For this we build a custom model based on the mobileneyb2 cnn as our backbone.