Signie: Sign Language Tutor and Translator App (WIP)
Learn sign language effortlessly and communicate seamlessly with real-time translation into ASL. Breaking down communication barriers and making the world more inclusive — one sign at a time.
Dec 2024 - Jan 2025
Product Design, User Reseach, 3D Designer, Prototyper, ShapesXR Designer, Video Editor,
User Interface, User Experience, Prototype and Content Creator
Figma, ShapesXR, DaVinci Resolve, Unity
Context
As part of the XRDC Hackathon, I joined a team to design and conceptualize a utility app that leverages camera access and artificial intelligence within an XR environment to teach and translate sign language.
Signie is a concept app designed to revolutionize Sign language learning and translating (we focused on American Sign Langugae). It uses XR technology, avatars, and motion cues to make learning more intuitive. I made the prototype, in ShapesXR, which showcases how XR can enhance sign langugae education. In the future, AI could enable real-time gesture recognition and audio-to-sign language translation, allowing the hearing impaired to experience movies without captions and interact in MR environments seamlessly.
Among 200+ projects, 3,000+ participants, and 60 finalists, Signie won two awards: Best Use Case of Context AI with XR and the Community Award for receiving the most votes across the entire challenge! 🎉🚀
A detailed case study is coming soon. Meanwhile, you can learn more about the project by clicking here or watch behind the scenes of the project in the video down below.