WATCH: Student’s Creation Translates Sign Language To Real-Time English With AI

 

Engineering student Priyanjali Gupta wanted to bridge the gap between real-time communication and sign-language.

 

Priyanjali noticed that with real-time communication, software companies keep their platforms updated with identifying the person speaking. However, a person using sign language doesn’t have the same recognition acting as a barrier to them which she wished to them.

 

 

The engineering student from Tamil Nadu’s Vellore Institute of Technology (VIT) came up with an AI model which translates English into real-time and shared it on LinkedIn. Her mother was an encouraging factor in this creation who urged her to try something different. In fact, Gupta said: “It made me contemplate what I could do with my knowledge and skillset. The idea of inclusive technology struck me.

 

Student uses AI to translate sign language to English in real-time

 

Her creation turns sign language signals into English text by analyzing body motions including arms and fingers. This provides people with speech or hearing impairments a new method of easier communication. So far, this model can work on single frames but cannot detect videos. The translation of sign language to other languages still has a lot of work that needs to be done. However, Gupta’s creation is a great starting point.

 

 

View this post on Instagram

 

A post shared by 89.7 Bay (@897bay)


What do you think of this student’s creation?