Kinect Bridge

Congratulations! This Entry has been selected as a finalist.

Kinect Bridge

IndiaHyderabad, India
Project Summary
Elevator Pitch

Concise Summary: Help us pitch this solution! Provide an explanation within 3-4 short sentences.

Enabling real-time communication between speech impaired people and others who do not know sign language, using motion sensing devices like Microsoft Kinect for Windows.

About Project

Problem: What problem is this project trying to address?

Real-time communication between a speech impaired person and others who do not know sign language is not possible without the involvement of an interpreter. This impacts millions of speech impaired people around the world and those who want to communicate with them.

Solution: What is the proposed solution? Please be specific!

Using the gesture detection capabilities of motion sensing devices like Microsoft Kinect for Windows, we are building a system which detects sign language used by Speech impaired user and convert the sign into its equivalent text. This text is then transmitted to other user who does not know sign language, through a chat program. This text can also be converted into equivalent speech output using a Text-to-speech engine. The other user then responds back by typing text into the chat program or speech which is converted back into equivalent text and transmitted back to the speech impaired person. This text is displayed on Speech impaired person's screen enabling a bi-directional real-time communication
Impact: How does it Work

Example: Walk us through a specific example(s) of how this solution makes a difference; include its primary activities.

Consider a person (Jim) who is employee of an IT services company. Jim is technically strong but he is speech impaired. As he works with other members of his team who are not speech impaired and do not understand sign language, the only way he can communicate with them is through a text chat or Emails. This form of communication is slow and can be painful for long discussions. Also, Jim can't participate in any video conference meeting as he cannot speak. Our solution will equip Jim with the power of converting his sign language gestures to equivalent text and speech, so that he can communicate with others in real-time and participate in video conference meeting. Its like giving him a voice.

Marketplace: Who else is addressing the problem outlined here? How does the proposed project differ from these approaches?

No known competitors in this space.

Founding Story

The idea came to my mind in July 2011 when I was playing a Kinect enabled game on my XBOX 360 gaming console. Kinect brings in a new way of gaming where players are not required to use a controller, instead the Kinect sensor detects the player's body movements and steers the game accordingly. Kinect for Windows SDK was launched few months back, which opened up a lot of possibilities for developers who want to take Kinect beyond gaming. As I was playing, the idea about making a social change came into my mind. The idea was to use Kinect's motion and gesture tracking capabilities to read sign language used by Speech impaired people and use it for communication with others.
About You
About You
First Name


Tell us about yourself/your team.

Over 6 years of diverse IT experience, currently working as a Program Manager with Microsoft. Leading the local Grassroots Innovation community within the company for 3 years. Worked on many innovative projects in the past.

What makes you an intrapreneur? What are the skills, capabilities, and personality traits that make you an intrapreneur?

Community builder, technical expertise, passion to try out new ideas and technologies.

About Your Organization
Company Country

, AP, Hyderabad

Primary country where this project is creating social impact
Additional countries or regions

Global impact


Professional, Scientific, and Technical Services

Select the stage that best applies to your solution

Start-Up (a pilot that has just begun operating)

The Solution: Why is this solution innovative for your company and industry?

No such solution exists in the industry.

What has been the impact of your solution to date?

We are in the initial stage of this project and have completed a proof of concept, wherein we have been able to read some hand gestures and transmit its text and speech equivalent to other user through Internet chat program. The project is not currently in a state where it can be used by a speech impaired person (as we don't have a complete sign language dictionary built into the system) but we are working towards it.

What is your projected impact over the next 1 to 3 years?

It has a potential to impact millions of Speech impaired people in the next 1 to 3 years.

What barriers might hinder the success of your project? How do you plan to overcome them?

The major barrier is ability to read all sign gestures and movement used by Speech impaired people and interpret them correctly. We are working on that and hope to overcome it in the next few months.

What is the benefit or value you're creating for your business?

The project is a beautiful showcase of how Microsoft Kinect for Windows can be used for a social cause.

How are you leveraging internal resources (funds, time, knowledge, etc.) to support this initiative?

We are working on this project in our personal time at this moment.

Expand on your answer, explaining the long-term funding and support plan.

We don't have any funding for this project at this moment and we plan to continue working on it in our personal time.

Tell us about your partnerships across your company and externally that are key to your project's success.

Partnerships across the company is important from a technical perspective and we have been getting great help from our company's employees and teams.
Once we are ready with a robust solution, we will need to partner with Social organization and speech impaired people to make the project successful.

What internal support have you gotten for your project? What kind of push-back have you received?

We have got technical support internally.