Puente Kinect

Congratulations! This Entry has been selected as a finalist.

Puente Kinect

IndiaHyderabad, India
Website:
http://www.microsoft.com
Share page with AddThis
Resumen del Proyecto
Presentación del Proyecto!

Resumen conciso: Ayúdenos a presentar esta solución! Proporcione una explicación en 3 o 4 frases cortas.

Permitiendo una comunicación en tiempo real entre personas con problemas en el habla y aquellas que no conocen el lenguaje de señas, utilizando dispositivos como Microsoft Kinect para Windows.

About Project

Problema: ¿Qué problema está tratando de abordar este proyecto?

Real-time communication between a speech impaired person and others who do not know sign language is not possible without the involvement of an interpreter. This impacts millions of speech impaired people around the world and those who want to communicate with them.

Solución: cuál es la solución propuesta? Por favor sé específico!

Using the gesture detection capabilities of motion sensing devices like Microsoft Kinect for Windows, we are building a system which detects sign language used by Speech impaired user and convert the sign into its equivalent text. This text is then transmitted to other user who does not know sign language, through a chat program. This text can also be converted into equivalent speech output using a Text-to-speech engine. The other user then responds back by typing text into the chat program or speech which is converted back into equivalent text and transmitted back to the speech impaired person. This text is displayed on Speech impaired person's screen enabling a bi-directional real-time communication
Impact: How does it Work

Ejemplo: Guíenos a través de un ejemplo/s específico/s de cómo esta solución hace la diferencia; incluya sus actividades principales.

Consider a person (Jim) who is employee of an IT services company. Jim is technically strong but he is speech impaired. As he works with other members of his team who are not speech impaired and do not understand sign language, the only way he can communicate with them is through a text chat or Emails. This form of communication is slow and can be painful for long discussions. Also, Jim can't participate in any video conference meeting as he cannot speak. Our solution will equip Jim with the power of converting his sign language gestures to equivalent text and speech, so that he can communicate with others in real-time and participate in video conference meeting. Its like giving him a voice.
Sustentabilidad

Mercado: ¿Quién mas está abordando el problema aquí descrito ? ¿Cómo difiere el proyecto propuesto de esos enfoques?

No known competitors in this space.
Equipo

Historia fundacional

The idea came to my mind in July 2011 when I was playing a Kinect enabled game on my XBOX 360 gaming console. Kinect brings in a new way of gaming where players are not required to use a controller, instead the Kinect sensor detects the player's body movements and steers the game accordingly. Kinect for Windows SDK was launched few months back, which opened up a lot of possibilities for developers who want to take Kinect beyond gaming. As I was playing, the idea about making a social change came into my mind. The idea was to use Kinect's motion and gesture tracking capabilities to read sign language used by Speech impaired people and use it for communication with others.
Sobre ti
Sobre ti
Nombre

Sidharth

Cuéntanos sobre tí/sobre tu equipo

Over 6 years of diverse IT experience, currently working as a Program Manager with Microsoft. Leading the local Grassroots Innovation community within the company for 3 years. Worked on many innovative projects in the past.

¿Qué te hace un intraemprendedor? Cuáles son las habilidades, capacidades y rasgos personales que te hacen un intraemprendedor?

Community builder, technical expertise, passion to try out new ideas and technologies.

Sobre tu organización
País de la Empresa

, AP, Hyderabad

Principal país en el cual este proyecto está creando impacto social
Países o regiones adicionales

Global impact

Industria

Profesional, Científico y Servicios Técnicos

Innovación
Selecciona la fase que describa mejor el momento en el que se encuentra tu emprendimiento

Inicio (iniciativa piloto que acaba de empezar a ponerse en práctica)

La Solución: ¿Por qué es innovadora la solución para tu compañía e industria?

No such solution exists in the industry.

Impacto
¿Cuál ha sido el impacto de la solución hasta la fecha?

We are in the initial stage of this project and have completed a proof of concept, wherein we have been able to read some hand gestures and transmit its text and speech equivalent to other user through Internet chat program. The project is not currently in a state where it can be used by a speech impaired person (as we don't have a complete sign language dictionary built into the system) but we are working towards it.

¿Cuál es tu impacto proyectado en los próximos 3 años?

It has a potential to impact millions of Speech impaired people in the next 1 to 3 years.

¿Qué barreras pueden dificultar el éxito de tu proyecto? ¿Cómo planean superarlas?

The major barrier is ability to read all sign gestures and movement used by Speech impaired people and interpret them correctly. We are working on that and hope to overcome it in the next few months.

Sostenibilidad
¿Cuál es el beneficio o valor que estás generando para el/los negocio/s?

The project is a beautiful showcase of how Microsoft Kinect for Windows can be used for a social cause.

¿Cómo estás impulsando recursos internos (fondos, tiempo, concimiento, etc.) para sostener esta iniciativa?

We are working on this project in our personal time at this moment.

Amplía tu respuesta, explicando el plan de financiación y sostenimiento a largo plazo.

We don't have any funding for this project at this moment and we plan to continue working on it in our personal time.

Cuéntanos sobre tus asociados, dentro de tu empresa y por fuera, que sean claves para el éxito de tu proceso.

Partnerships across the company is important from a technical perspective and we have been getting great help from our company's employees and teams.
Once we are ready with a robust solution, we will need to partner with Social organization and speech impaired people to make the project successful.

¿Qué apoyo interno has tenido para tu proyecto? Qué tipos de retrocesos has sufrido?

We have got technical support internally.