Data glove-based sign language translation with convolutional neural networks

Marco Castillo Cervera, Diego Lopez Meza, Deyby Huamanchahua

Resultado de la investigación: Libro o Capítulo del libro Contribución a la conferenciarevisión exhaustiva

Resumen

This research was carried out because of the communication barriers that currently exist between hearing impaired and hearing people. These barriers hinder their integration into society and affect their interpersonal relationships. The objective of the study was to propose the development of a stationary assistive robot capable of displaying sign language interpretation through the combination of data gloves and the D-CNN and LSTM algorithm to facilitate the communication of hearing-impaired children in Huancayo. The triple diamond research design was used, where the mind map and the lotus diagram were used for the delimitation and definition of the problem. In addition, the IDEF0 technique was used to obtain a structured design of the project system. A morphological matrix was also used to choose the best solution for the problem. The chosen design contemplates the use of an Arduino UNO, flex sensors, accelerometers and gyroscopes for sign detection. The main algorithm consists of the union of a deep convolutional neural network and a LSTM for a correct sign classification module. The proposed design proposes to visualize the conceptual development of the project mentioned above.

Idioma originalInglés estadounidense
Título de la publicación alojadaProceedings - 2022 International Conference on Mechanical, Automation and Electrical Engineering, CMAEE 2022
EditorialInstitute of Electrical and Electronics Engineers Inc.
Páginas67-74
-8
ISBN (versión digital)9798350346572
DOI
EstadoIndizado - 2022
Publicado de forma externa
Evento2022 International Conference on Mechanical, Automation and Electrical Engineering, CMAEE 2022 - Virtual, Online, China
Duración: 16 dic. 202218 dic. 2022

Serie de la publicación

NombreProceedings - 2022 International Conference on Mechanical, Automation and Electrical Engineering, CMAEE 2022

Conferencia

Conferencia2022 International Conference on Mechanical, Automation and Electrical Engineering, CMAEE 2022
País/TerritorioChina
CiudadVirtual, Online
Período16/12/2218/12/22

Nota bibliográfica

Publisher Copyright:
© 2022 IEEE.

Huella

Profundice en los temas de investigación de 'Data glove-based sign language translation with convolutional neural networks'. En conjunto forman una huella única.

Citar esto