Gift of Voice to Mute: Hand Gestures Converted to Text and Voice

Authors

  • Taneja S Dept. of Physics, Springdales School, Dhaula Kuan, New Delhi, India
  • Sukhija M Dept. of Physics, Springdales School, Dhaula Kuan, New Delhi, India

DOI:

https://doi.org/10.26438/ijcse/v8i4.6469

Keywords:

Sign language, Flex sensor, Arduino Uno, Gestures, MIT App Inventor

Abstract

Though Sign language using gestures and facial expressions helps deaf and dumb people to express their thoughts, normal people do not learn sign language and therefore not able to comprehend it thus causing a barrier between the two and a big cause of frustration. With the objective to lower the barrier in communication by opening up conversations between signers and speakers, we have converted sign language to text and speech using flex sensors, Arduino Uno, HC-05: Bluetooth and a mobile device as the hardware and Arduino IDE and MIT App Inventor as the software. Normal driving gloves have been converted to wireless data smart gloves by fitting them with flex sensors along the length of each finger and the thumb and accelero sensor. The signals are passed on Arduino Uno which converts analog signal from the sensors to digital signals. The signal is then passed on to a Bluetooth device HC-05.Then signal is transmitted to a mobile device on a Bluetooth app. Signal is then converted into a voice message. This low cost solution is affordable, portable and easily customizable with additional Feature for GPS location for safety purposes.

References

[1]. J. Thilagavathy, A.J. Murugan, S. Darwin, “ Embedded Based Hand Talk Assisting System for Deaf and Dumb”, International Journal of Engineering Research & Technology, Vol. 3, Issue.,3, pp. 318-321,2014

[2]. R.R Itkarkar, A.V.Nandi, “Hand gesture to Speech Conversion Using MATLAB”, 4th ICCCNT,Tiruchengode, India,2013

[3]. O.Khandeshe, V.Salvi, V.Gawade, S.Varia, R.Molawade, “A Comparative study On Gesture control voice command Over Android Device”, International Journal of Modern Engineering Research, Vol.9, Issue 1, pp.33-37, 2019

[4]. M.A Ahmed, B.B ZAidan, A.A ZAidan, M.M Salih, M.M.B Lakulu, “A Review on Systems-Based Sensory Gloves for Sign Language Recognition State of the Art between 2007 and 2017, Sensors(Basel), Vol.18, Issue 7,2018

[5]. M.Tawde, H.Singh, S.Shaikh, “Glove for Gesture Recognition using Flex Sensor”, International Journal of Recent Trends in Engineering & Research”, Vol 03, Issue 03, pp. 35-39, 2017

[6]. P.Y.Ingle, R.Kumar, “Let’s Talk model for converting Gesture to voice using hand glove and IOT”, International Journal of Computer Sciences and Engineering, Vol. 7, Issue., 5,pp.806-809,2019

[7]. T. Jaya, Rajendran .V, "Hand-Talk Assistive Technology for the Dumb," International Journal of Scientific Research in Network Security and Communication, Vol.6, Issue.5, pp.27-31, 2018

Downloads

Published

2020-04-30
CITATION
DOI: 10.26438/ijcse/v8i4.6469
Published: 2020-04-30

How to Cite

[1]
S. Taneja and M. Sukhija, “Gift of Voice to Mute: Hand Gestures Converted to Text and Voice”, Int. J. Comp. Sci. Eng., vol. 8, no. 4, pp. 64–69, Apr. 2020.

Issue

Vol. 8 No. 4 (2020): IJCSE April Edition

Section

Technical Article

License

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Authors contributing to this journal agree to publish their articles under the Creative Commons Attribution 4.0 International License, allowing third parties to share their work (copy, distribute, transmit) and to adapt it, under the condition that the authors are given credit and that in the event of reuse or distribution, the terms of this license are made clear.