SIGN LANGUAGE DETECTION USING PYTHON AND OPENCV

AUTHOR(S)

Dr. S. Nandagopal, S.Priyanga, R.Vidhyasri, N.Sharmila, M.Suvetha

DOI: https://doi.org/10.46647/ijetms.2023.v07i02.055

ABSTRACT
This work focuses on detection of (sign) hand gesture techniques and introduces the merits and limitations in various circumstances. The hand segmentation theories and hand detection system is used to construct hand gesture recognition using Python with OpenCV. The hand gestures use as a natural interface motivates research in gesture representations, taxonomies and recognition methods/algorithms, and software platforms/ frameworks, all of which are briefly covered in this work. All the processes have been done using webcam by keras and tensorflow. The ever-increasing public acceptance and funding for multinational projects emphasizes the need for sign language. The desire for computer-based solution is significant in recent age of technology for deaf people. Still, researchers are attacking the problem for quite sometimes and the results are showing promises. This work represents a comprehensive review of vision-based sign recognition methodologies, emphasizing importance of taking the things into consideration in addition with algorithm's recognition accuracy during predicting their success in real world applications. This project matches the sign language action with dataset images with various categories of sign (gestures) that already been trained using webcam. This project applies neural network to compare the actions with data set images. The coding language used is Python 3.10.

Page No: 477 - 484

References:

• 1. Swapnil Athavale and Mona Deshmukh. Dynamic hand gesture recognition for human computer interaction; a comparative study. International Journal of Engineering Research and General Science, 2(2):38–55, 2014.
  2. GRS Murthy and RS Jadon. A review of vision based hand gestures recognition. International Journal of Information Technology and Knowledge Management, 2(2):405–410, 2009.
  3. Vinayak S Kunder, Aakash A Bhardwaj, and Vipul D Tank. Sign language recognition system
  4. Omkar Vedak, Prasad Zavre, Abhijeet Todkar, and Manoj Patil. Sign language interpreter using image processing and machine learning. International Research Journal of Engineering and Technology (IRJET), 2019.
  5. Parshwa P Patil, Maithili J Phatak, Suharsh S Kale, Premjeet N Patil, Pranav S Harole, and CS Shinde. Hand gesture recognition for deaf and dumb. Hand, 6(11), 2019.
  6. Hai, P. T., Thinh, H. C., Van Phuc, B., & Kha, H. H. (2018). Automatic feature extraction for Vietnamese sign language recognition using support vector machine. 2018 2nd International Conference on Recent Advances in Signal Processing, Telecommunications & Computing (SigTelCom).
  7. Purva C. Badhe, Vaishali Kulkarni, “Indian Sign Language Translator using Gesture Recognition Algorithm”, 2015. IEEE International Conference on Computer Graphics, Graphics and Information Security (CGVIS).
  8. Md Azher Uddin, Shayhan Ameen Chowdhury, “Hand Sign language recognition for Bangla Alphabet using Support Vector Machines”, 2016 International Conference on Innovations in Science Engineerig and Technology (ICISET).
  9. Muhammad Aminur Rahaman, Mahmood Jasim, Md. Haider Ali and Md. Hasanuzzaman, “Real-Time Computer Vision based Bengali Sign Language Recognition”, 2014 17th International Conference on Computer and Information Technology (ICCIT).
  10. Rahat Yasir, Riasat Azim Khan, “Two Handed Hand Gesture Recognition for Bangla Sign Language using LDA and ANN”, The 8th International Conference on Software, Knowledge, Information Management and Applications (SKIMA 2014).
  11. P.Gajalaxmi, T, Sree Sharmila, “Sign Language Recognition for Invariant features based on multiclass Support Vector Machine with BeamECOC Optimization”, IEEE International Conference on Power, Control, Signals and Instrumentation Engineering (ICPCSI-2017. certification. In Proc. of ACM Conference on Computer and Communications Security (CCS), pages 235–245, 2009.
  12. J. Kramer, “Communication system for deaf, deaf-blind and non-vocal individuals using instrumented gloves,” United States Patent No. 5047952, Virtual Technologies Co., 1991.
  13. R. Carmel, C. Ullrich, and J. Silver, “VirtualHand v2.5-user’s guide,” Virtual Technologies Inc., 2001.
  14. C. Charayaphan and A. Marble, “Image processing system for interpreting motion in American sign language,” Journal of Biomedical Engineering, Vol. 14, 1992, pp. 419-425.
  15. T. Takahashi and F. Kishino, “Gesture coding based in experiments with a hand gesture interface device,” ACM SIGCHI Bulletin, Vol. 23, 1991, pp. 67-73
  16. Shwetasaibal Samanta Sahoo; Mousime Xalxo; B G Mukunda. "A Study on Tourist Behaviour Towards Sustainable Tourism in Karnataka". International Research Journal on Advanced Science Hub, 2, 5, 2020, 27-33. doi: 10.47392/irjash.2020.28
  17. Muniyandy Elangovan; Mohamed Yousuf; Mohamed Nauman; Mohammed Nayeem. "Design and Development of Delivery Robot for Commercial Purpose". International Research Journal on Advanced Science Hub, 4, 07, 2022, 192-197. doi: 10.47392/irjash.2022.047
  18. Manikandan N; Swaminathan G; Dinesh J; Manish Kumar S; Kishore T; Vignesh R. "Significant Attention in Industry and Academia for Wire Arc Additive Manufacturing (WAAM) - A Review". International Research Journal on Advanced Science Hub, 4, 07, 2022, 198-204. doi: 10.47392/irjash.2022.048
  19. Shoeb Ahmed Syed; Steve Ales; Rajesh Kumar Behera; Kamalakanta Muduli. "Challenges, Opportunities and Analysis of the Machining Characteristics in hybrid Aluminium Composites (Al6061-SiC-Al2O3 ) Produced by Stir Casting Method". International Research Journal on Advanced Science Hub, 4, 08, 2022, 205-216. doi: 10.47392/irjash.2022.051
  20. Ashima Saxena; Preeti Chawla. "A Study on the Role of Demographic Variables on Online Payment in Delhi NCR". International Research Journal on Advanced Science Hub, 4, 08, 2022, 217-221. doi: 10.47392/irjash.2022.052
  21. Vishnupriya S; Nirsandh Ganesan; Ms. Piriyanga; Kiruthiga Devi. "Introducing Fuzzy Logic for Software Reliability Admeasurement". International Research Journal on Advanced Science Hub, 4, 09, 2022, 222-226. doi: 10.47392/irjash.2022.056
  22. GANESAN M; Mahesh G; Baskar N. "An user friendly Scheme of Numerical Representation for Music Chords". International Research Journal on Advanced Science Hub, 4, 09, 2022, 227-236. doi: 10.47392/irjash.2022.057
  23. Nirsandh Ganesan; Nithya Sri Chandrasekar; Ms. Gokila; Ms. Varsha. "Decision Model Based Reliability Prediction Framework". International Research Journal on Advanced Science Hub, 4, 10, 2022, 236-242. doi: 10.47392/irjash.2022.061
  24. Vishnupriya S; Nithya Sri Chandrasekar; Nirsandh Ganesan; Ms. Mithilaa; Ms. Jeyashree. "Comprehensive Analysis of Power and Handloom Market Failures and Potential Regrowth Options". International Research Journal on Advanced Science Hub, 4, 10, 2022, 243-250. doi: 10.47392/irjash.2022.062
  25. Minh Duc Ly; Que Nguyen Kieu Viet. "Improvement Productivity and Quality by Using Lean Six Sigma: A Case Study in Mechanical Manufacturing". International Research Journal on Advanced Science Hub, 4, 11, 2022, 251-266. doi: 10.47392/irjash.2022.066
  26. Ragunath A; Poonam Syal. "Net Zero Energy Buildings Initiatives - A Review". International Research Journal on Advanced Science Hub, 4, 11, 2022, 267-271. doi: 10.47392/irjash.2022.067
  27. Suresh P; Justin Jayaraj K; Aravintha Prasad VC; Abishek Velavan; Mr Gokulnath. "Deep Learning for Covid-19 Identification: A Comparative Analysis". International Research Journal on Advanced Science Hub, 4, 11, 2022, 272-280. doi: 10.47392/irjash.2022.068
  28. Chirag H B; Darshan M; Rakesh M D; Priyanka D S; Manjunath Aradya. "Prediction of Concrete Compressive Strength Using Artificial Neural Network". International Research Journal on Advanced Science Hub, 4, 11, 2022, 281-287. doi: 10.47392/irjash.2022.069
  29. Minh Ly Duc; Que Nguyen Kieu Viet. "Analysis Affect Factors of Smart Meter A PLS-SEM Neural Network". International Research Journal on Advanced Science Hub, 4, 12, 2022, 288-301. doi: 10.47392/irjash.2022.071
  30. Lely Novia; Muhammad Basri Wello. "Analysis of Interpersonal Skill Learning Outcomes in Business English Students Class". International Research Journal on Advanced Science Hub, 4, 12, 2022, 302-305. doi: 10.47392/irjash.2022.072
  31. Ms. Nikita; Sandeep Kumar; Prabhakar Agarwal; Manisha Bharti. "Comparison of multi-class motor imagery classification methods for EEG signals". International Research Journal on Advanced Science Hub, 4, 12, 2022, 306-311. doi: 10.47392/irjash.2022.073
  32. Aniket Manash; Ratan Kumar; Rakesh Kumar; Pandey S C; Saurabh Kumar. "Elastic properties of ferrite nanomaterials: A compilation and a review". International Research Journal on Advanced Science Hub, 4, 12, 2022, 312-317. doi: 10.47392/irjash.2022.074
  33. Prabin Kumar; Rahul Kumar; Ragul Kumar; Vivek Rai; Aniket Manash. "A Review on coating of steel with nanocomposite for industrial applications". International Research Journal on Advanced Science Hub, 4, 12, 2022, 318-323. doi: 10.47392/irjash.2022.075
  34. Twinkle Beniwal; Vidhu K. Mathur. "Cloud Kitchens and its impact on the restaurant industry". International Research Journal on Advanced Science Hub, 4, 12, 2022, 324-335. doi: 10.47392/irjash.2022.076
  35. T. Pravin, C. Somu, R. Rajavel, M. Subramanian, P. Prince Reynold, Integrated Taguchi cum grey relational experimental analysis technique (GREAT) for optimization and material characterization of FSP surface composites on AA6061 aluminium alloys, Materials Today: Proceedings,Volume 33, Part 8, 2020, Pages 5156-5161, ISSN 2214-7853. doi.org/10.1016/j.matpr.2020.02.863.
  36. R. Ranjith, C. Somu, G. Tharanitharan, Venkatajalapathi.T, Naveenkumar M, Integrated Taguchi cum Grey Relational Experimental Analysis (GREAT) for Optimization and Machining Characterization of Cryogenic Cooled AA6063 Aluminium Alloys, Materials Today: Proceedings, Volume 18, Part 7, 2019,Pages 3597- 605, https://doi.org/10.1016/j.matpr.2019.07. 291.
  37. R. Devi Priya, R. Sivaraj, Ajith Abraham, T. Pravin, P. Sivasankar and N. Anitha. "Multi-Objective Particle Swarm Optimization Based Preprocessing of Multi-Class Extremely Imbalanced Datasets". International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems Vol. 30, No. 05, pp. 735-755 (2022). Doi: 10.1142/S0218488522500209
  38. M. S. N. K. Nijamudeen, G. Muthuarasu, G. Gokulkumar, A. Nagarjunan, and T. Pravin, “Investigation on mechanical properties of aluminium with copper and silicon carbide using powder metallurgy technique,” Advances in Natural and Applied Sciences, vol. 11, no. 4, pp. 277–280, 2017.
  39. Pravin T, M. Subramanian, R. Ranjith,Clarifying the phenomenon of Ultrasonic Assisted Electric discharge machining, “Journal of the Indian Chemical Society”, Volume 99, Issue 10, 2022, 100705, ISSN 0019-4522, Doi: 10.1016/j.jics.2022.100705
  40. V.S. Rajashekhar; T. Pravin; K. Thiruppathi , “Control of a snake robot with 3R joint mechanism”, International Journal of Mechanisms and Robotic Systems (IJMRS), Vol. 4, No. 3, 2018. Doi: 10.1504/IJMRS.2018.10017186
  41. T. Pravin, M. Sadhasivam, and S. Raghuraman, “Optimization of process parameters of Al-10% Cu compacts through powder metallurgy,” Applied Mechanics and Materials, vol. 813-814, pp. 603–607, 2010.
  42. Rajashekhar, V., Pravin, T., Thiruppathi, K.: A review on droplet deposition manufacturing-a rapid prototyping technique. Int. J. Manuf. Technol. Manage. 33(5), 362–383 (2019) https://doi.org/10.1504/IJMTM.2019.103277
  43. Rajashekhar V S, Pravin T, Thirupathi K, Raghuraman S.Modeling and Simulation of Gravity based Zig-zag Material Handling System for Transferring Materials in Multi Floor Industries. Indian Journal of Science and Technology.2015 Sep, 8(22), pp.1-6.
  
  

  How to Cite This Article:
  Dr. S. Nandagopal, S.Priyanga, R.Vidhyasri, N.Sharmila, M.Suvetha . SIGN LANGUAGE DETECTION USING PYTHON AND OPENCV . ijetms;7(2):477-484. DOI: 10.46647/ijetms.2023.v07i02.055