Hand Gesture Recognition Using OpenCV

Authors

  • Rohini M  Assistant Professor, Department of Computer Engineering, Coimbatore Institute of Engineering and Technology, Coimbatore, Tamil Nadu, India
  • Abishek Leo Kingston. J  UG Scholar, Department of Computer Engineering, Coimbatore Institute of Engineering and Technology, Coimbatore, Tamil Nadu, India
  • Shriram.G.S  UG Scholar, Department of Computer Engineering, Coimbatore Institute of Engineering and Technology, Coimbatore, Tamil Nadu, India
  • Siva Sankaran.S  UG Scholar, Department of Computer Engineering, Coimbatore Institute of Engineering and Technology, Coimbatore, Tamil Nadu, India
  • Vasuki. G  UG Scholar, Department of Computer Engineering, Coimbatore Institute of Engineering and Technology, Coimbatore, Tamil Nadu, India

Keywords:

Fingertip detection, Gesture recognition, Handy algorithm.

Abstract

In human-computer interaction or sign language interpretation, recognizing hand gestures and detecting fingertips become ubiquitous in computer vision research. Hand gesture recognition provides an intelligent and natural way of human computer interaction. Its applications range from medical rehabilitation to consumer electronics control. In order to distinguish hand gestures, various kinds of sensing techniques are utilized to obtain signals for pattern recognition. This system can be divided into three parts according: Hand detection, hand gesture recognition, Edge detection for images, Integrating media. The system has two major advantages. First, it is highly modularized, and each of these steps is capsuled from others; second, the edge/contour detection of hand as well as gesture recognition is an add-on layer, which can be easily transplanted to other applications. The techniques used for image processing are hand gesture detection, edge detection, thresholding, contour detection. Using OpenCV, which provides a library collection of functions for different image processing techniques, these input images can be processed and corresponding key strokes will be generated.

References

  1. A. Bandini, J. Zariffa, Analysis of the hands in egocentric vision: A survey, IEEE Transactions on Pattern Analysis and Machine Intelligence.
  2. C. Von Hardenberg, F. Be´rard, Bare-hand human-computer interaction, in: Proceedings of the 2001 workshop on Perceptive user interfaces, ACM, Orlando, Florida, USA, 2001, pp. 1–8.
  3. P. Xu, A real-time hand gesture recognition and human-computer interaction system, arXiv preprint arXiv:1704.07296.
  4. A. Haria, A. Subramanian, N. Asokkumar, S. Poddar, J. S. Nayak, Hand gesture recognition for human computer interaction, Procedia computer science 115 (2017) 367–374.
  5. R. Rastgoo, K. Kiani, S. Escalera, Sign language recognition: A deep survey, Expert Systems with Applications (2020) 113794.
  6. T. Sahana, S. Paul, S. Basu, A. F. Mollah, Hand sign recognition from depth images with multi-scale density features for deaf mute persons, Procedia Computer Science 167 (2020) 2043–2050.
  7. M. Flasin´ski, S. Mys´lin´ski, On the use of graph parsing for recognition of isolated hand postures of polish sign language, Pattern Recognition 43 (6) (2010) 2249–2264.
  8. B. Garcia, S. A. Viesca, Real-time american sign language recognition with convolutional neural networks, Convolutional Neural Networks for Visual Recognition 2.
  9. J. P. Sahoo, S. Ari, D. K. Ghosh, Hand gesture recognition using dwt and f-ratio based feature descriptor, IET Image Processing 12 (10) (2018) 1780–1787.
  10. M.-Y. Wu, P.-W. Ting, Y.-H. Tang, E.-T. Chou, L.-C. Fu, Hand pose estimation in object-interaction based on deep learningfor virtual reality applications, Journal of Visual Communicationand Image Representation (2020) 102802.
  11. M. M. Alam, S. M. Rahman, Detection and tracking of fingertips for geometric transformation of objects in virtual environment, in: Proc. IEEE/ACS 16th Int. Conf. on Computer Systems and Applications (AICCSA), IEEE, Abu Dhabi, United Arab Emirates, 2019, pp. 1–8.
  12. P. Song, H. Yu, S. Winkler, Vision-based 3d finger interactions for mixed reality games with physics simulation, in: Proceedings of the 7th ACM SIGGRAPH Int. Conf. on virtual-reality continuum and its applications in industry, ACM, Singapore, 2008, p. 7.
  13. C. Weichel, M. Lau, D. Kim, N. Villar, H. W. Gellersen, Mixfab: a mixed-reality environment for personal fabrication, in: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, Toronto, Ontario, Canada, 2014, pp. 3855–3864.
  14. M. M. Alam, S. M. Rahman, Affine transformationof virtual 3d object using 2d localization of fingertips, Virtual Reality & Intelligent Hardware 2 (6) (2020) 534–555.
  15. M. Bhuyan, D. R. Neog, M. K. Kar, Fingertip detection for hand pose recognition, International Journal on Computer Science and Engineering 4 (3) (2012) 501.
  16. J. Shotton, A. Fitzgibbon, M. Cook, T. Sharp, M. Finocchio, R. Moore,A. Kipman, and A. Blake. Real-time human pose recognition in parts from single depth images. In Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on, pages 1297 –1304, June 2011.
  17.  T. Leyvand, C. Meekhof, Y.-C. Wei, J. Sun, and B. Guo. Kinect identity: Technology and experience. Computer, 44(4):94 –96, April 2011.
  18. S. Henderson and S. Feiner. Exploring the benefits of augmented reality documentation for maintenance and repair. Visualization and Computer Graphics, IEEE Transactions on, 17(10):1355 –1368, Oct. 2011.
  19. Saket Warade, Jagannath Aghav, Petitpierre Claude, Sandeep Udayagiri. Real-Time Detection and Tracking with Kinect. International Conference on `Computer and Information Technology (ICCIT'2012) June 16-17, 2012, Bangkok
  20. R. Owens, "Lecture 6", Computer Vision IT412, 10/29/1997. http://homepages.inf.ed.ac.uk/rbf/CVonline/LOCAL_COPIES/ OWENS/LECT6/node2.html
  21. S. Price, "Edges: The Canny Edge Detector", July 4, 1996. http://homepages.inf.ed.ac.uk/rbf/CVonline/LOCAL_COPIES/ MARBLE/low/edges/canny.html
  22. Ehsan Nadernejad, Sara Sharifzadeh, Hamid Hassanpour. Edge Detection Techniques: Evaluations and Comparisons. Applied Mathematical Sciences, Vol. 2, 2008, no. 31, 1507 – 1520.

International Journal of Scientific Research in Science and Technology

Downloads

Published

2021-04-30

Issue

Volume 8, Issue 2, March-April-2021

Section

Research Articles

License

Copyright (c) IJSRST

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

How to Cite

[1]
Rohini M, Abishek Leo Kingston. J, Shriram.G.S, Siva Sankaran.S, Vasuki. G "Hand Gesture Recognition Using OpenCV" International Journal of Scientific Research in Science and Technology(IJSRST), Online ISSN : 2395-602X, Print ISSN : 2395-6011,Volume 8, Issue 2, pp.272-277, March-April-2021.