Review on Development of Assistive Text & Product Label Recognition System for Blind Person

Authors

  • Garima G. Charpe  ME Student, Department of Electronics and Tele Communication, HVPM’s College of Engineering & Technology, Amravati, Maharashtra, India
  • Prashant M. Kakde  Assistant Professor, Electronics and Tele Communication, HVPM’s College of Engineering & Technology, Amravati, Maharashtra, India

Keywords:

Assistive devices, distribution of edge pixels, hand-held objects, optical character recognition (OCR), stroke orientation, text region localization, image processing

Abstract

This paper presents camera based system which will help blind person for reading. This is the framework to assist visually impaired persons to read text patterns and convert it into the audio output. To obtain the object from the background and extract the text pattern from that object, the system first proposes the method that will capture the image from the camera and object region is detected. The texts which are maximally stable are detected using Maximally Stable External Regions (MSER) feature. The detected text is compared with the template and converted into the speech output. The text patterns are localized and binarized using Optical Character Recognition (OCR).The recognized text is then converted to an audio output. Experimental results show the analysis of MSER and OCR for different text patterns. MSER shows that it is robust algorithm for the text detection. Therefore, this paper deals with analysis of detection and recognition of different text patterns on different objects.

References

  1. World Health Organization. (2009). 10 facts about blindness and visual impairment [Online]. Available: www.who.int/features/factfiles/blindness/blindness_facts/en/index.html
  2. Advance Data Reports from the National Health Interview Survey (2008).[Online]. Available: http://www.cdc.gov/nchs/nhis/nhis_ad.htm
  3. Scan Talker, Bar code scanning application to help Blind Identify over one million products. (2006). [Online]. Available: http://www.freedomscientific.com/fs_news/PressRoom/en/2006/ScanTalker2-Announcement_3 HYPERLINK "http://www.freedomscientific.com/fs_news/PressRoom/en/2006/ScanTalker2-Announcement_3–30–2006.asp"– HYPERLINK "http://www.freedomscientific.com/fs_news/PressRoom/en/2006/ScanTalker2-Announcement_3–30–2006.asp"30 HYPERLINK "http://www.freedomscientific.com/fs_news/PressRoom/en/2006/ScanTalker2-Announcement_3–30–2006.asp"– HYPERLINK "http://www.freedomscientific.com/fs_news/PressRoom/en/2006/ScanTalker2-Announcement_3–30–2006.asp"2006.asp
  4. T. Phan, P. Shivakumara, and C. L. Tan, “A Laplacian method for video text detection,” in Proc. Int.  Conf. Document Anal. Recognition, 2009, pp. 66–70.
  5. P. Shivakumara, T. Phan, and C. L. Tan, “A gradient difference based technique for video text detection,” in Proc. Int. Conf. Document Anal. Recognit, 2009, pp. 66–70.
  6. N. Nikolaou and N. Papamarkos, “Color reduction for complex document images,” Int. J. Imaging Syst. Technol., vol. 19, pp. 14–26, 2009.
  7. X. Chen, J. Yang, J. Zhang, and A. Waibel, “Automatic detection and recognition of signs from natural scenes,” IEEE Trans. Image Process, vol. 13, no. 1, pp. 87–99, Jan. 2004.
  8. B. Epshtein, E. Ofek, and Y. Wexler, “Detecting text in natural scenes with stroke width transform,” in Proc. Comput. Vision Pattern Recognit.,2010, pp. 2963–2970
  9. X. Chen and A. L. Yuille, “Detecting and reading text in natural scenes,” in Proc. Comput. Vision Pattern Recognit, 2004, vol. 2, pp. II-366–II-373.
  10. K. Kim, K. Jung, and J. Kim, “Texture-based approach for text detection in images using support vector machines and continuously adaptive mean shift algorithm,” IEEE Trans. Pattern Anal. Mach. Intel., vol. 25, no. 12,pp. 1631–1639, Dec. 2003
  11. S. Kumar, R. Gupta, N. Khanna, S. Chaudhury, and S. D. Joshi, “Text extraction and document image segmentation using matched wavelets and MRF model,” IEEE Trans Image Process., vol. 16, no. 8, pp. 2117–2128,Aug. 2007.
  12. L. Ma, C. Wang, and B. Xiao, “Text detection in natural images based on multi-scale edge detection and classification,” in Proc. Int. Congr. Image Signal Process., 2010, vol. 4, pp. 1961–1965.
  13. M. Shi, Y. Fujisawab, T. Wakabayashia, and F. Kimura, “Handwritten numeral recognition using gradient and curvature of gray scale image, ”Pattern Recognit., vol. 35, no. 10, pp. 2051–2059, 2002.
  14. International Workshop on Camera-Based Document Analysis and Recognition (CBDAR 2005, 2007, 2009, 2011). [Online]. Available: http://www.m.cs.osakafu-u.ac.jp/cbdar2011.
  15. D. Dakopoulos and N. G. Bourbakis, “Wearable obstacle avoidance electronic travel aids for blind: A survey,” IEEE Trans. Syst., Man, Cybern, vol. 40, no. 1, pp. 25–35, Jan. 2010.
  16. K Reader Mobile User Guide, knfb Reading Technology Inc. (2008). [Online]. Available: http://www.knfbReading.com
  17. K. Jung, K.I. Kim, A.K. Jain, “Text information extraction in images and video: a survey”, Pattern Recognition, 37 977-997S, 2004.
  18. Rajkumar N, Anand M.G, Barathiraja N, “Portable Camera-Based Product Label Reading For Blind People”, International Journal of Engineering Trends and Technology (IJETT) – Volume 10, Issue No: 1 - Apr 2014.
  19. Chucai Yi, Student Member, IEEE, YingLi Tian, Senior Member, IEEE, Aries Arditi,” Portable Camera-based Assistive Text and Product Label Reading from Hand-held Objects for Blind Persons” IEEE/ASME Transactions on Mechatronics
  20. Author and Second Author. 2002. International Journal of Scientific Research in Science, Engineering and Technology. (Nov  2002),  ISSN NO:XXXX-XXXX DOI:10.251XXXXX

International Journal of Scientific Research in Science and Technology

Downloads

Published

2017-02-28

Issue

Volume 3, Issue 1, January-February-2017

Section

Research Articles

License

Copyright (c) IJSRST

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

How to Cite

[1]
Garima G. Charpe, Prashant M. Kakde, " Review on Development of Assistive Text & Product Label Recognition System for Blind Person, International Journal of Scientific Research in Science and Technology(IJSRST), Online ISSN : 2395-602X, Print ISSN : 2395-6011, Volume 3, Issue 1, pp.567-570, January-February-2017.