Power of Big Data System for Storing and Processing Huge Data

Authors

  • Dr. S. Natarajan  Professor, Department of Computer Science, Karpagam Academy of Higher Education (Deemed to be University), Coimbatore, Tamil Nadu, India
  • Dr. S. Rajarajesware  HoD, Department of Computer Engineering, Sree NarayanaGuru Polytechnic College, Coimbatore, Tamil Nadu, India
  • Suresh Ram R  B. Tech (EEE) Student, Amrita Vishwa Vidhyapeetam (Deemed to be University), Coimbatore, Tamil Nadu, India

DOI:

https://doi.org//10.32628/IJSRST196422

Keywords:

Big Data, volume, variety, velocity, Big Data Analytics System, HDFC, Hadoop

Abstract

Big data uses storage of huge data with some approaches and techniques to manage and process them. During the past few years the number of persons using internet, email and other internet-based applications has been growing tremendously. Big Data is mainly characterized by 3V’s (Volume, Velocity and, Variety). The Big Data Architecture Framework (BDAF) is proposed to address all aspects of the Big Data Ecosystem. BDAF includes components such as Big Data Infrastructure, Big Data Analytics, Data structures & models, Big Data Lifecycle Management and Big Data Security. Nowadays the volume of data used by the people throughout the world is increasing enormously and exponentially. So, the need for storing, processing and protecting large volume of data has been becoming a great challenge in the modern hyper-connected world. On the basis of work from home concept lot of software professionals are doing their jobs with their internet connected systems for development, implementation, testing and maintenance of various softwares. These professionals and experts are sending and receiving lot of data to various locations to their clients, higher authorities and other officials frequently depending upon their requirements. The traditional data management models are not efficient for today’s exponentially growing data from variety of industries. This challenging task of storing and managing huge volume of data is achieved in Big Data Systems. In this paper we try to give an overview of Big Data Analytics system for storing and processing huge volume of various types of data. Overwhelming the security threats due to various factors like viruses, worms, etc are also great challenges to protect huge volume of data in a big data system.

References

  1. Securing Big Data: Security Recommendations for Hadoop and NoSQL Environments www.securosis.com.
  2. First Author and Second Author. 2002. International Journal of Scientific Research in Science, Engineering and Technology. (Nov 2002), ISSN NO:XXXX-XXXX DOI:10.251XXXXX
  3. S. Natarajan and S. Rajarajesware, "Computer Virus: A Major Network Security Threat," International Journal of Innovative Research & Development, vol. 3, no. 7, pp. 229-302, 2014.
  4. Arushi Gupta, Asmita Sharma, AsthaSahu, Anjali Mukati and AshleshaPanse, (2016), ‘Study Of Pros And Cons In The Education System Using Big Data’, International Journal Of Engineering Sciences & Research Technology.
  5. Miss Gurpreet Kaur Jangla and Mrs. Deepa.A.Amne, ‘Development of an Intrusion Detection System based on Big Data for Detecting Unknown Attacks’, ISSN (Online) 2278-1021ISSN (Print) 2319 5940 International Journal of Advanced Research in Computer and Communication Engineering Vol. 4, Issue 12, December 2015.
  6. Harshawardhan S. Bhosale, Prof. Devendra P. Gadekar, (2014), ‘A Review Paper on Big Data and Hadoop’, International Journal of Scientific and Research Publications, Volume 4, Issue 10, ISSN 2250-3153.
  7. Priya P. Sharma et al, (2014), ‘Securing Big Data Hadoop: A Review of Security Issues, Threats and Solution’, (IJCSIT) International Journal of Computer Science and Information Technologies, Vol. 5 (2), 2126-2131
  8. Nishu Arora and Rajesh Kumar Bawa, (2014), ‘A Review on Cloud to Handle and Process Big Data’, International Journal of Innovations & Advancement in Computer Science IJIACS ISSN 2347 – 8616 Volume 3, Issue 5.
  9. Big Data Analytics for Security Intelligence September 2013, CLOUD SECURITY ALLIANCE.
  10. . Seungwoo Jeon, Bonghee Hong, Joonho Kwon, Yoon-sik Kwak and Seok-il Song, (2013)
  11. ‘Redundant Data Removal Technique for Efficient Big Data Search Processing’, International Journal of Software Engineering and Its Applications Vol. 7, No. 4.
  12. Prashant Kumar B and Khushboo Pandeya, (2013), ‘Big Data and Distributed Data Mining: An Example of Future Networks’, Volume 1, Issue 2 (2013) 36-39 ISSN 2347 - 3258 International Journal of Advance Research and Innovation.
  13.  Azza Abouzeid, Kamil BajdaPawlikowski, Daniel Abadi, AviSilberschatz and Alexander Rasin, (2009),’ HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads’.
  14.  Fay Chang, Jeffrey Dean, Sanjay Ghemawat, Wilson C. Hsieh, Deborah A. Wallach
  15. Mike Burrows, Tushar Chandra, Andrew Fikes and Robert E. Gruber, (2006), ‘Bigtable: A Distributed Storage System for Structured Data’.
  16. https://www.ey.com/Publication/vwLUAssets/EY__Big_data:_changing_the_way_businesses_operate/%24FILE/EY-Insights-on-GRC-Big-data.pdf
  17. https://wikibon.com/wikibons-2018-big-data-analytics-trends-forecast/ YuriDemchenko, Canh Ngo, Peter Membrey., Architecture Framework and Components for the Big Data Ecosystem Draft Version 0.2

Downloads

Published

2019-08-30

Issue

Section

Research Articles

How to Cite

[1]
Dr. S. Natarajan, Dr. S. Rajarajesware, Suresh Ram R, " Power of Big Data System for Storing and Processing Huge Data, International Journal of Scientific Research in Science and Technology(IJSRST), Online ISSN : 2395-602X, Print ISSN : 2395-6011, Volume 6, Issue 4, pp.138-142, July-August-2019. Available at doi : https://doi.org/10.32628/IJSRST196422