Big Data with Cloud Computing: Discussions and Challenges
Keywords:
big data; data analysis; cloud computing; HadoopAbstract
With the recent advancements in computer technologies, the amount of data available is increasing day by day. However, excessive amounts of data create great challenges for users. Meanwhile, cloud computing services provide a powerful environment to store large volumes of data. They eliminate various requirements, such as dedicated space and maintenance of expensive computer hardware and software. Handling big data is a time-consuming task that requires large computational clusters to ensure successful data storage and processing. [1] Security and Privacy of information is the biggest challenge to cloud computing. Security and privacy issues can be overcome by employing encryption, security hardware and security applications.[2] In this work, the definition, classification, and characteristics of big data are discussed, along with various cloud services, such as Microsoft Azure, Google Cloud, Amazon Web Services, International Business Machine cloud, Hortonworks, and MapR. A comparative analysis of various cloud-based big data frameworks is also performed. Various research challenges are defined in terms of distributed database storage, data security, heterogeneity, and data visualization.[1]
References
- https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=9663258 BIG DATA MINING AND ANALYTICS ISSN 2096-0654 03/06 pp 32 – 40 Volume 5, Numbe r 1, Mar ch 2022 DOI: 10.26599/BDMA.2021.9020016 C The author(s) 2022. The articles published in this open access journal are distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/). Big Data with Cloud Computing: Discussions and Challenges
- https://www.tutorialspoint.com/cloud_computing/cloud_computing_challenges.htm
- J. H. Yu and Z. M. Zhou, Components and development in big data system: A survey, J. Electr. Sci. Technol., vol. 17, no. 1, pp. 51–72, 2019.
- S. Kumar and K. K. Mohbey, A review on big data based parallel and distributed approaches of pattern mining, J. King Saud Univ. – Comput. Inform. Sci., doi:
- https://en.wikipedia.org/wiki/Big_data
- F. Ridzuan and W. M. N. Wan Zainon, A review on data cleansing methods for big data, Procedia Comput. Sci., vol.
- https://www.javatpoint.com/big-data-characteristics
- https://www.techtarget.com/searchdatamanagement/definition/5-Vs-of-big-data
- L. Q. Kong, Z. F. Liu, and J. G. Wu, A systematic review of big data-based urban sustainability research: state-of-thescience and future directions, J. Clean. Prod., vol. 273, p. 123142, 2020.
- P. P¨a¨akk¨onen and D. Pakkala, Reference architecture and classification of technologies, products and services for big data systems, Big Data Res., vol. 2, no. 4, pp. 166–186, 2015.
- M. Wook, N. A. Hasbullah, N. M. Zainudin, Z. Z. A. Jabar, S. Ramli, N. A. M. Razali, and N. M. M. Yusop, Exploring big data traits and data quality dimensions for big data analytics application using partial least squares structural equation modelling, J. Big Data, vol. 8, no. 1, pp. 1–15, 2021.
- S. M. Shamsuddin and S. Hasan, Data science vs. big data @ UTM big data centre, in Proc. of 2015 IEEE Int. Conf. Science in Information Technology, Yogyakarta, Indonesia, 2015, pp. 1–4.
- T. Y. Yang and Y. Zhao, Application of cloud computing in biomedicine big data analysis cloud computing in big data, in Proc. of the 2017 Int. Conf. Algorithms, Methodology, Models and Applications in Emerging Technologies (ICAMMAET), Chennai, India, 2017, pp. 1–3.
Downloads
Published
Issue
Section
License
Copyright (c) IJSRST
This work is licensed under a Creative Commons Attribution 4.0 International License.