Big Data: Research Issues and Challenges

Authors

  • Qamar Rayees Khan   Department of Computer Science, Baba Ghulam Shah Badshah University, Rajouri, Jammu & Kashmir, India

Keywords:

Big Data, Analytics, Hadoop, HDFS, Map Reduce,

Abstract

In the present digital and computing world, it is believed that over two billion people are connected to the internet, and over five billion people own mobile phones. By 2025, there is going to be a TSUNAMI of 50 billion devices to be connected with Internet. The prediction of data will be 45 times more than in couple of years and is growing at an exponential rate. These datasets generated by various sources are not only huge in volume but also high in velocity and variety, thus making it difficult to handle using traditional tools and techniques. There is a need to gain valuable insights in order to handle and extract knowledge from these data sets. Big data analytics help to provide that value and knowledge by discovering the unexpected patterns in the ocean of data. The aim of this paper is to provide overview of Big Data Analytics, characteristics of Big data, technologies, issues and challenges related with Big Data.

References

  1. Worldometers, “Real time world statistics,” 2014, http://www.worldometers.info/world-population/.
  2. http://www.digitalpromise.org/blog/entry/realizing- theopportunity-for-big-data-in-education
  3. D. Che, M. Safran, and Z. Peng, “From Big Data to Big Data Mining: challenges, issues, and opportunities,” in Database Systems for Advanced Applications, pp. 1–15, Springer, Berlin,Germany, 2013.
  4. Diebold, F. X. (2012). A personal perspective on the origin(s) and development of “big data”: The phenomenon, the term, and the discipline (ScholarlyPaper No. ID 2202843). Social Science Research Network
  5. Laney, D. (2001, February 6). 3-D data management: Controlling data volume, velocity and variety. Application Delivery Strategies by META Group Inc
  6. Min Chen, Shiwen Mao, and Yunhao Liu, “Big Data: A Survey”, 2014 Springer.
  7. Amir Gandomi and MurtazaHaider, “Beyond the hype:Big data concepts, methods, and analytics”, 2015 ELSEVIER.
  8. Avita Katal, Mohammad Wazid, and R H Goudar, “BigData: Issues. Challenges, Tools and Good Practices”, 2013 IEEE.
  9. Uzma Shafaque, Parag D. Thakare, Mangesh M. Ghonge, and Milindkumar V. Sarode, “Algorithm and Approaches to Handle Big Data”, National Level Technical Conference “XPLORE 14, 2014 IJCA.
  10. Schroeck, M., Shockley, R., Smart, J., Romero- Morales, D., & Tufano, P.(2012). Analytics: The real-world use of big data.How innovative enterprises extract value from uncertain data. IBM Institute for Business Value.
  11. Cukier K., The Economist, Data, data everywhere: A special report on managing information, 2010
  12. “Challenges and Opportunities with Big Data”, Acommunity white paper developed by leading researchers across the United States, 2012.
  13. Dhole Poonam B, GunjalBaisa L, “Survey Paper on Traditional Hadoop and Pipelined Map Reduce”,International Journal of Computational Engineering Research Vol 03, Issue12
  14. “Leveraging Massively Parallel Processing in an Oracle Environment for Big Data”, An Oracle White Paper, November 2010.
  15. Jeffrey Dean and Sanjay Ghemawat, “Map Reduce: Simplified Data Processing on Large Clusters”, Google, Inc.
  16. Vibhavari chavan, Rajesh N. Phursule, “Survey paper on Big Data, IJCSIT , Vol. 5, 2014, PP. 7932- 7939”. Technologies, Vol. 5 (6), 2014,7932-7939”.
  17. Kubick, W.R.: Big Data, Information and Meaning. In: Clinical Trail insights, Pp. 26-28, 2012
  18. Russom, P.: Big Data Analytics. In: TDWI Best Practices Report, pp. 1–40 (2011)
  19. Elgendy, N.: Big Data Analytics in Support of the Decision Making Process. MSc Thesis, German University in Cairo, p. 164 (2013)
  20. Suman Arora, Dr. Madhu Goel, “Survey Paper on Scheduling in Hadoop”, International Journal of Advance Research in Computer Science and Software Engineering Volume 4, Issue 5, May 2014
  21. Cuzzocrea, A., Song, I., Davis, K.C.: Analytics over Large-Scale Multidimensional Data:The Big Data Revolution! In: Proceedings of the ACM International Workshop on Data Warehousing and OLAP, pp. 101–104 (2011)
  22. EMC: Data Science and Big Data Analytics. In: EMC Education Services, pp. 1–508 (2012)
  23. Lee, R., Luo, T., Huai, Y., Wang, F., He, Y., Zhang, X.: Ysmart: Yet Another SQL-to-MapReduce Translator. In: IEEE International Conference on Distributed Computing Systems (ICDCS), pp. 25–36 (2011)
  24. Chen H, Chiang RHL, Storey VC. Business intelligence and analytics: from big data to big impact. MIS Quart.2012; 36(4):1165–88
  25. Stephen Kaisler, Frank Armour, J. Alberto Espinosa, andWilliam Money, “Big data: Issues and challenges Moving forward”, 2012 IEEE.
  26. Avita Katal, Mohammad Wazid, and R H Goudar, “BigData: Issues. Challenges, Tools and Good Practices”, 2013 IEEE.
  27. Chaffin, D., Heidl, R., Hollenbeck, J. R., Howe, M., Yu, A., Voorhees, C., & Calantone, R. The promise and perils of wearable sensors in organizational research. Organizational Research Methods. Published online ahead of print. doi: 10.1177/1094428115617004, 2015.
  28. Sismeiro, C., & Bucklin, R. E. Modeling purchase behavior at an e-commerce web site: A task- completion approach. Journal of Marketing Research, 41: 306–323, 2004.
  29. Varian, H. R. Big data: New tricks for econometrics.The Journal of Economic Perspectives, 28: 3–27, 2014.
  30. Prajapati, V. Big data analytics with R and Hadoop.Birmingham, England: Packt Publishing,2013.
  31. Manning, C. D., Raghavan, P., & Schu¨ tze, H, Intro- duction to information retrieval. Cambridge, England: Cambridge University Press, 2009.
  32. Teixeira, T., Wedel, M., & Pieters, R. Emotion- induced engagement in internet video advertisements. Journal of Marketing Research, 49: 144–159, 2012
  33. Hastie, T., Tibshirani, R., & Friedman, J. 2009. The el- ements of statistical learning: Data mining, in- ference and prediction (2nd ed.). Berlin, Germany: Springer.
  34. George, E. I., & McCulloch, R. E,. Variable selection via Gibbs sampling. Journal of the American Statis- tical Association, 88: 881–889, 1993
  35. Archak, N., Ghose, A., & Ipeirotis, P. G. . Deriving the pricing power of product features by mining consumer reviews. Management Science, 57: 1485– 1509,2011.
  36. Loughran, T., & McDonald, B. When is a liability not a liability? Textual analysis, dictionaries, and 10-Ks. The Journal of Finance, 66: 35–65,2011.
  37. Simonsohn, U., Simmons, J. P., & Nelson, L. D, Specification curve: Descriptive and inferential statistics on all reasonable specifications. Available online at SSRN. doi: 10.2139/ssrn.2694998, 2015

Downloads

Published

2017-10-31

Issue

Section

Research Articles

How to Cite

[1]
Qamar Rayees Khan , " Big Data: Research Issues and Challenges, International Journal of Scientific Research in Science and Technology(IJSRST), Online ISSN : 2395-602X, Print ISSN : 2395-6011, Volume 3, Issue 7, pp.1485-1493, September-October-2017.