Proposing A New Methodology For Weather Forecasting By Using Big Data Analytics

Authors

  • S. Saranya  Research Scholar, Department of Computer Science Alagappa University, Karaikudi, India
  • T. Meyyappan  Department of Computer Science Alagappa University, Karaikudi, India

Keywords:

Big Data, Hadoop, HDFS, MapReduce, Mapper, Reducer, Min, Max, Average, NCDC.

Abstract

Big data has described an enormous quantity of data which needs new technologies to make potential to obtain value from it by analysis and capturing method. Data Analytics often includes scrutinizing past traditional data to research potential trends. Weather prognostication has been one of the most fascinating and exciting domain, and it performs an essential role in aerography. The weather situation is the state of the atmosphere at a given time regarding weather variables like wind direction, rainfall, cloud conditions, pressure, temperature, thunderstorm, etc. The Big data obtained by NCDC (National Climatic Data Center) has received over more than 116 weather locations and more than 1000 observations centers. The data produced by them is unstructured which grows a challenging job to explain it. In this paper, these enormous amounts of data have loaded onto the Apache Pig, Hadoop Distributed File System, Apache Hive is to process the data, which utilizes mappers and reducers to process the data. The above dataset has explained by using given methods and the final output of this project in the form of maximum, minimum and average temperature according to the given time and date.

References

  1. N.Padmaja, Prof. T.Sudha, "Big Data Analytics With Long Range Plan To Process Large Data Sets," International Journal of Advanced Scientific Technologies, Engineering and Management Sciences, pp.87-90.
  2. Harshawardhan S. Bhosale, Prof. Devendra P. Gadekar, "A Review Paper on Big Data and Hadoop," International Journal of Scientific and Research Publications, Volume 4, Issue 10, October 2014, pp.1-7.
  3. National Climatic Data Center Data Documentation for Data Set 3260 (DSI-3260). ftp://ftp.ncdc.noaa.gov/pub/data/noaa/dsi3260.pdf.
  4. Pooja S.Honnutagi, "The Hadoop distributed file system," International Journal of Computer Science and Information Technologies, Vol. 5 (5), 2014, 6238-6243.
  5. Jimmy Lin and Chris Dyer, "Data-Intensive Text Processing with MapReduce," This is the pre-production manuscript of a book in the Morgan & Claypool Synthesis Lectures on Human Language Technologies. Anticipated publication date is mid-2010.

Downloads

Published

2018-06-30

Issue

Section

Research Articles

How to Cite

[1]
S. Saranya, T. Meyyappan, " Proposing A New Methodology For Weather Forecasting By Using Big Data Analytics, International Journal of Scientific Research in Science and Technology(IJSRST), Online ISSN : 2395-602X, Print ISSN : 2395-6011, Volume 4, Issue 8, pp.249-254, May-June-2018.