Proposing A New Methodology For Weather Forecasting By Using Big Data Analytics

S. Saranya; T. Meyyappan

doi:10.32628/IJSRST184860

Proposing A New Methodology For Weather Forecasting By Using Big Data Analytics

Authors(2) :-S. Saranya, T. Meyyappan

Big data has described an enormous quantity of data which needs new technologies to make potential to obtain value from it by analysis and capturing method. Data Analytics often includes scrutinizing past traditional data to research potential trends. Weather prognostication has been one of the most fascinating and exciting domain, and it performs an essential role in aerography. The weather situation is the state of the atmosphere at a given time regarding weather variables like wind direction, rainfall, cloud conditions, pressure, temperature, thunderstorm, etc. The Big data obtained by NCDC (National Climatic Data Center) has received over more than 116 weather locations and more than 1000 observations centers. The data produced by them is unstructured which grows a challenging job to explain it. In this paper, these enormous amounts of data have loaded onto the Apache Pig, Hadoop Distributed File System, Apache Hive is to process the data, which utilizes mappers and reducers to process the data. The above dataset has explained by using given methods and the final output of this project in the form of maximum, minimum and average temperature according to the given time and date.

Authors and Affiliations

S. Saranya
Research Scholar, Department of Computer Science Alagappa University, Karaikudi, India
T. Meyyappan
Department of Computer Science Alagappa University, Karaikudi, India

Big Data, Hadoop, HDFS, MapReduce, Mapper, Reducer, Min, Max, Average, NCDC.

N.Padmaja, Prof. T.Sudha, "Big Data Analytics With Long Range Plan To Process Large Data Sets," International Journal of Advanced Scientific Technologies, Engineering and Management Sciences, pp.87-90.

Harshawardhan S. Bhosale, Prof. Devendra P. Gadekar, "A Review Paper on Big Data and Hadoop," International Journal of Scientific and Research Publications, Volume 4, Issue 10, October 2014, pp.1-7.

National Climatic Data Center Data Documentation for Data Set 3260 (DSI-3260). ftp://ftp.ncdc.noaa.gov/pub/data/noaa/dsi3260.pdf.

Pooja S.Honnutagi, "The Hadoop distributed file system," International Journal of Computer Science and Information Technologies, Vol. 5 (5), 2014, 6238-6243.

Jimmy Lin and Chris Dyer, "Data-Intensive Text Processing with MapReduce," This is the pre-production manuscript of a book in the Morgan & Claypool Synthesis Lectures on Human Language Technologies. Anticipated publication date is mid-2010.

Publication Details

Published in : Volume 4 | Issue 8 | May-June 2018
Date of Publication : 2018-06-30
License: This work is licensed under a Creative Commons Attribution 4.0 International License.
Page(s) : 249-254
Manuscript Number : IJSRST184860
Publisher : Technoscience Academy

Print ISSN : 2395-6011, Online ISSN : 2395-602X

Cite This Article :

S. Saranya, T. Meyyappan, " Proposing A New Methodology For Weather Forecasting By Using Big Data Analytics, International Journal of Scientific Research in Science and Technology(IJSRST), Print ISSN : 2395-6011, Online ISSN : 2395-602X, Volume 4, Issue 8, pp.249-254, May-June-2018. Available at doi : 10.32628/IJSRST184860
Journal URL : http://ijsrst.com/IJSRST184860

Article Preview

Manuscript Number : IJSRST184860

Proposing A New Methodology For Weather Forecasting By Using Big Data Analytics