Web Scraping Techniques to Collect Weather Data in South Sumatera

2018 International Conference on Electrical Engineering and Computer Science (ICECOS) Pub Date : 2018-10-01 DOI:10.1109/ICECOS.2018.8605202

Fatmasari, Yesi Novaria Kunang, S. D. Purnamasari

{"title":"Web Scraping Techniques to Collect Weather Data in South Sumatera","authors":"Fatmasari, Yesi Novaria Kunang, S. D. Purnamasari","doi":"10.1109/ICECOS.2018.8605202","DOIUrl":null,"url":null,"abstract":"In some cities in South Sumatra has several weather measurement points owned by several different institutions such as BMKG, AngkasaPura, Lapan, and others. However, to get the latest weather data in detail within a specified period constrained the bureaucratic process to each institution. While the availability of weather datasets is needed in conducting researches in the field of data analytics to predict the weather and analyses for DSS that require weather patterns. On the other hand, some websites provide real-time weather data for some cities. For that in this research, we use web scraping technology to collect weather data in some cities in South Sumatera surrounding on some websites. Web scraping technology is a technique for retrieving the contents of a web page individually. The data collected by this web scraping technique will form a database or data warehouse that can be used for further research for weather forecast data mining in South Sumatra, which in the future can be developed weather-based decision support application.","PeriodicalId":149318,"journal":{"name":"2018 International Conference on Electrical Engineering and Computer Science (ICECOS)","volume":"76 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2018-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"18","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2018 International Conference on Electrical Engineering and Computer Science (ICECOS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICECOS.2018.8605202","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 18

Abstract

In some cities in South Sumatra has several weather measurement points owned by several different institutions such as BMKG, AngkasaPura, Lapan, and others. However, to get the latest weather data in detail within a specified period constrained the bureaucratic process to each institution. While the availability of weather datasets is needed in conducting researches in the field of data analytics to predict the weather and analyses for DSS that require weather patterns. On the other hand, some websites provide real-time weather data for some cities. For that in this research, we use web scraping technology to collect weather data in some cities in South Sumatera surrounding on some websites. Web scraping technology is a technique for retrieving the contents of a web page individually. The data collected by this web scraping technique will form a database or data warehouse that can be used for further research for weather forecast data mining in South Sumatra, which in the future can be developed weather-based decision support application.

查看原文本刊更多论文

收集南苏门答腊天气数据的网络抓取技术

在南苏门答腊岛的一些城市有几个天气测量点，由几个不同的机构拥有，如BMKG, AngkasaPura, Lapan等。然而，要在特定时期内获得详细的最新天气数据，限制了每个机构的官僚程序。而天气数据集的可用性是进行数据分析领域的研究，以预测天气和分析需要天气模式的决策支持所必需的。另一方面，一些网站提供一些城市的实时天气数据。为此，在本研究中，我们使用网页抓取技术在一些网站上收集了南苏门答腊一些城市周围的天气数据。网页抓取技术是一种单独检索网页内容的技术。通过这种网络抓取技术收集的数据将形成一个数据库或数据仓库，可用于南苏门答腊天气预报数据挖掘的进一步研究，将来可开发基于天气的决策支持应用程序。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

2018 International Conference on Electrical Engineering and Computer Science (ICECOS)

自引率

0.00%

发文量