Web Scraping Techniques to Collect Weather Data in South Sumatera

In some cities in South Sumatra has several weather measurement points owned by several different institutions such as BMKG, AngkasaPura, Lapan, and others. However, to get the latest weather data in detail within a specified period constrained the bureaucratic process to each institution. While the availability of weather datasets is needed in conducting researches in the field of data analytics to predict the weather and analyses for DSS that require weather patterns. On the other hand, some websites provide real-time weather data for some cities. For that in this research, we use web scraping technology to collect weather data in some cities in South Sumatera surrounding on some websites. Web scraping technology is a technique for retrieving the contents of a web page individually. The data collected by this web scraping technique will form a database or data warehouse that can be used for further research for weather forecast data mining in South Sumatra, which in the future can be developed weather-based decision support application.