应用大数据技术评估该地区的自然湿度

Q4 Agricultural and Biological Sciences
A. I. Pavlova
{"title":"应用大数据技术评估该地区的自然湿度","authors":"A. I. Pavlova","doi":"10.12731/2658-6649-2023-15-3-139-154","DOIUrl":null,"url":null,"abstract":"Due to the sharp changes in climatic conditions in Western Siberia, the most pressing problem is food security associated with forecasting crop yields. There is a need to estimate the natural wetness of the area on the basis of agroclimatic indicators, among which the sum of active air temperatures and precipitation is currently the most widely used. \nBackground. However, for a comprehensive assessment of the wetness of the territory, it is necessary to take into account the climate energy resources associated with evaporation of different time resolutions (day, decades, months, vegetation period, year). The initial meteorological parameters are described in the form of poorly structured information of a large volume. Therefore, various technologies and algorithms of machine processing are used in the work. \nPurpose. The application of big data technologies to assess the natural moisture of the territory \nMaterials and methods.  With the help of the high-level Python programming language and engineering libraries, a comprehensive assessment of the territory was carried out using the example of Mirny of the Kochenevsky District of the Novosibirsk Region in the context of long-term average data and two years 2019 and 2020. That the use of machine processing technologies related to NoSQL data requests, creation of data set and big data slices allows to store and process meteorological parameters using cloud services of different time resolution. This makes it possible to significantly reduce the time for a comprehensive assessment of the territory according to agroclimatic parameters. As a result of the work, precipitation distribution, temperature, relative air humidity, evaporability, humidification coefficients (Ivanov-Vysotsky and Selyaninov hydrothermal coefficient) were obtained. \nResults. The paper proposes to use technologies of big data processing using Python, including pre-processing of poorly structured hydrometeorological data, execution of NoSQL queries, compilation of summary reports on agroclimatic parameters. Pre-processing consists of processing hourly meteorological data, filling gaps in the data, making slices in big data to process multi-temporal queries (day, month, growing season, year). By the example of Mirny farm in Kochenevsky district of Novosibirsk region (Russian Federation), big data processing was performed to calculate agroclimatic parameters to assess the natural moisture content of the area and  yield forecasting. \nConclusion. The practical significance of the work is as follows: \n- the application of big data processing technologies has significantly reduced the time for the labor-intensive process of assessing agrometeorological parameters; \n- obtained aggregated meteorological parameters of different temporal resolution (hours, days, decades, months) allowed us to identify a strong variability of agroclimatic conditions for the territory of Mirny farm Kochenevsky district, located in the forest-steppe zone of Western Siberia; \n- perform an integral assessment of agroclimatic conditions by calculating the integral indices of moisture, climate continentality, and agroclimatic potential.","PeriodicalId":21854,"journal":{"name":"Siberian Journal of Life Sciences and Agriculture","volume":" ","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2023-06-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"APPLICATION OF BIG DATA TECHNOLOGIES TO ASSESS THE NATURAL MOISTURE OF THE TERRITORY\",\"authors\":\"A. I. Pavlova\",\"doi\":\"10.12731/2658-6649-2023-15-3-139-154\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Due to the sharp changes in climatic conditions in Western Siberia, the most pressing problem is food security associated with forecasting crop yields. There is a need to estimate the natural wetness of the area on the basis of agroclimatic indicators, among which the sum of active air temperatures and precipitation is currently the most widely used. \\nBackground. However, for a comprehensive assessment of the wetness of the territory, it is necessary to take into account the climate energy resources associated with evaporation of different time resolutions (day, decades, months, vegetation period, year). The initial meteorological parameters are described in the form of poorly structured information of a large volume. Therefore, various technologies and algorithms of machine processing are used in the work. \\nPurpose. The application of big data technologies to assess the natural moisture of the territory \\nMaterials and methods.  With the help of the high-level Python programming language and engineering libraries, a comprehensive assessment of the territory was carried out using the example of Mirny of the Kochenevsky District of the Novosibirsk Region in the context of long-term average data and two years 2019 and 2020. That the use of machine processing technologies related to NoSQL data requests, creation of data set and big data slices allows to store and process meteorological parameters using cloud services of different time resolution. This makes it possible to significantly reduce the time for a comprehensive assessment of the territory according to agroclimatic parameters. As a result of the work, precipitation distribution, temperature, relative air humidity, evaporability, humidification coefficients (Ivanov-Vysotsky and Selyaninov hydrothermal coefficient) were obtained. \\nResults. The paper proposes to use technologies of big data processing using Python, including pre-processing of poorly structured hydrometeorological data, execution of NoSQL queries, compilation of summary reports on agroclimatic parameters. Pre-processing consists of processing hourly meteorological data, filling gaps in the data, making slices in big data to process multi-temporal queries (day, month, growing season, year). By the example of Mirny farm in Kochenevsky district of Novosibirsk region (Russian Federation), big data processing was performed to calculate agroclimatic parameters to assess the natural moisture content of the area and  yield forecasting. \\nConclusion. The practical significance of the work is as follows: \\n- the application of big data processing technologies has significantly reduced the time for the labor-intensive process of assessing agrometeorological parameters; \\n- obtained aggregated meteorological parameters of different temporal resolution (hours, days, decades, months) allowed us to identify a strong variability of agroclimatic conditions for the territory of Mirny farm Kochenevsky district, located in the forest-steppe zone of Western Siberia; \\n- perform an integral assessment of agroclimatic conditions by calculating the integral indices of moisture, climate continentality, and agroclimatic potential.\",\"PeriodicalId\":21854,\"journal\":{\"name\":\"Siberian Journal of Life Sciences and Agriculture\",\"volume\":\" \",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-06-30\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Siberian Journal of Life Sciences and Agriculture\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.12731/2658-6649-2023-15-3-139-154\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"Agricultural and Biological Sciences\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Siberian Journal of Life Sciences and Agriculture","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.12731/2658-6649-2023-15-3-139-154","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"Agricultural and Biological Sciences","Score":null,"Total":0}
引用次数: 0

摘要

由于西西伯利亚气候条件的急剧变化,最紧迫的问题是与预测作物产量相关的粮食安全。有必要根据农业气候指标来估计该地区的自然湿度,其中目前使用最广泛的是活跃气温和降水量的总和。背景然而,为了全面评估领土的湿度,有必要考虑与不同时间分辨率(天、几十年、月、植被期、年)的蒸发相关的气候能源资源。初始气象参数以大体积结构不良的信息的形式进行描述。因此,在工作中使用了各种机器处理技术和算法。意图应用大数据技术对境内自然水分进行评估的材料与方法。在高级Python编程语言和工程库的帮助下,以新西伯利亚地区科切涅夫斯基区的Mirny为例,在长期平均数据和2019年和2020年两年的背景下,对该地区进行了全面评估。使用与NoSQL数据请求、数据集创建和大数据切片相关的机器处理技术,可以使用不同时间分辨率的云服务存储和处理气象参数。这就可以大大缩短根据农业气候参数对领土进行全面评估的时间。结果得到了降水分布、温度、相对空气湿度、蒸发性、增湿系数(Ivanov-Vysotsky和Selyaninov水热系数)。后果本文提出使用Python进行大数据处理的技术,包括结构不良的水文气象数据的预处理、NoSQL查询的执行、农业气候参数总结报告的编写。预处理包括处理每小时的气象数据、填补数据空白、在大数据中切片以处理多时相查询(日、月、生长季节、年)。以新西伯利亚地区(俄罗斯联邦)Kochenevsky区Mirny农场为例,进行了大数据处理,计算了农业气候参数,以评估该地区的自然含水量和产量预测。结论这项工作的实际意义如下:-大数据处理技术的应用大大减少了劳动密集型农业气象参数评估过程的时间;-获得的不同时间分辨率(小时、天、几十年、几个月)的汇总气象参数使我们能够确定Mirny农场Kochenevsky区的农业气候条件的强烈可变性,该地区位于西西伯利亚的森林草原地带通过计算水分、气候大陆性和农业气候潜力的综合指数,对农业气候条件进行综合评估。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
APPLICATION OF BIG DATA TECHNOLOGIES TO ASSESS THE NATURAL MOISTURE OF THE TERRITORY
Due to the sharp changes in climatic conditions in Western Siberia, the most pressing problem is food security associated with forecasting crop yields. There is a need to estimate the natural wetness of the area on the basis of agroclimatic indicators, among which the sum of active air temperatures and precipitation is currently the most widely used. Background. However, for a comprehensive assessment of the wetness of the territory, it is necessary to take into account the climate energy resources associated with evaporation of different time resolutions (day, decades, months, vegetation period, year). The initial meteorological parameters are described in the form of poorly structured information of a large volume. Therefore, various technologies and algorithms of machine processing are used in the work. Purpose. The application of big data technologies to assess the natural moisture of the territory Materials and methods.  With the help of the high-level Python programming language and engineering libraries, a comprehensive assessment of the territory was carried out using the example of Mirny of the Kochenevsky District of the Novosibirsk Region in the context of long-term average data and two years 2019 and 2020. That the use of machine processing technologies related to NoSQL data requests, creation of data set and big data slices allows to store and process meteorological parameters using cloud services of different time resolution. This makes it possible to significantly reduce the time for a comprehensive assessment of the territory according to agroclimatic parameters. As a result of the work, precipitation distribution, temperature, relative air humidity, evaporability, humidification coefficients (Ivanov-Vysotsky and Selyaninov hydrothermal coefficient) were obtained. Results. The paper proposes to use technologies of big data processing using Python, including pre-processing of poorly structured hydrometeorological data, execution of NoSQL queries, compilation of summary reports on agroclimatic parameters. Pre-processing consists of processing hourly meteorological data, filling gaps in the data, making slices in big data to process multi-temporal queries (day, month, growing season, year). By the example of Mirny farm in Kochenevsky district of Novosibirsk region (Russian Federation), big data processing was performed to calculate agroclimatic parameters to assess the natural moisture content of the area and  yield forecasting. Conclusion. The practical significance of the work is as follows: - the application of big data processing technologies has significantly reduced the time for the labor-intensive process of assessing agrometeorological parameters; - obtained aggregated meteorological parameters of different temporal resolution (hours, days, decades, months) allowed us to identify a strong variability of agroclimatic conditions for the territory of Mirny farm Kochenevsky district, located in the forest-steppe zone of Western Siberia; - perform an integral assessment of agroclimatic conditions by calculating the integral indices of moisture, climate continentality, and agroclimatic potential.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Siberian Journal of Life Sciences and Agriculture
Siberian Journal of Life Sciences and Agriculture Biochemistry, Genetics and Molecular Biology-Biochemistry, Genetics and Molecular Biology (all)
CiteScore
0.80
自引率
0.00%
发文量
15
审稿时长
8 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信