WarenstromInfo:轻松提取贸易流数据并将其可视化的工具

Octavio Mesa-Varona, Carolina Plaza-Rodríguez, Lars Valentin, Matthias Filter
{"title":"WarenstromInfo:轻松提取贸易流数据并将其可视化的工具","authors":"Octavio Mesa-Varona, Carolina Plaza-Rodríguez, Lars Valentin, Matthias Filter","doi":"10.3897/rio.10.e112227","DOIUrl":null,"url":null,"abstract":"Epidemiological outbreak investigations often prove to be lengthy and inconclusive due to the time-consuming nature of the currently-used approaches. An alternative approach to address these challenges could involve the application of algorithms to support authorities and food business operators by providing timely, relevant and reliable information. Algorithms, such as gravity models, could be applied as commodity trade models, but they require a large amount of reliable and consistent data on trade for generating projections at international, national or even regional level. Several trade databases, such as UN COMTRADE, EUROSTAT, BACI, CHELEM and GTAP, provide information on trace, albeit with variations in the provided information and in the structure. However, it is worth noting that not all of these databases are freely accessible and data management can pose challenges, hampering the access to the trade data. WarenstromInfo (WI) was created as a software solution that allows easy trade data extraction and visualisation for application in different areas, such as outbreak investigations.\n WarenstromInfo (WI) is an application tool that automatically extracts, decodes and visually displays trade flow data from EUROSTAT \"EU trade since 2002 by statistical procedure, by HS2-4-6 and CN8 (DS-059322)\" (hereinafter referred to EUROSTAT) and the BACI databases, based on user input.\n WI was developed by using the open-source desktop software KNIME Analytics Platform. WI offers the flexibility to be executed either as a web service on a KNIME Web Server infrastructure or as a local resource.\n To integrate the BACI database into WI, the database is annually downloaded as csv files, rebuilt as a SQLite database and hosted locally into the KNIME Web Server Infrastructure. In order to optimise storage space on the KNIME server, this SQLite database specifically includes only agrifood data, reflecting the tool´s focus. However, if new objectives are established, this database can be expanded. Further, data of the SQLite database can be customised by executing the WI workflow locally, enabling the user to expand the database at any time.\n In contrast to BACI, trade data extraction from the EUROSTAT database is performed via the EUROSTAT’s API (Application Programming Interface) applying GET requests and XML data management.\n WI displays four User-friendly Interfaces (UIs) designed with interactive KNIME nodes that facilitate the input of variables. The extracted trade flow data are shown through interactive tables directly within the UIs. This feature enables users to easily explore the data in a structured and user-friendly manner. Additionally, WI incorporates the extracted trade flow data into maps. These maps provide a visual representation of the data, allowing users to gain insights and identify patterns and trends geographically. Both, the data table and the maps, can be downloaded as a single Excel file (containing multiple preformatted tables) and as png files, respectively.","PeriodicalId":92718,"journal":{"name":"Research ideas and outcomes","volume":"80 2","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-02-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"WarenstromInfo: a tool for the easy extraction and visualisation of trade flow data\",\"authors\":\"Octavio Mesa-Varona, Carolina Plaza-Rodríguez, Lars Valentin, Matthias Filter\",\"doi\":\"10.3897/rio.10.e112227\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Epidemiological outbreak investigations often prove to be lengthy and inconclusive due to the time-consuming nature of the currently-used approaches. An alternative approach to address these challenges could involve the application of algorithms to support authorities and food business operators by providing timely, relevant and reliable information. Algorithms, such as gravity models, could be applied as commodity trade models, but they require a large amount of reliable and consistent data on trade for generating projections at international, national or even regional level. Several trade databases, such as UN COMTRADE, EUROSTAT, BACI, CHELEM and GTAP, provide information on trace, albeit with variations in the provided information and in the structure. However, it is worth noting that not all of these databases are freely accessible and data management can pose challenges, hampering the access to the trade data. WarenstromInfo (WI) was created as a software solution that allows easy trade data extraction and visualisation for application in different areas, such as outbreak investigations.\\n WarenstromInfo (WI) is an application tool that automatically extracts, decodes and visually displays trade flow data from EUROSTAT \\\"EU trade since 2002 by statistical procedure, by HS2-4-6 and CN8 (DS-059322)\\\" (hereinafter referred to EUROSTAT) and the BACI databases, based on user input.\\n WI was developed by using the open-source desktop software KNIME Analytics Platform. WI offers the flexibility to be executed either as a web service on a KNIME Web Server infrastructure or as a local resource.\\n To integrate the BACI database into WI, the database is annually downloaded as csv files, rebuilt as a SQLite database and hosted locally into the KNIME Web Server Infrastructure. In order to optimise storage space on the KNIME server, this SQLite database specifically includes only agrifood data, reflecting the tool´s focus. However, if new objectives are established, this database can be expanded. Further, data of the SQLite database can be customised by executing the WI workflow locally, enabling the user to expand the database at any time.\\n In contrast to BACI, trade data extraction from the EUROSTAT database is performed via the EUROSTAT’s API (Application Programming Interface) applying GET requests and XML data management.\\n WI displays four User-friendly Interfaces (UIs) designed with interactive KNIME nodes that facilitate the input of variables. The extracted trade flow data are shown through interactive tables directly within the UIs. This feature enables users to easily explore the data in a structured and user-friendly manner. Additionally, WI incorporates the extracted trade flow data into maps. These maps provide a visual representation of the data, allowing users to gain insights and identify patterns and trends geographically. Both, the data table and the maps, can be downloaded as a single Excel file (containing multiple preformatted tables) and as png files, respectively.\",\"PeriodicalId\":92718,\"journal\":{\"name\":\"Research ideas and outcomes\",\"volume\":\"80 2\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-02-07\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Research ideas and outcomes\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.3897/rio.10.e112227\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Research ideas and outcomes","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3897/rio.10.e112227","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

由于目前使用的方法耗时较长,流行病学爆发调查往往耗时较长,且无法得出结论。应对这些挑战的另一种方法是应用算法,通过提供及时、相关和可靠的信息,为当局和食品企业经营者提供支持。重力模型等算法可用作商品贸易模型,但它们需要大量可靠和一致的贸易数据,以生成国际、国家甚至区域一级的预测。一些贸易数据库,如联合国商品贸易统计数据库(UN COMTRADE)、欧洲统计局(EUROSTAT)、BACI、CHELEM 和 GTAP 等,都提供了有关跟踪的信息,尽管所提供的信息和结构各不相同。不过,值得注意的是,并非所有这些数据库都可以免费访问,而且数据管理可能会带来挑战,妨碍对贸易数据的访问。WarenstromInfo (WI) 作为一种软件解决方案应运而生,可轻松提取贸易数据并将其可视化,以应用于不同领域,如疫情调查。WarenstromInfo (WI) 是一种应用工具,可自动提取、解码和直观显示欧盟统计局的贸易流数据 "2002 年以来按统计程序、HS2-4-6 和 CN8 分类的欧盟贸易(DS-059322)"。(以下简称 EUROSTAT)和 BACI 数据库中的贸易流数据。WI 是利用开源桌面软件 KNIME 分析平台开发的。WI 既可作为 KNIME 网络服务器基础架构上的网络服务,也可作为本地资源灵活使用。为了将 BACI 数据库整合到 WI 中,数据库每年以 csv 文件的形式下载,然后重建为 SQLite 数据库,并托管到 KNIME 网络服务器基础设施的本地。为了优化 KNIME 服务器的存储空间,该 SQLite 数据库仅包含农粮数据,以反映该工具的重点。但是,如果有新的目标,该数据库可以扩展。此外,SQLite 数据库的数据可通过本地执行 WI 工作流程进行定制,使用户能够随时扩展数据库。与 BACI 不同的是,从 EUROSTAT 数据库中提取贸易数据是通过应用 GET 请求和 XML 数据管理的 EUROSTAT API(应用编程接口)进行的。WI 显示四个用户友好界面(UIs),这些界面设计有交互式 KNIME 节点,便于输入变量。提取的贸易流数据通过交互式表格直接显示在用户界面中。这一功能使用户能够以结构化和用户友好的方式轻松探索数据。此外,WI 还将提取的贸易流数据纳入地图。这些地图提供了数据的可视化表示,使用户能够深入了解并识别地理上的模式和趋势。数据表和地图可分别以单个 Excel 文件(包含多个预格式化表格)和 png 文件的形式下载。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
WarenstromInfo: a tool for the easy extraction and visualisation of trade flow data
Epidemiological outbreak investigations often prove to be lengthy and inconclusive due to the time-consuming nature of the currently-used approaches. An alternative approach to address these challenges could involve the application of algorithms to support authorities and food business operators by providing timely, relevant and reliable information. Algorithms, such as gravity models, could be applied as commodity trade models, but they require a large amount of reliable and consistent data on trade for generating projections at international, national or even regional level. Several trade databases, such as UN COMTRADE, EUROSTAT, BACI, CHELEM and GTAP, provide information on trace, albeit with variations in the provided information and in the structure. However, it is worth noting that not all of these databases are freely accessible and data management can pose challenges, hampering the access to the trade data. WarenstromInfo (WI) was created as a software solution that allows easy trade data extraction and visualisation for application in different areas, such as outbreak investigations. WarenstromInfo (WI) is an application tool that automatically extracts, decodes and visually displays trade flow data from EUROSTAT "EU trade since 2002 by statistical procedure, by HS2-4-6 and CN8 (DS-059322)" (hereinafter referred to EUROSTAT) and the BACI databases, based on user input. WI was developed by using the open-source desktop software KNIME Analytics Platform. WI offers the flexibility to be executed either as a web service on a KNIME Web Server infrastructure or as a local resource. To integrate the BACI database into WI, the database is annually downloaded as csv files, rebuilt as a SQLite database and hosted locally into the KNIME Web Server Infrastructure. In order to optimise storage space on the KNIME server, this SQLite database specifically includes only agrifood data, reflecting the tool´s focus. However, if new objectives are established, this database can be expanded. Further, data of the SQLite database can be customised by executing the WI workflow locally, enabling the user to expand the database at any time. In contrast to BACI, trade data extraction from the EUROSTAT database is performed via the EUROSTAT’s API (Application Programming Interface) applying GET requests and XML data management. WI displays four User-friendly Interfaces (UIs) designed with interactive KNIME nodes that facilitate the input of variables. The extracted trade flow data are shown through interactive tables directly within the UIs. This feature enables users to easily explore the data in a structured and user-friendly manner. Additionally, WI incorporates the extracted trade flow data into maps. These maps provide a visual representation of the data, allowing users to gain insights and identify patterns and trends geographically. Both, the data table and the maps, can be downloaded as a single Excel file (containing multiple preformatted tables) and as png files, respectively.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
审稿时长
2 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信