Chenhao Qian , Huan Yang , Jayadev Acharya , Jingqiu Liao , Renata Ivanek , Martin Wiedmann
{"title":"初始化用于托管基准数据集的公共存储库,以促进食品安全中的机器学习模型开发。","authors":"Chenhao Qian , Huan Yang , Jayadev Acharya , Jingqiu Liao , Renata Ivanek , Martin Wiedmann","doi":"10.1016/j.jfp.2025.100463","DOIUrl":null,"url":null,"abstract":"<div><div>While there is clear potential for artificial intelligence (AI) and machine learning (ML) models to help improve food safety, the development and deployment of these models in the food safety domain are by and large lacking. The absence of publicly available databases that host well-curated datasets that can be used to develop and validate AI /ML models represents one likely barrier. Thus, we took three previously published datasets, which we further cleaned and annotated, and made them publicly available in a repository called Cornell Food Safety ML Repository. The selected datasets include (i) presence or absence of <em>Listeria</em> spp. in soil samples collected across the U.S. with paired metadata for soil properties, geolocation, climate, and surrounding land use, (ii) presence or absence of <em>Salmonella</em> and <em>Campylobacter</em> in young chicken carcasses tested in processing facilities with associated meteorological and temporal metadata, and (iii) presence or absence of fecal contamination as well as <em>E. coli</em> concentration in New York watersheds with associated metadata for land use, water attributes, and meteorological factors. These datasets can serve as benchmark datasets for developing ML models. To demonstrate the utility of the repository, we developed customizable scripts as well as LazyPredict (a quick screening method) scripts for training different types of ML models using the shared datasets. While this repository provides an important starting point that will allow for the development and testing of ML models to predict foodborne pathogens contamination in different sources, the inclusion of further datasets is clearly needed to advance this field. This paper thus includes a call to action for the deposit of well-curated datasets that can be used for further development of predictive models in food safety. This paper will also discuss the benefits of such public databases, including the assessment of data-sharing scenarios using existing privacy-preserving techniques.</div></div>","PeriodicalId":15903,"journal":{"name":"Journal of food protection","volume":"88 3","pages":"Article 100463"},"PeriodicalIF":2.1000,"publicationDate":"2025-02-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Initializing a Public Repository for Hosting Benchmark Datasets to Facilitate Machine Learning Model Development in Food Safety\",\"authors\":\"Chenhao Qian , Huan Yang , Jayadev Acharya , Jingqiu Liao , Renata Ivanek , Martin Wiedmann\",\"doi\":\"10.1016/j.jfp.2025.100463\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>While there is clear potential for artificial intelligence (AI) and machine learning (ML) models to help improve food safety, the development and deployment of these models in the food safety domain are by and large lacking. The absence of publicly available databases that host well-curated datasets that can be used to develop and validate AI /ML models represents one likely barrier. Thus, we took three previously published datasets, which we further cleaned and annotated, and made them publicly available in a repository called Cornell Food Safety ML Repository. The selected datasets include (i) presence or absence of <em>Listeria</em> spp. in soil samples collected across the U.S. with paired metadata for soil properties, geolocation, climate, and surrounding land use, (ii) presence or absence of <em>Salmonella</em> and <em>Campylobacter</em> in young chicken carcasses tested in processing facilities with associated meteorological and temporal metadata, and (iii) presence or absence of fecal contamination as well as <em>E. coli</em> concentration in New York watersheds with associated metadata for land use, water attributes, and meteorological factors. These datasets can serve as benchmark datasets for developing ML models. To demonstrate the utility of the repository, we developed customizable scripts as well as LazyPredict (a quick screening method) scripts for training different types of ML models using the shared datasets. While this repository provides an important starting point that will allow for the development and testing of ML models to predict foodborne pathogens contamination in different sources, the inclusion of further datasets is clearly needed to advance this field. This paper thus includes a call to action for the deposit of well-curated datasets that can be used for further development of predictive models in food safety. This paper will also discuss the benefits of such public databases, including the assessment of data-sharing scenarios using existing privacy-preserving techniques.</div></div>\",\"PeriodicalId\":15903,\"journal\":{\"name\":\"Journal of food protection\",\"volume\":\"88 3\",\"pages\":\"Article 100463\"},\"PeriodicalIF\":2.1000,\"publicationDate\":\"2025-02-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of food protection\",\"FirstCategoryId\":\"97\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0362028X25000158\",\"RegionNum\":4,\"RegionCategory\":\"农林科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"BIOTECHNOLOGY & APPLIED MICROBIOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of food protection","FirstCategoryId":"97","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0362028X25000158","RegionNum":4,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"BIOTECHNOLOGY & APPLIED MICROBIOLOGY","Score":null,"Total":0}
引用次数: 0
摘要
虽然人工智能(AI)和机器学习(ML)模型在帮助改善食品安全方面具有明显的潜力,但这些模型在食品安全领域的开发和部署总体上是缺乏的。缺乏公开可用的数据库来托管精心策划的数据集,这些数据集可用于开发和验证AI /ML模型,这可能是一个障碍。因此,我们采用了三个先前发布的数据集,我们进一步清理和注释,并在一个名为Cornell Food Safety ML repository的存储库中公开提供它们。选择的数据集包括(i)在美国各地收集的土壤样本中是否存在李斯特菌,并对土壤特性、地理位置、气候和周围土地使用进行配对元数据,(ii)在加工设施中测试的雏鸡尸体中是否存在沙门氏菌和弯曲杆菌,并使用相关的气象和时间元数据。(iii)纽约流域是否存在粪便污染以及大肠杆菌浓度,并提供与土地利用、水属性和气象因素相关的元数据。这些数据集可以作为开发ML模型的基准数据集。为了演示存储库的实用性,我们开发了可定制的脚本以及LazyPredict(一种快速筛选方法)脚本,用于使用共享数据集训练不同类型的ML模型。虽然这个存储库提供了一个重要的起点,将允许ML模型的开发和测试,以预测食源性病原体污染的不同来源,包括进一步的数据集显然需要推进这一领域。因此,本文呼吁采取行动,储存精心整理的数据集,这些数据集可用于进一步开发食品安全预测模型。本文还将讨论这种公共数据库的好处,包括使用现有隐私保护技术评估数据共享方案。
Initializing a Public Repository for Hosting Benchmark Datasets to Facilitate Machine Learning Model Development in Food Safety
While there is clear potential for artificial intelligence (AI) and machine learning (ML) models to help improve food safety, the development and deployment of these models in the food safety domain are by and large lacking. The absence of publicly available databases that host well-curated datasets that can be used to develop and validate AI /ML models represents one likely barrier. Thus, we took three previously published datasets, which we further cleaned and annotated, and made them publicly available in a repository called Cornell Food Safety ML Repository. The selected datasets include (i) presence or absence of Listeria spp. in soil samples collected across the U.S. with paired metadata for soil properties, geolocation, climate, and surrounding land use, (ii) presence or absence of Salmonella and Campylobacter in young chicken carcasses tested in processing facilities with associated meteorological and temporal metadata, and (iii) presence or absence of fecal contamination as well as E. coli concentration in New York watersheds with associated metadata for land use, water attributes, and meteorological factors. These datasets can serve as benchmark datasets for developing ML models. To demonstrate the utility of the repository, we developed customizable scripts as well as LazyPredict (a quick screening method) scripts for training different types of ML models using the shared datasets. While this repository provides an important starting point that will allow for the development and testing of ML models to predict foodborne pathogens contamination in different sources, the inclusion of further datasets is clearly needed to advance this field. This paper thus includes a call to action for the deposit of well-curated datasets that can be used for further development of predictive models in food safety. This paper will also discuss the benefits of such public databases, including the assessment of data-sharing scenarios using existing privacy-preserving techniques.
期刊介绍:
The Journal of Food Protection® (JFP) is an international, monthly scientific journal in the English language published by the International Association for Food Protection (IAFP). JFP publishes research and review articles on all aspects of food protection and safety. Major emphases of JFP are placed on studies dealing with:
Tracking, detecting (including traditional, molecular, and real-time), inactivating, and controlling food-related hazards, including microorganisms (including antibiotic resistance), microbial (mycotoxins, seafood toxins) and non-microbial toxins (heavy metals, pesticides, veterinary drug residues, migrants from food packaging, and processing contaminants), allergens and pests (insects, rodents) in human food, pet food and animal feed throughout the food chain;
Microbiological food quality and traditional/novel methods to assay microbiological food quality;
Prevention of food-related hazards and food spoilage through food preservatives and thermal/non-thermal processes, including process validation;
Food fermentations and food-related probiotics;
Safe food handling practices during pre-harvest, harvest, post-harvest, distribution and consumption, including food safety education for retailers, foodservice, and consumers;
Risk assessments for food-related hazards;
Economic impact of food-related hazards, foodborne illness, food loss, food spoilage, and adulterated foods;
Food fraud, food authentication, food defense, and foodborne disease outbreak investigations.