Structure from motion-convolutional neural network model (SfM-CNN) achieved accurate portable Chinese dietary chemical composition estimation for dietary recall
Peihua Ma , Hsuan Chih Hong , Xiaoxue Jia , Cheng Jan Chi , Ning Xiao , Bei Fan , Fengzhong Wang , Cheng-I Wei
{"title":"Structure from motion-convolutional neural network model (SfM-CNN) achieved accurate portable Chinese dietary chemical composition estimation for dietary recall","authors":"Peihua Ma , Hsuan Chih Hong , Xiaoxue Jia , Cheng Jan Chi , Ning Xiao , Bei Fan , Fengzhong Wang , Cheng-I Wei","doi":"10.1016/j.foodchem.2025.144908","DOIUrl":null,"url":null,"abstract":"<div><div>Accurately estimating the chemical composition of dietary intake is essential for health and nutrition management, especially in regions with complex culinary diversity like China. This study introduces a novel AI-driven solution using a Structure from Motion-Convolutional Neural Network (SfM-CNN) model to automate chemical composition analysis of Chinese food. By integrating advanced 3D reconstruction techniques with deep learning, specifically the Scale-Invariant Feature Transform (SIFT) algorithm, we achieved superior feature extraction and food volume estimation with less than 4 % error. Our model, trained on the newly developed ChineseDish-100 dataset, demonstrated an R<sup>2</sup> of 0.949 for carbohydrate content estimation using the SIFT-ResNet50 architecture. The model's interpretability was enhanced through visualizations, facilitating parameter optimization and reliable chemical composition estimation. These results underscore the potential of AI-powered models in providing efficient, accurate, and culturally relevant dietary analysis tools, marking a significant advancement for nutritional science, food chemistry, and public health initiatives in culturally diverse regions.</div></div>","PeriodicalId":318,"journal":{"name":"Food Chemistry","volume":"489 ","pages":"Article 144908"},"PeriodicalIF":8.5000,"publicationDate":"2025-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Food Chemistry","FirstCategoryId":"97","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0308814625021594","RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CHEMISTRY, APPLIED","Score":null,"Total":0}
引用次数: 0
Abstract
Accurately estimating the chemical composition of dietary intake is essential for health and nutrition management, especially in regions with complex culinary diversity like China. This study introduces a novel AI-driven solution using a Structure from Motion-Convolutional Neural Network (SfM-CNN) model to automate chemical composition analysis of Chinese food. By integrating advanced 3D reconstruction techniques with deep learning, specifically the Scale-Invariant Feature Transform (SIFT) algorithm, we achieved superior feature extraction and food volume estimation with less than 4 % error. Our model, trained on the newly developed ChineseDish-100 dataset, demonstrated an R2 of 0.949 for carbohydrate content estimation using the SIFT-ResNet50 architecture. The model's interpretability was enhanced through visualizations, facilitating parameter optimization and reliable chemical composition estimation. These results underscore the potential of AI-powered models in providing efficient, accurate, and culturally relevant dietary analysis tools, marking a significant advancement for nutritional science, food chemistry, and public health initiatives in culturally diverse regions.
期刊介绍:
Food Chemistry publishes original research papers dealing with the advancement of the chemistry and biochemistry of foods or the analytical methods/ approach used. All papers should focus on the novelty of the research carried out.