End-to-end solution for automatic beverage stock detection in supermarkets based on image processing and convolutional neural networks

Jorge Muñoz, Alonso Sanchez, Guillermo Kemper
{"title":"End-to-end solution for automatic beverage stock detection in supermarkets based on image processing and convolutional neural networks","authors":"Jorge Muñoz,&nbsp;Alonso Sanchez,&nbsp;Guillermo Kemper","doi":"10.1016/j.ijcce.2024.09.001","DOIUrl":null,"url":null,"abstract":"<div><div>This study addresses the challenge of detecting and identifying stock shortages in large warehouses through an advanced algorithm that integrates image processing and artificial intelligence techniques. Presently, many companies contend with the limitations of manual inventory management, such as susceptibility to errors, slow inventory actualizations, and consequent adverse economic effects. In contrast to solutions based on robotics, the proposed approach continuously monitors shelves throughout warehouse aisles using several fixed cameras, each connected to a single-board computer that processes the acquired images, identifies stock levels using deep learning, and updates a centralized database with stock analysis results. The algorithmic process begins with an image validation step based on a convolutional neural network to ensure obstacle-free images of the shelves. Subsequently, an application-specific YOLOv2 detector trained via transfer learning identifies product types captured in the images and estimates their stock levels. The proposed solution not only reduces the need for manual intervention and operational costs but also drastically enhances inventory supervision efficiency. The fully implemented system achieves an average accuracy of over 98 %, surpassing the human visual inspection performance. The proposed solution also incorporates the aspect of user-friendliness through a developed mobile application. This application connects to the centralized database, allowing inventory supervisors to receive alerts when the stock of a product falls below a user-configured threshold. This technological integration within a centralized system signifies a substantial advancement in inventory management, offering prompt responses to product scarcity situations and optimizing warehouse operational efficiency.</div></div>","PeriodicalId":100694,"journal":{"name":"International Journal of Cognitive Computing in Engineering","volume":"5 ","pages":"Pages 453-474"},"PeriodicalIF":0.0000,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Cognitive Computing in Engineering","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2666307424000342","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

This study addresses the challenge of detecting and identifying stock shortages in large warehouses through an advanced algorithm that integrates image processing and artificial intelligence techniques. Presently, many companies contend with the limitations of manual inventory management, such as susceptibility to errors, slow inventory actualizations, and consequent adverse economic effects. In contrast to solutions based on robotics, the proposed approach continuously monitors shelves throughout warehouse aisles using several fixed cameras, each connected to a single-board computer that processes the acquired images, identifies stock levels using deep learning, and updates a centralized database with stock analysis results. The algorithmic process begins with an image validation step based on a convolutional neural network to ensure obstacle-free images of the shelves. Subsequently, an application-specific YOLOv2 detector trained via transfer learning identifies product types captured in the images and estimates their stock levels. The proposed solution not only reduces the need for manual intervention and operational costs but also drastically enhances inventory supervision efficiency. The fully implemented system achieves an average accuracy of over 98 %, surpassing the human visual inspection performance. The proposed solution also incorporates the aspect of user-friendliness through a developed mobile application. This application connects to the centralized database, allowing inventory supervisors to receive alerts when the stock of a product falls below a user-configured threshold. This technological integration within a centralized system signifies a substantial advancement in inventory management, offering prompt responses to product scarcity situations and optimizing warehouse operational efficiency.
基于图像处理和卷积神经网络的超市饮料库存自动检测端到端解决方案
本研究通过整合图像处理和人工智能技术的先进算法,解决了在大型仓库中检测和识别库存短缺的难题。目前,许多公司都在与人工库存管理的局限性作斗争,例如容易出错、库存实际实现速度慢以及由此产生的不利经济影响。与基于机器人技术的解决方案不同,本文提出的方法是使用多个固定摄像头持续监控仓库过道中的货架,每个摄像头都连接到一台单板计算机,该计算机可处理获取的图像,利用深度学习识别库存水平,并根据库存分析结果更新中央数据库。算法流程首先是基于卷积神经网络的图像验证步骤,以确保货架图像无障碍。随后,通过迁移学习训练的特定应用 YOLOv2 检测器会识别图像中捕获的产品类型,并估算其库存水平。所提出的解决方案不仅减少了人工干预和运营成本,还大大提高了库存监管效率。全面实施后的系统平均准确率超过 98%,超过了人工视觉检测的性能。建议的解决方案还通过开发的移动应用程序实现了用户友好性。该应用程序连接到中央数据库,当产品库存低于用户配置的阈值时,库存主管就会收到警报。这种在中央系统内的技术整合标志着库存管理的巨大进步,可迅速应对产品稀缺的情况,优化仓库运营效率。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
13.80
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信