Yang Liu, Lei Si, Zhongbin Wang, Miao Chen, Xin Li, Dong Wei, Jinheng Gu
{"title":"A novel coal-rock recognition method in coal mining face based on fusing laser point cloud and images","authors":"Yang Liu, Lei Si, Zhongbin Wang, Miao Chen, Xin Li, Dong Wei, Jinheng Gu","doi":"10.1016/j.ijmst.2025.05.009","DOIUrl":null,"url":null,"abstract":"Rapid and accurate recognition of coal and rock is an important prerequisite for safe and efficient coal mining. In this paper, a novel coal-rock recognition method is proposed based on fusing laser point cloud and images, named Multi-Modal Frustum PointNet (MMFP). Firstly, MobileNetV3 is used as the backbone network of Mask R-CNN to reduce the network parameters and compress the model volume. The dilated convolutional block attention mechanism (Dilated CBAM) and inception structure are combined with MobileNetV3 to further enhance the detection accuracy. Subsequently, the 2D target candidate box is calculated through the improved Mask R-CNN, and the frustum point cloud in the 2D target candidate box is extracted to reduce the calculation scale and spatial search range. Then, the self-attention PointNet is constructed to segment the fused point cloud within the frustum range, and the bounding box regression network is used to predict the bounding box parameters. Finally, an experimental platform of shearer coal wall cutting is established, and multiple comparative experiments are conducted. Experimental results indicate that the proposed coal-rock recognition method is superior to other advanced models.","PeriodicalId":48625,"journal":{"name":"International Journal of Mining Science and Technology","volume":"18 1","pages":""},"PeriodicalIF":11.7000,"publicationDate":"2025-06-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Mining Science and Technology","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1016/j.ijmst.2025.05.009","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MINING & MINERAL PROCESSING","Score":null,"Total":0}
引用次数: 0
Abstract
Rapid and accurate recognition of coal and rock is an important prerequisite for safe and efficient coal mining. In this paper, a novel coal-rock recognition method is proposed based on fusing laser point cloud and images, named Multi-Modal Frustum PointNet (MMFP). Firstly, MobileNetV3 is used as the backbone network of Mask R-CNN to reduce the network parameters and compress the model volume. The dilated convolutional block attention mechanism (Dilated CBAM) and inception structure are combined with MobileNetV3 to further enhance the detection accuracy. Subsequently, the 2D target candidate box is calculated through the improved Mask R-CNN, and the frustum point cloud in the 2D target candidate box is extracted to reduce the calculation scale and spatial search range. Then, the self-attention PointNet is constructed to segment the fused point cloud within the frustum range, and the bounding box regression network is used to predict the bounding box parameters. Finally, an experimental platform of shearer coal wall cutting is established, and multiple comparative experiments are conducted. Experimental results indicate that the proposed coal-rock recognition method is superior to other advanced models.
期刊介绍:
The International Journal of Mining Science and Technology, founded in 1990 as the Journal of China University of Mining and Technology, is a monthly English-language journal. It publishes original research papers and high-quality reviews that explore the latest advancements in theories, methodologies, and applications within the realm of mining sciences and technologies. The journal serves as an international exchange forum for readers and authors worldwide involved in mining sciences and technologies. All papers undergo a peer-review process and meticulous editing by specialists and authorities, with the entire submission-to-publication process conducted electronically.