Automatic description of rock thin sections: A web application

The identification and characterization of rock types is a core activity in geology and related fields, including mining, petroleum, environmental science, industry, and construction. Traditionally, this task is performed by human specialists who analyze and describe the type, composition, texture, shape, and other properties of rock samples, whether collected in-situ or prepared in a laboratory. However, the process is subjective, dependent on the specialist’s experience, and time-consuming. This study proposes an artificial intelligence-based approach that combines computer vision and natural language processing to generate both textual and verbal descriptions from images of rock thin sections. A dataset of images and corresponding textual descriptions is used to train a hybrid deep learning model. Features extracted from the images using EfficientNetB7 are processed by a Transformer network to generate textual descriptions, which are then converted into verbal responses using a speech synthesis service. The experimental results show an accuracy of 0.892 and a BLEU score of 0.71. This model offers potential utility for research, professional, and academic applications and has been deployed as a web application for public use.