Recognition of fabric composition of clothing in an image in e-commerce using neural networks

Objectives . Development of new approach for recognizing the fabric composition of clothing in e-commerce images by using generative adversarial network(GAN) to generate synthetic images of clothing with known fabric composition, to be used to train the CNN to classify the fabric composition of real clothing images. Instead of a classic clothing image, a copy is generated with the material zoomed to fibers and fabric structure. Methods . The main methods to recognize the fabric composition of the clothing image in the e-commerce are the creation and annotation of a dataset for the neural network training, synthesis of the fabric of clothing, the choice of architecture and its modification, validation and testing, and interpretation of the results. Results . Experimental results with the constructed method show that it is effective for accurately recognizing the fabric composition of e-commerce clothing to be used to improve search and browsing on websites. Conclusion . In the course of the experiment, using a generative adversarial network, a data set of e-commerce products was synthesized and annotated, neural networks were built to recognize the composition of the fabric of clothing items. The results of the study showed that the new approach for recognizing the fabric of clothing provides higher accuracy in comparison with already known methods, in addition, the use of the attention model also gives good results to improve the metrics.