Two Approaches for Recognizing the Structure of Block Diagrams

Abstract

Introduction. Working with graphic images is an essential element of almost any modern computer-aided design systems. The result of neural network, including deep image processing, can be recognition of the belonging classes of objects present on them. Objects of the real world require large expenditures for the development and implementation of highly specialized computer vision systems. In recent years, there has been an improvement of the quality characteristics obtained in the field of technical vision. This is made possible by artificial neural networks. The article deals with the recognition of a flat, black and white flowchart image. These are two-dimensional images or their selected parts, which are displayed in an arbitrary graphic format by system means on a computer monitor screen. Basic block diagram shapes: rectangle, rhombus, parallelogram, circle, ellipse (oval), etc. The purpose of the article is to solve the problem of graphic image recognition. The systems for the recognition of graphic images include modern systems of computer-aided design, management and document management. The article has formed a basic set of training and test images of block diagram nodes. Neural network models are proposed to improve the detection accuracy of block diagram nodes based on fully connected and convolutional neural networks. Results. The basic procedures of the block diagram image recognition algorithm were partially tested at the software level, and allow us to conclude the effectiveness of the proposed structural methods. A comparative analysis of neural network and syntactic structural approaches for solving this problem is carried out. Conclusions. Two methods of recognizing flat graphic figures and recognizing connections between figures in flowcharts are proposed: a method of recursive traversal of all branches of the tree of the current union of connections between figures and the figures themselves, and also a study was carried out for the created neural network in PyTorch to solve this problem using trained neural network methods. Keywords: image recognition, convolutional neural networks, syntactic analysis.