Design Of High Flexibility Visual Search And Analysis Engine System

Abstract

With the rapid development of the Internet, access logs grow explosively and contain rich important information. There are various requirements for temporary log analysis, such as fault location, business characteristics analysis, and system operation. This kind of requirements are temporary, sudden and diverse. In order to meet this kind of requirements quickly, a distributed visual search and analysis engine system is designed, which has high flexibility and low threshold. The flexibility of the system is enhanced by abstracting the general search and analysis engine module, supporting the configurable extension of statistical dimension and providing user-friendly visual interface. At the same time, for unified management of configuration files, abstract matrix extended framework, which can improve the loading automation of configuration file and descriptibility of dependency relationship. Finally, two case studies verify the feasibility and flexibility of the system.