Research on the key technology of big data service in university library

Abstract

With the development of information technology of university library, the mass data of the university library has the basic characteristics of Big Data. However, the current situation of the university library is the lack of distributed storage and computing model for massive data, the lack of capacity to handl the diverse data sources, including the structured, semi-structured and unstructured data, the lack of a simple, flexible application model of big data service. In order to solve the problems in the service innovation of University Libraries in China, such as the problem of distributed storage and computation of massive data, the distributed management of diverse data sources, the simple and flexible application of big data services, this paper analyzes the research contents of big data processing, Hadoop ecosystem and the demand for big data services in University Libraries, and presents a technology framework for big data service in University Libraries based Hadoop. The framework includes the distributed storage and parallel computing model of mass data, the distributed management model of diverse data sources and the model of diversified service application for university libraries. This framework takes full account of the service innovation change of University Library under the environment of big data, such as data storage and calculation, data management and service applications et al. It can solve the key technical problems of big data service of University Library in a certain extent.