Design of Paper Duplicate Detection System Based on Lucene

Abstract

Full-text retrieval is a very popular technology in recent information search area. Lucene is an open-source full-text search engine toolkit, and has excellent system architecture and wide application foreground. Based on paper duplicate detection system research, we introduce Lucene theory and analyze two pivotal work steps of Lucene which are index creation module and index search module. We describe the paper duplicate detection system design and implementation, and discuss key technology of highlight and combination of B/S mode and C/S mode. We provide excellent solution for similar system development.