The duplicated of partial content detection based on PSO

Abstract

It is discussed how to detect the duplicated of partial contents between two documents in this paper. There are some algorithms which can detect similarity among documents. But these algorithms cannot detect the duplicated of partial contents in documents. A new effective algorithm of the duplicated of partial contents detection in documents is put forward in this paper. The new algorithm is using PSO algorithm to search the optimized partial contents which is the most similar in two documents. For PSO algorithm, it provides the encoding of the particles. A new related coefficient of strings is defined for strings similarity. And the new evaluation function of PSO is designed based on the related coefficient function. The hybrid mutation PSO algorithm is used for searching the most similar partial contents quickly and accurately. The simulation experiments indicate that the algorithm can search the most similar partial contents in two documents effectively.