Translation evaluation without reference based on user behavior model

Abstract

How to evaluate the translation of a machine translation system is a very important research topic. The traditional method of translation evaluation without reference is used to evaluate the translation from the linguistic characteristics mostly. In this paper, the user cost of post-editing operation is considered, and a new method of evaluation translation based on user behavior model is proposed. First of all, track and record the process from the post-editing of machine translation to the forming of the final translation, and extract the decision knowledge of a user behavior; then use the knowledge as an indicator of translation evaluation, and evaluate the machine translation by combining with a language model. Experimental results show that in the absence of reference, the present method is much better than the method of using linguistic characteristics only, and the present method is close to BLEU method with one reference in Spearmen's rank order correlation coefficient with human evaluation.