Review
ZHAO Hongmei, LV Yajuan, BEN Guosheng, HUANG Yun, LIU Qun
2012, 26(1): 22-31.
The 7th China Workshop on Machine Translation(CWMT2011)Evaluation continues the ongoing series of evaluation of machine translation technology in China. This paper presents an overall introduction to CWMT2011 evaluation. This evaluation focuses on the evaluation of MT translation from other languages to Chinese, especially, from ethnic languages (including Mongolian, Tibetan, Uyghur, Kazakh and Kirghiz). 165 systems of 19 participants from home and aboard have taken part in the evaluation. The paper introduces the evaluation tasks, the evaluation data, the evaluation procedure and the participants. We also discuss the evaluation results in details. The examples from this evaluation show that the evaluation result depends on the following factorsthe similarity between the source language and the target language, the range of the field which the evaluation task involves, the similarity between the test data and the training/development data, the size of the training data, the technology and the maturity of the participating system, and etc.
Key wordsmachine translation; machine translation evaluation; BLEU-SBP; WoodPecker evaluation