機(jī)器翻譯系統(tǒng)翻譯質(zhì)量的人工評價模型
發(fā)布時間:2018-06-18 18:38
本文選題:機(jī)器翻譯 + 人工評價; 參考:《廣東外語外貿(mào)大學(xué)》2017年碩士論文
【摘要】:機(jī)器翻譯研究發(fā)展迅速已歷經(jīng)數(shù)個重要階段。它從早期的基于規(guī)則的方法發(fā)展到基于實例的方法再到統(tǒng)計方法。而機(jī)器翻譯的翻譯評價一直是其中一個活躍的領(lǐng)域。該領(lǐng)域有令人鼓舞的成果,但困難依然存在。自動評價標(biāo)準(zhǔn)不夠準(zhǔn)確,而翻譯質(zhì)量評估的標(biāo)準(zhǔn)也難以適應(yīng)機(jī)器翻譯的質(zhì)量評價。該論文提出了機(jī)器翻譯的人工評價模型,旨在解決以上的問題。已有的統(tǒng)計機(jī)器翻譯的評價指標(biāo)要么是僅僅從詞語選擇和詞語順序方面評價譯文或者是它們的評價標(biāo)準(zhǔn)呈現(xiàn)相互交疊的情況。該模型包含兩個方面:評價指標(biāo)、評價指標(biāo)的權(quán)重。評價指標(biāo)有三個:信息性、語法性、語言多樣性。該模型的構(gòu)建基于系統(tǒng)思想理論,一個完整的系統(tǒng)應(yīng)包含組成元素、相互關(guān)系、以及組合成后的系統(tǒng)的復(fù)雜性。該論文由組成元素對于系統(tǒng)的意義推導(dǎo)出譯文評價的信息性指標(biāo),由相互關(guān)系對于系統(tǒng)的意義推導(dǎo)出譯文評價的語法性指標(biāo),以及同理可得的語言多樣性指標(biāo)。評價指標(biāo)的權(quán)重反映了每個指標(biāo)之間的相對重要性的關(guān)系。在對模型的有效性進(jìn)行測試中,本文選取了具有代表性的兩個機(jī)器翻譯系統(tǒng):谷歌翻譯和百度翻譯。同時,該測試還在新聞,經(jīng)濟(jì)和體育三個領(lǐng)域隨機(jī)選取了30個漢語句子,作為翻譯原文本。得出的譯文將由Asiya(開放在線機(jī)器翻譯評價軟件)上面的METEOR進(jìn)行打分,同時也將由人工評價模型進(jìn)行打分。該論文分析比較了由兩種評價工具所得的分?jǐn)?shù)結(jié)果:METEOR和人工評價模型在評價結(jié)果上是一致的。進(jìn)一步的分析得出人工評價模型的分?jǐn)?shù)結(jié)果比METEOR的更加穩(wěn)定,人工評價模型的分?jǐn)?shù)結(jié)果的變異系數(shù)是6.58%,METEOR的變異系數(shù)是29.1%。因此,該人工評價模型能夠提高機(jī)器翻譯質(zhì)量評價的準(zhǔn)確性。同時,該模型因為評價指標(biāo)本身可以量化的特點,所以能夠?qū)⒃撃P蛻?yīng)用到機(jī)器翻譯系統(tǒng)的自動評價標(biāo)準(zhǔn)里,提升評價準(zhǔn)確性,幫助不斷改善機(jī)器翻譯的譯文質(zhì)量。
[Abstract]:The rapid development of machine translation research has gone through several important stages. It developed from the early rule-based approach to the case-based method and then to the statistical method. The translation evaluation of machine translation has always been an active field. There have been encouraging results in this area, but difficulties remain. The automatic evaluation criteria are not accurate enough, and the translation quality assessment criteria are difficult to adapt to machine translation quality evaluation. In this paper, a manual evaluation model of machine translation is proposed to solve the above problems. The existing evaluation criteria of statistical machine translation are either evaluated only in terms of word selection and word order or their evaluation criteria overlap with each other. The model includes two aspects: the evaluation index and the weight of the evaluation index. There are three evaluation indicators: informational, grammatical and linguistic diversity. The model is based on the theory of system theory. A complete system should include the elements, the relationship, and the complexity of the combined system. In this paper, the information index of translation evaluation is derived from the meaning of component elements to the system, the grammatical index of translation evaluation and the linguistic diversity index are derived from the meaning of interrelation to the system. The weight of the evaluation index reflects the relative importance of each index. In order to test the validity of the model, this paper selects two representative machine translation systems: Google Translation and Baidu Translation. At the same time, the test also randomly selected 30 Chinese sentences in news, economics and sports as the original text. The resulting translation will be scored by Meter on Asiya (Open online Machine Translation Evaluation Software) and by a manual evaluation model. This paper analyzes and compares the score results obtained by two evaluation tools: Meter and the artificial evaluation model in the evaluation results are consistent. Further analysis showed that the score of artificial evaluation model was more stable than that of Meter. The coefficient of variation of the score of artificial evaluation model was 6.58 and the coefficient of variation of METEOR was 29.1. Therefore, the artificial evaluation model can improve the accuracy of machine translation quality evaluation. At the same time, the model can be applied to the automatic evaluation standard of machine translation system because of the quantifiable characteristics of the evaluation index itself, so it can improve the accuracy of evaluation and help to improve the translation quality of machine translation.
【學(xué)位授予單位】:廣東外語外貿(mào)大學(xué)
【學(xué)位級別】:碩士
【學(xué)位授予年份】:2017
【分類號】:H085
【參考文獻(xiàn)】
相關(guān)期刊論文 前5條
1 馬紅霞,錢兆華;20世紀(jì)系統(tǒng)思想發(fā)展的回顧[J];系統(tǒng)辯證學(xué)學(xué)報;2003年01期
2 張華夏;論系統(tǒng)思想——走向21世紀(jì)的系統(tǒng)辯證哲學(xué)思潮[J];系統(tǒng)辯證學(xué)學(xué)報;1998年03期
3 馮志偉;機(jī)器翻譯——從實驗室走向市場[J];語言文字應(yīng)用;1997年03期
4 閻德勝;俄漢翻譯與系統(tǒng)思想[J];外語學(xué)刊(黑龍江大學(xué)學(xué)報);1995年03期
5 劉文海;論系統(tǒng)思想[J];中國社會科學(xué)院研究生院學(xué)報;1993年04期
,本文編號:2036481
本文鏈接:http://sikaile.net/wenyilunwen/yuyanyishu/2036481.html
最近更新
教材專著