Dzhavdet Suleymanov, Lenara Kubedinova, A. Gatiatullin, N. Prokopyev
{"title":"形态翻译在机器翻译系统创建“TurkLang-7”项目训练数据集增强中的应用","authors":"Dzhavdet Suleymanov, Lenara Kubedinova, A. Gatiatullin, N. Prokopyev","doi":"10.1109/UBMK55850.2022.9919552","DOIUrl":null,"url":null,"abstract":"The paper discusses an approach to solving the problem of low-resource languages in the development of neural network machine translation systems for Turkic language pairs by artificially increasing training data in form of parallel corpora. The basis of this approach lies in usage of toolset of the multilingual portal “Turkic Morpheme” for morphological analysis and generation of word forms. The issues of creating machine translation systems for Turkic languages are considered, a hypothesis about possibility of using the presented approach to improve the results of machine learning is formulated, and the rationale for using morphological analysis methods is given. The developed algorithm for artificial augmentation of training data is presented.","PeriodicalId":417604,"journal":{"name":"2022 7th International Conference on Computer Science and Engineering (UBMK)","volume":"75 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Usage of Morphotranslation in Data Augmentation of the Training Dataset for “TurkLang-7” Project on MT Systems Creation\",\"authors\":\"Dzhavdet Suleymanov, Lenara Kubedinova, A. Gatiatullin, N. Prokopyev\",\"doi\":\"10.1109/UBMK55850.2022.9919552\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The paper discusses an approach to solving the problem of low-resource languages in the development of neural network machine translation systems for Turkic language pairs by artificially increasing training data in form of parallel corpora. The basis of this approach lies in usage of toolset of the multilingual portal “Turkic Morpheme” for morphological analysis and generation of word forms. The issues of creating machine translation systems for Turkic languages are considered, a hypothesis about possibility of using the presented approach to improve the results of machine learning is formulated, and the rationale for using morphological analysis methods is given. The developed algorithm for artificial augmentation of training data is presented.\",\"PeriodicalId\":417604,\"journal\":{\"name\":\"2022 7th International Conference on Computer Science and Engineering (UBMK)\",\"volume\":\"75 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-09-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 7th International Conference on Computer Science and Engineering (UBMK)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/UBMK55850.2022.9919552\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 7th International Conference on Computer Science and Engineering (UBMK)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/UBMK55850.2022.9919552","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Usage of Morphotranslation in Data Augmentation of the Training Dataset for “TurkLang-7” Project on MT Systems Creation
The paper discusses an approach to solving the problem of low-resource languages in the development of neural network machine translation systems for Turkic language pairs by artificially increasing training data in form of parallel corpora. The basis of this approach lies in usage of toolset of the multilingual portal “Turkic Morpheme” for morphological analysis and generation of word forms. The issues of creating machine translation systems for Turkic languages are considered, a hypothesis about possibility of using the presented approach to improve the results of machine learning is formulated, and the rationale for using morphological analysis methods is given. The developed algorithm for artificial augmentation of training data is presented.