Evaluating Large Language Models in Translation: A Theoretical and Practical Analysis Based on Skopos Theory

Authors : Dilara Bal, Şaban Köktürk

Pages : 819-826

Doi:10.29110/soylemdergi.1602093

View : 38 | Download : 56

Publication Date : 2025-03-25

Article Type : Research Paper

Abstract :The aim of this study is to analyse the translation abilities of large language models, such as GPT-4, through various theoretical lenses within translation studies. This study is unique in its comprehensive evaluation of these models\\\' translation performance based on skopos theory. This research assesses how well large language models align with these theoretical frameworks and their effectiveness in producing contextually appropriate and culturally sensitive translations. The research explores the architecture and operational principles of large language models, explaining their application in translation. Methodologically, the study employs a comparative analysis of translations generated by large language models across language pairs amongst Turkish, English and Spanish. The analysis focuses on key theoretical aspects, such as the purpose and functionality of translations. Additionally, the study examines the cultural and contextual appropriateness of translations generated by large language models, evaluating their ability to maintain cultural nuances and meet the expectations set by the respective translation theories. The findings reveal the strengths and limitations of large language models in adhering to theoretical principles, providing insights into their potential to enhance or challenge traditional translation practices. This research advances the theoretical understanding of machine translation and offers practical recommendations for improving the translation capabilities of large language models. By integrating theoretical analysis with practical applications, the study aims to provide insight into future developments in translation technologies and their role in the future of translation studies.
Keywords : Büyük dil modelleri, çeviri kuramları, nöral makine çevirisi, skopos teorisi, çeviri teknolojileri