Evaluating Large Language Models in Translation:  A Theoretical and Practical Analysis Based on Skopos Theory

Dilara Bal; Şaban Köktürk

Makale detayları

Evaluating Large Language Models in Translation: A Theoretical and Practical Analysis Based on Skopos Theory

Yazarlar:

Dilara Bal | Şaban Köktürk

Yayıncı:

Yusuf ÇETİN

Ana Başlıklar:

Çeviri ve Yorum Çalışmaları

Dergi:

Söylem Filoloji Dergisi Issue Çeviribilim Özel Sayısı II, pp.819-826

Belge Tipi:

Makale

Yayın Tarihi:

3/2025

Belge Dili:

İngilizce

Document ID (Org No.):

2001332535

pISSN:

2548-0502

Anahtar kelimeler:

Özet:

 The aim of this study is to analyse the translation abilities of large language models, such as GPT-4, through various theoretical lenses within translation studies. This study is unique in its comprehensive evaluation of these models translation performance based on skopos theory. This research assesses how well large language models align with these theoretical frameworks and their effectiveness in producing contextually appropriate and culturally sensitive translations. The research explores the architecture and operational principles of large language models, explaining their application in translation. Methodologically, the study employs a comparative analysis of translations generated by large language models across language pairs amongst Turkish, English and Spanish. The analysis focuses on key theoretical aspects, such as the purpose and functionality of translations. Additionally, the study examines the cultural and contextual appropriateness of translations generated by large language models, evaluating their ability to maintain cultural nuances and meet the expectations set by the respective translation theories. The findings reveal the strengths and limitations of large language models in adhering to theoretical principles, providing insights into their potential to enhance or challenge traditional translation practices. This research advances the theoretical understanding of machine translation and offers practical recommendations for improving the translation capabilities of large language models. By integrating theoretical analysis with practical applications, the study aims to provide insight into future developments in translation technologies and their role in the future of translation studies.

 The aim of this study is to analyse the translation abilities of large language models, such as GPT-4, through various theoretical lenses within translation studies. This study is unique in its comprehensive evaluation of these models translation performance based on skopos theory. This research assesses how well large language models align with these theoretical frameworks and their effectiveness in producing contextually appropriate and culturally sensitive translations. The research explores the architecture and operational principles of large language models, explaining their application in translation. Methodologically, the study employs a comparative analysis of translations generated by large language models across language pairs amongst Turkish, English and Spanish. The analysis focuses on key theoretical aspects, such as the purpose and functionality of translations. Additionally, the study examines the cultural and contextual appropriateness of translations generated by large language models, evaluating their ability to maintain cultural nuances and meet the expectations set by the respective translation theories. The findings reveal the strengths and limitations of large language models in adhering to theoretical principles, providing insights into their potential to enhance or challenge traditional translation practices. This research advances the theoretical understanding of machine translation and offers practical recommendations for improving the translation capabilities of large language models. By integrating theoretical analysis with practical applications, the study aims to provide insight into future developments in translation technologies and their role in the future of translation studies.

 The aim of this study is to analyse the translation abilities of large language models, such as GPT-4, through various theoretical lenses within translation studies. This study is unique in its comprehensive evaluation of these models translation performance based on skopos theory. This research assesses how well large language models align with these theoretical frameworks and their effectiveness in producing contextually appropriate and culturally sensitive translations. The research explores the architecture and operational principles of large language models, explaining their application in translation. Methodologically, the study employs a comparative analysis of translations generated by large language models across language pairs amongst Turkish, English and Spanish. The analysis focuses on key theoretical aspects, such as the purpose and functionality of translations. Additionally, the study examines the cultural and contextual appropriateness of translations generated by large language models, evaluating their ability to maintain cultural nuances and meet the expectations set by the respective translation theories. The findings reveal the strengths and limitations of large language models in adhering to theoretical principles, providing insights into their potential to enhance or challenge traditional translation practices. This research advances the theoretical understanding of machine translation and offers practical recommendations for improving the translation capabilities of large language models. By integrating theoretical analysis with practical applications, the study aims to provide insight into future developments in translation technologies and their role in the future of translation studies.

 Bu çalışmanın amacı, GPT-4 gibi büyük dil modellerinin çeviri edinçlerini çeviribilim alanındaki kuramlar aracılığıyla incelemektir. Bu çalışma, büyük dil modellerinin çeviri edimlerini skopos teorisine dayalı kapsamlı bir değerlendirme yapması bakımından özgündür. Bu araştırma, büyük dil modellerinin bu teorik çerçevelerle ne kadar iyi uyum sağladığını ve bağlamsal olarak uygun ve kültürel olarak hassas çeviriler üretmedeki başarısını değerlendirir. Araştırma, büyük dil modellerinin mimarisini ve işleyiş ilkelerini inceleyerek çeviride uygulamalarını açıklar. Yöntemde, çalışma Türkçe, İngilizce ve İspanyolca arasında dil çiftleri arasında büyük dil modelleri tarafından üretilen çevirilerin karşılaştırmalı analizini kullanır. Analiz, çevirilerin amacı ve işlevselliği gibi temel kuramsal yönlere odaklanır. Ayrıca, çalışma büyük dil modelleri tarafından üretilen çevirilerin kültürel ve bağlamsal uygunluğunu inceler, kültürel nüansları koruma ve ilgili çeviri teorilerinin koyduğu beklentileri karşılama edinçlerini değerlendirir. Bulgular, büyük dil modellerinin teorik ilkelere bağlı kalmadaki güçlü ve zayıf yönlerini ortaya koyarak geleneksel çeviri uygulamalarını geliştirme veya bunları değiştirme konularını tartışır. Bu araştırma yalnızca makine çevirisinin kuramsal kısmına katkı sağlamakla kalmıyor, aynı zamanda büyük dil modellerinin çeviri edinçlerini geliştirmek için öneriler de sunuyor. Kuram ve uygulamayı bütünleştirerek, çeviri teknolojilerindeki gelecekteki gelişmelere ve çeviribilimin geleceğindeki rollerine ilişkin tartışma alanı açmayı amaçlıyor.

Makale detayları

Evaluating Large Language Models in Translation: A Theoretical and Practical Analysis Based on Skopos Theory

Yazarlar:

Dilara Bal | Şaban Köktürk

Yayıncı:

Yusuf ÇETİN

Ana Başlıklar:

Çeviri ve Yorum Çalışmaları

Dergi:

Söylem Filoloji Dergisi Issue Çeviribilim Özel Sayısı II, pp.819-826

Belge Tipi:

Makale

Yayın Tarihi:

3/2025

Belge Dili:

İngilizce

Document ID (Org No.):

2001332535

pISSN:

2548-0502

Large language models

translation theories

neural machine translation

skopos theory

translation technologiesBüyük dil modelleri

çeviri kuramları

nöral makine çevirisi

skopos teorisi

çeviri teknolojileri

Sayı

Makale detayları

Yazarlar: Dilara Bal | Şaban Köktürk

Yayıncı: Yusuf ÇETİN

Ana Başlıklar: Çeviri ve Yorum Çalışmaları

Dergi: Söylem Filoloji Dergisi Issue Çeviribilim Özel Sayısı II, pp.819-826

Belge Tipi: Makale

Yayın Tarihi: 3/2025

Belge Dili: İngilizce

Document ID (Org No.): 2001332535

pISSN: 2548-0502

Sayı

Yazarlar:

Dilara Bal | Şaban Köktürk

Yayıncı:

Yusuf ÇETİN

Ana Başlıklar:

Çeviri ve Yorum Çalışmaları

Dergi:

Söylem Filoloji Dergisi Issue Çeviribilim Özel Sayısı II, pp.819-826

Belge Tipi:

Makale

Yayın Tarihi:

3/2025

Belge Dili:

İngilizce

Document ID (Org No.):

2001332535

pISSN:

2548-0502