El-Haj, Mahmoud and Rayson, Paul and Hall, David (2014) Language independent evaluation of translation style and consistency : comparing human and machine translations of Camus’ novel “The Stranger”. In: Text, speech and dialogue : 17th International Conference, TSD 2014, Brno, Czech Republic, September 8-12, 2014. Proceedings. Lecture Notes in Computer Science . Springer International Publishing, pp. 116-124. ISBN 9783319108155
Abstract
We present quantitative and qualitative results of automatic and manual comparisons of translations of the originally French novel “The Stranger” (French: L’Étranger). We provide a novel approach to evaluating translation performance across languages without the need for reference translations or comparable corpora. Our approach examines the consistency of the translation of various document levels including chapters, parts and sentences. In our experiments we analyse four expert translations of the French novel. We also used Google’s machine translation output as baselines. We analyse the translations by using readability metrics, rank correlation comparisons and Word Error Rate (WER).