OSMAN : a novel Arabic readability metric

El-Haj, Mahmoud and Rayson, Paul Edward (2016) OSMAN : a novel Arabic readability metric. In: Proceedings of the Language Resources and Evaluation Conference 2016 :. European Language Resources Association (ELRA), Slovenia, pp. 250-255. ISBN 9782951740891

[thumbnail of elhajlrec2016Arabic]
Preview
PDF (elhajlrec2016Arabic)
elhajlrec2016Arabic.pdf - Published Version

Download (1MB)

Abstract

We present OSMAN (Open Source Metric for Measuring Arabic Narratives) - a novel open source Arabic readability metric and tool. It allows researchers to calculate readability for Arabic text with and without diacritics. OSMAN is a modified version of the conventional readability formulas such as Flesch and Fog. In our work we introduce a novel approach towards counting short, long and stress syllables in Arabic which is essential for judging readability of Arabic narratives. We also introduce an additional factor called “Faseeh” which considers aspects of script usually dropped in informal Arabic writing. To evaluate our methods we used Spearman’s correlation metric to compare text readability for 73,000 parallel sentences from English and Arabic UN documents. The Arabic sentences were written with the absence of diacritics and in order to count the number of syllables we added the diacritics in using an open source tool called Mishkal. The results show that OSMAN readability formula correlates well with the English ones making it a useful tool for researchers and educators working with Arabic text.

Item Type:
Contribution in Book/Report/Proceedings
Subjects:
?? arabicreadabilitynlpdiacriticsosmanfleschfogparallelcorpuscorpus linguistics ??
ID Code:
78553
Deposited By:
Deposited On:
08 Mar 2016 09:12
Refereed?:
Yes
Published?:
Published
Last Modified:
12 Apr 2024 23:47