DTW at Qur'an QA 2022 : Utilising Transfer Learning with Transformers for Question Answering in a Low-resource Domain

Premasiri, Damith and Ranasinghe, Tharindu and Zaghouani, Wajdi and Mitkov, Ruslan (2022) DTW at Qur'an QA 2022 : Utilising Transfer Learning with Transformers for Question Answering in a Low-resource Domain. Other. Arxiv.

[thumbnail of 2205.06025v1]
Text (2205.06025v1)
Download (0B)
[thumbnail of 2205.06025v1]
Text (2205.06025v1)
Download (0B)
[thumbnail of 2205.06025v1]
Text (2205.06025v1)
2205.06025v1.pdf - Published Version
Available under License Creative Commons Attribution.

Download (285kB)

Abstract

The task of machine reading comprehension (MRC) is a useful benchmark to evaluate the natural language understanding of machines. It has gained popularity in the natural language processing (NLP) field mainly due to the large number of datasets released for many languages. However, the research in MRC has been understudied in several domains, including religious texts. The goal of the Qur'an QA 2022 shared task is to fill this gap by producing state-of-the-art question answering and reading comprehension research on Qur'an. This paper describes the DTW entry to the Quran QA 2022 shared task. Our methodology uses transfer learning to take advantage of available Arabic MRC data. We further improve the results using various ensemble learning strategies. Our approach provided a partial Reciprocal Rank (pRR) score of 0.49 on the test set, proving its strong performance on the task.

Item Type:
Monograph (Other)
Additional Information:
Accepted to OSACT5 Co-located with LREC 2022
Uncontrolled Keywords:
Research Output Funding/no_not_funded
Subjects:
?? cs.clno - not funded ??
ID Code:
220373
Deposited By:
Deposited On:
28 May 2024 13:05
Refereed?:
No
Published?:
Published
Last Modified:
29 May 2024 06:00