Lancaster EPrints

Tagging the Bard:Evaluating the Accuracy of a Modern POS Tagger on Early Modern English Corpora

Rayson, Paul and Archer, Dawn and Baron, Alistair and Culpeper, Jonathan and Smith, Nicholas (2007) Tagging the Bard:Evaluating the Accuracy of a Modern POS Tagger on Early Modern English Corpora. In: Proceedings of the Corpus Linguistics Conference. UCREL. ISBN 1747-9398

[img]
Preview
PDF (192_Paper.pdf)
Download (157Kb) | Preview

    Abstract

    In this paper we focus on automatic part-of-speech (POS) annotation, in the context of historical English texts. Techniques that were originally developed for modern English have been applied to numerous other languages over recent years. Despite this diversification, it is still almost invariably the case that the texts being analysed are from contemporary rather than historical sources. Although there is some recognition among historical linguists of the advantages of annotation for the retrieval of lexical, grammatical and other linguistic phenomena, the implementation of such forms of annotation by automatic methods is problematic. For example, changes in grammar over time will lead to a mismatch between probabilistic language models derived from, say, Present-day English and Middle English. Similarly, variability and changes in spelling can cause problems for POS taggers with fixed lexicons and rulebases. To determine the extent of the problem, and develop possible solutions, we decided to evaluate the accuracy of existing POS taggers, trained on modern English, when they are applied to Early Modern English (EModE) datasets. We focus here on the CLAWS POS tagger, a hybrid rule-based and statistical tool for English, and use as experimental data the Shakespeare First Folio and the Lampeter Corpus. First, using a manually post-edited test set, we evaluate the accuracy of CLAWS when no modifications are made either to its grammatical model or to its lexicon. We then compare this output with CLAWS' performance when using a pre-processor that detects spelling variants and matches them to modern equivalents. This experiment highlights (i) the extent to which the handling of orthographic variants is sufficient for the tagging accuracy of EModE data to approximate to the levels attained on modernday text(s), and (ii) in turn, whether revisions to the lexical resources and language models of POS taggers need to be made.

    Item Type: Contribution in Book/Report/Proceedings
    Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
    Departments: Faculty of Science and Technology > School of Computing & Communications
    Faculty of Arts & Social Sciences > Linguistics & English Language
    ID Code: 13011
    Deposited By: ep_importer_comp
    Deposited On: 24 Jun 2008 22:58
    Refereed?: No
    Published?: Published
    Last Modified: 25 Mar 2014 23:51
    Identification Number:
    URI: http://eprints.lancs.ac.uk/id/eprint/13011

    Actions (login required)

    View Item