An experiment in automatic indexing using the HASSET thesaurus

El-Haj, M. and Balkan, L. and Barbalet, S. and Bell, L. and Shepherdson, J. (2013) An experiment in automatic indexing using the HASSET thesaurus. In: Computer Science and Electronic Engineering Conference (CEEC), 2013 5th. IEEE, pp. 13-18.

Full text not available from this repository.

Abstract

In this paper we present the tools, techniques and evaluation results of an automatic indexing experiment we conducted on the UK Data Archive/UK Data Service data-related document collection, as part of the Jisc-funded SKOS-HASSET project. We examined the quality of an automatic indexer based on a controlled vocabulary called the Humanities and Social Science Electronic Thesaurus (HASSET). We used the Keyphrase Extraction Algorithm (KEA), a text mining and a machine learning tool. KEA builds a classifier model using training documents with known keywords which is then applied to help assign keywords to new documents. We performed extensive manual and automatic evaluation on the results using recall, precision and F1 scores. The quality of the KEA indexing was measured a) automatically by the degree of overlap between the automated indexing decisions and those originally made by the human indexer and b) manually by comparing KEA's output with the source text. This paper explains how and why we applied the chosen technical solutions, and how we intend to take forward any lessons learned from this work in the future.

Item Type:
Contribution in Book/Report/Proceedings
Subjects:
ID Code:
71285
Deposited By:
Deposited On:
16 Oct 2014 09:21
Refereed?:
Yes
Published?:
Published
Last Modified:
10 Jun 2020 22:40