Options
Evaluation of keyness metrics : Performance and reliability
Sönning, Lukas (2024): Evaluation of keyness metrics : Performance and reliability, in: Bamberg: Otto-Friedrich-Universität, S. 1–24.
Faculty/Chair:
Author:
Publisher Information:
Year of publication:
2024
Pages:
Source/Other editions:
Corpus Linguistics and Linguistic Theory, 20 (2023), 2, S. 263-288. - ISSN: 1613-7035, 1613-7027
Year of first publication:
2023
Language:
English
Abstract:
The methodological debates surrounding keyword analysis have given rise to a wide range of keyness metrics. The present paper delineates four dimensions of keyness, which distinguish between frequency-and dispersion-related perspectives. Existing measures are then organized according to these dimensions and evaluated with regard to their performance on a specific keyword analysis task: The identification of key verbs in academic writing. To this end, the rankings produced by 32 different metrics are evaluated against an established academic word list. Further, the reliability of measures is assessed, to determine whether they produce stable rankings across repeated studies on the same pair of text varieties. We observe notable differences among metrics with regard to these criteria. Our findings provide further support for the superiority of the Wilcoxon rank sum test and textdispersion–based measures, and allow us to identify, within each dimension of keyness, metrics that may be given preference in applied work.
GND Keywords: ;
Korpus, Linguistik
Sprachstatistik
Keywords: ; ; ; ;
keyness
keyword analysis
frequency
dispersion
methodology
DDC Classification:
Peer Reviewed:
Yes:
International Distribution:
Yes:
Type:
Article
Activation date:
July 4, 2024
Permalink
https://fis.uni-bamberg.de/handle/uniba/96272