Options
Zero-Shot Cross-Lingual Transfer is a Hard Baseline to Beat in German Fine-Grained Entity Typing
Weber, Sabine; Steedman, Mark (2021): Zero-Shot Cross-Lingual Transfer is a Hard Baseline to Beat in German Fine-Grained Entity Typing, in: João Sedoc, Anna Rogers, Anna Rumshisky, u. a. (Hrsg.), Proceedings of the Second Workshop on Insights from Negative Results in NLP, Association for Computational Linguistics, S. 42–48, doi: 10.18653/v1/2021.insights-1.7.
Faculty/Chair:
Author:
Title of the compilation:
Proceedings of the Second Workshop on Insights from Negative Results in NLP
Editors:
Conference:
Second Workshop on Insights from Negative Results in NLP ; Online and Punta Cana, Dominican Republic
Publisher Information:
Year of publication:
2021
Pages:
Language:
English
Abstract:
The training of NLP models often requires large amounts of labelled training data, which makes it difficult to expand existing models to new languages. While zero-shot cross-lingual transfer relies on multilingual word embeddings to apply a model trained on one language to another, Yarowski and Ngai (2001) propose the method of annotation projection to generate training data without manual annotation. This method was successfully used for the tasks of named entity recognition and coarse-grained entity typing, but we show that it is outperformed by zero-shot cross-lingual transfer when applied to the similar task of fine-grained entity typing. In our study of fine-grained entity typing with the FIGER type ontology for German, we show that annotation projection amplifies the English model’s tendency to underpredict level 2 labels and is beaten by zero-shot cross-lingual transfer on three novel test sets.
Keywords:
Zero-Shot Cross-Lingual Transfer
Peer Reviewed:
Yes:
International Distribution:
Yes:
Open Access Journal:
Yes:
Type:
Conferenceobject
Activation date:
August 12, 2024
Versioning
Question on publication
Permalink
https://fis.uni-bamberg.de/handle/uniba/97228