BIP! Finder - FinEst BERT and CroSloEngual BERT

2020 • FinEst BERT and CroSloEngual BERT

Authors: Matej Ulčar; Marko Robnik-Šikonja

Venue: N/A

Type: Publication

Abstract: Large pretrained masked language models have become state-of-the-art solutions for many NLP problems. The research has been mostly focused on English language, though. While massively multilingual models exist, studies have shown that monolingual models produce much better results. We train two trilingual BERT-like models, one for Finnish, Estonian, and English, the other for Croatian, Slovenian, and English. We evaluate their performance on several downstream tasks, NER, POS-tagging, and dependency parsing, using the multilingual BERT and XLM-... (read more)

Topics: Natural language processing Artificial intelligence Linguistics

DOI: 10.1007/978-3-030-58323-1_11

BIP! social metrics: 0 25
External links: Crossref OpenAIRE

Found 2 versions BibTex PDF

Topic-specific impact indicators

Popularity:
This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
Influence:
This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
Citation Count:
This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
Impulse:
This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.