metadata

language:
  - ca
license: '???'
tags:
  - catalan
  - part of speech tagging
  - pos
  - CaText
  - Catalan Textual Corpus
datasets:
  - universal_dependencies
metrics:
  - f1
model-index:
  - name: roberta-base-ca-cased-pos
    results:
      - task:
          type: token-classification
        dataset:
          type: universal_dependencies
          name: ancora-ca-pos
        metrics:
          - type: f1
            value: 0.9893832385244624
widget:
  - text: Em dic Lluïsa i visc a Santa Maria del Camí.
  - text: L'Aina, la Berta i la Norma són molt amigues.
  - text: El Martí llegeix el Cavall Fort.

Catalan BERTa (RoBERTa-base) finetuned for Named Entity Recognition.

The roberta-base-ca-cased-pos is a Named Entity Recognition (NER) model for the Catalan language fine-tuned from the BERTa model, a RoBERTa base model pre-trained on a medium-size corpus collected from publicly available corpora and crawlers (check the BERTa model card for more details).

Datasets

We used the POS dataset in Catalan from the Universal Dependencies Treebank we refer to Ancora-ca-pos for training and evaluation.

Evaluation and results

We evaluated the roberta-base-ca-cased-tc on the Ancora-ca-ner test set against standard multilingual and monolingual baselines:

Model	Ancora-ca-pos (F1)
roberta-base-ca-cased-pos	98.93
mBERT	98.82
XLM-RoBERTa	98.89
WikiBERT-ca	97.60

For more details, check the fine-tuning and evaluation scripts in the official GitHub repository.

Citing

If you use any of these resources (datasets or models) in your work, please cite our latest paper:

@inproceedings{armengol-estape-etal-2021-multilingual,
    title = "Are Multilingual Models the Best Choice for Moderately Under-resourced Languages? {A} Comprehensive Assessment for {C}atalan",
    author = "Armengol-Estap{\'e}, Jordi  and
      Carrino, Casimiro Pio  and
      Rodriguez-Penagos, Carlos  and
      de Gibert Bonet, Ona  and
      Armentano-Oller, Carme  and
      Gonzalez-Agirre, Aitor  and
      Melero, Maite  and
      Villegas, Marta",
    booktitle = "Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021",
    month = aug,
    year = "2021",
    address = "Online",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2021.findings-acl.437",
    doi = "10.18653/v1/2021.findings-acl.437",
    pages = "4933--4946",
}

Funding

TODO

Disclaimer

TODO