Monsia's picture
Update README.md
1f0d729
|
raw
history blame
545 Bytes
metadata
language:
  - fr
tags:
  - classification
license: apache-2.0
metrics:
  - accuracy
  - f1-score

camembert-fr-covid-tweet-classification

This model is a fine-tune checkpoint of Yanzhu/bertweetfr-base, fine-tuned on SST-2. This model reaches an accuracy of 66.0 on the dev set (for comparison, Bert bert-base-uncased version reaches an accuracy of 92.7).

Fine-tuning hyper-parameters

  • learning_rate = 1e-5
  • batch_size = 32
  • warmup = 600
  • max_seq_length = 128
  • num_train_epochs = 3.0