YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

Fine-tuned XLM-R Model for welsh Sentiment Analysis

This is a fine-tuned XLM-R model for sentiment analysis in welsh.

Model Details

  • Model Name: XLM-R Sentiment Analysis
  • Language: welsh
  • Fine-tuning Dataset: DGurgurov/welsh_sa

Training Details

  • Epochs: 20
  • Batch Size: 32 (train), 64 (eval)
  • Optimizer: AdamW
  • Learning Rate: 5e-5

Performance Metrics

  • Accuracy: 0.86613
  • Macro F1: 0.86609
  • Micro F1: 0.86613

Usage

To use this model, you can load it with the Hugging Face Transformers library:

from transformers import AutoTokenizer, AutoModelForSequenceClassification

tokenizer = AutoTokenizer.from_pretrained("DGurgurov/xlm-r_welsh_sentiment")
model = AutoModelForSequenceClassification.from_pretrained("DGurgurov/xlm-r_welsh_sentiment")

License

[MIT]

Downloads last month
8
Safetensors
Model size
278M params
Tensor type
F32
·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Collection including DGurgurov/xlm-r_welsh_sentiment