Spaces:
Sleeping
Sleeping
Update README.md
Browse files
README.md
CHANGED
@@ -39,6 +39,35 @@ The model uses the QuotaClimat/frugalaichallenge-text-train dataset:
|
|
39 |
|
40 |
## Performance
|
41 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
42 |
### Metrics
|
43 |
- **Accuracy**: ~12.5% (random chance with 8 classes)
|
44 |
- **Environmental Impact**:
|
|
|
39 |
|
40 |
## Performance
|
41 |
|
42 |
+
This model is a fine-tuned version of michellejieli/emotion_text_classifier on an unknown dataset. It achieves the following results on the evaluation set:
|
43 |
+
|
44 |
+
Loss: 0.2828
|
45 |
+
F1: 0.7879
|
46 |
+
Roc Auc: nan
|
47 |
+
Hamming: 0.1039
|
48 |
+
Model description
|
49 |
+
This model uses a lightweight RoBERTa checkpoint that has been fine-tuned on evaluating emotions to further be trained on recognizing climate disinformation.
|
50 |
+
|
51 |
+
## Training procedure
|
52 |
+
Used a binarizer to tokenize the text and found a seemingly suitable model checkpoint as a good place to start!
|
53 |
+
|
54 |
+
## Training hyperparameters
|
55 |
+
The following hyperparameters were used during training:
|
56 |
+
|
57 |
+
learning_rate: 5e-05
|
58 |
+
train_batch_size: 8
|
59 |
+
eval_batch_size: 8
|
60 |
+
seed: 42
|
61 |
+
optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
|
62 |
+
lr_scheduler_type: linear
|
63 |
+
num_epochs: 4
|
64 |
+
Training results
|
65 |
+
Framework versions
|
66 |
+
Transformers 4.47.1
|
67 |
+
Pytorch 2.5.1+cu121
|
68 |
+
Datasets 3.2.0
|
69 |
+
Tokenizers 0.21.0
|
70 |
+
|
71 |
### Metrics
|
72 |
- **Accuracy**: ~12.5% (random chance with 8 classes)
|
73 |
- **Environmental Impact**:
|