nhankins commited on
Commit
d54d775
·
verified ·
1 Parent(s): 188ea19

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +29 -0
README.md CHANGED
@@ -39,6 +39,35 @@ The model uses the QuotaClimat/frugalaichallenge-text-train dataset:
39
 
40
  ## Performance
41
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
42
  ### Metrics
43
  - **Accuracy**: ~12.5% (random chance with 8 classes)
44
  - **Environmental Impact**:
 
39
 
40
  ## Performance
41
 
42
+ This model is a fine-tuned version of michellejieli/emotion_text_classifier on an unknown dataset. It achieves the following results on the evaluation set:
43
+
44
+ Loss: 0.2828
45
+ F1: 0.7879
46
+ Roc Auc: nan
47
+ Hamming: 0.1039
48
+ Model description
49
+ This model uses a lightweight RoBERTa checkpoint that has been fine-tuned on evaluating emotions to further be trained on recognizing climate disinformation.
50
+
51
+ ## Training procedure
52
+ Used a binarizer to tokenize the text and found a seemingly suitable model checkpoint as a good place to start!
53
+
54
+ ## Training hyperparameters
55
+ The following hyperparameters were used during training:
56
+
57
+ learning_rate: 5e-05
58
+ train_batch_size: 8
59
+ eval_batch_size: 8
60
+ seed: 42
61
+ optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
62
+ lr_scheduler_type: linear
63
+ num_epochs: 4
64
+ Training results
65
+ Framework versions
66
+ Transformers 4.47.1
67
+ Pytorch 2.5.1+cu121
68
+ Datasets 3.2.0
69
+ Tokenizers 0.21.0
70
+
71
  ### Metrics
72
  - **Accuracy**: ~12.5% (random chance with 8 classes)
73
  - **Environmental Impact**: