Sentiment Fa

README.md

@@ -1,7 +1,7 @@
 ---
 library_name: transformers
 license: apache-2.0
-base_model: HooshvareLab/bert-fa-base-uncased
+base_model: dadashzadeh/roberta-sentiment-persian
 tags:
 - generated_from_trainer
 metrics:
@@ -17,11 +17,11 @@ should probably proofread and complete it, then remove this comment. -->
 
 # Bert-Sentiment-Fa
 
-This model is a fine-tuned version of [HooshvareLab/bert-fa-base-uncased](https://huggingface.co/HooshvareLab/bert-fa-base-uncased) on the None dataset.
+This model is a fine-tuned version of [dadashzadeh/roberta-sentiment-persian](https://huggingface.co/dadashzadeh/roberta-sentiment-persian) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 1.0798
-- Accuracy: 0.5652
-- F1: 0.5901
+- Loss: 1.2509
+- Accuracy: 0.8333
+- F1: 0.8213
 
 ## Model description
 
@@ -40,23 +40,28 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 3e-05
+- learning_rate: 2e-05
 - train_batch_size: 8
 - eval_batch_size: 8
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- num_epochs: 5
+- num_epochs: 10
 
 ### Training results
 
 | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1     |
 |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|
-| No log        | 1.0   | 52   | 1.0320          | 0.4130   | 0.2269 |
-| No log        | 2.0   | 104  | 0.9651          | 0.4783   | 0.4406 |
-| No log        | 3.0   | 156  | 1.0128          | 0.5435   | 0.5541 |
-| No log        | 4.0   | 208  | 1.0869          | 0.5870   | 0.6025 |
-| No log        | 5.0   | 260  | 1.0798          | 0.5652   | 0.5901 |
+| No log        | 1.0   | 270  | 0.4689          | 0.8208   | 0.8081 |
+| 0.4419        | 2.0   | 540  | 0.7073          | 0.8042   | 0.7840 |
+| 0.4419        | 3.0   | 810  | 0.7497          | 0.8042   | 0.7820 |
+| 0.1823        | 4.0   | 1080 | 0.9258          | 0.8167   | 0.7981 |
+| 0.1823        | 5.0   | 1350 | 1.0813          | 0.8042   | 0.7897 |
+| 0.0742        | 6.0   | 1620 | 1.1488          | 0.8042   | 0.7866 |
+| 0.0742        | 7.0   | 1890 | 1.2846          | 0.8167   | 0.8023 |
+| 0.0311        | 8.0   | 2160 | 1.2308          | 0.8333   | 0.8193 |
+| 0.0311        | 9.0   | 2430 | 1.2446          | 0.8333   | 0.8193 |
+| 0.0108        | 10.0  | 2700 | 1.2509          | 0.8333   | 0.8213 |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:638c7cfb2ddb70d4ab54bc9988d0476d5f02fb8c227b62dfbb00c44ee2f6a6e1
+oid sha256:647a7e686da6a511f9969a53dd57b49bf9ec1892f1760441b76aa5b374ba8ea6
 size 473225820

runs/Oct11_06-12-39_b0be7e6222f4/events.out.tfevents.1728627173.b0be7e6222f4.1498.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:361d9d0ba341fa8f8d0e5fb54af67d49f0fe503544169a9d332f67949825d44a
-size 9960
+oid sha256:17decaffdd194a23c36093d93f9aca3a74b85070929611d5eda034909c8ed5df
+size 10314