deprem_bert_128k / README.md
Ertugrul's picture
Update README.md
08e3d8c
|
raw
history blame
2.36 kB
metadata
license: apache-2.0
language:
  - tr
metrics:
  - accuracy
  - recall
  - f1
tags:
  - deprem-clf-v1
library_name: transformers
pipeline_tag: text-classification
model-index:
  - name: deprem_v12
    results:
      - task:
          type: text-classification
        dataset:
          type: deprem_private_dataset_v1_2
          name: deprem_private_dataset_v1_2
        metrics:
          - type: recall
            value: 0.82
            verified: false
          - type: f1
            value: 0.76
            verified: false
widget:
  - text: >-
      acil acil acil antakyadan istanbula gitmek için antakya expoya ulaşmaya
      çalışan 19 kişilik bir aile için şehir içi ulaşım desteği istiyoruz.
      dışardalar üşüyorlar.iletebileceğiniz numaraları bekliyorum 
    example_title: Örnek

Eval Results

              precision    recall  f1-score   support

    Alakasiz       0.87      0.91      0.89       734
     Barinma       0.79      0.89      0.84       207
  Elektronik       0.69      0.83      0.75       130
       Giysi       0.71      0.81      0.76        94
    Kurtarma       0.82      0.85      0.83       362
    Lojistik       0.57      0.67      0.62       112
      Saglik       0.68      0.85      0.75       108
          Su       0.56      0.76      0.64        78
       Yagma       0.60      0.77      0.68        31
       Yemek       0.71      0.89      0.79       117

   micro avg       0.77      0.86      0.81      1973
   macro avg       0.70      0.82      0.76      1973
weighted avg       0.78      0.86      0.82      1973
 samples avg       0.83      0.88      0.84      1973

Training Params:

{'per_device_train_batch_size': 32,
 'per_device_eval_batch_size': 32,
 'learning_rate': 5.8679699888213376e-05,
 'weight_decay': 0.03530961718117487,
 'num_train_epochs': 4,
 'lr_scheduler_type': 'cosine',
 'warmup_steps': 40,
 'seed': 42,
 'fp16': True,
 'load_best_model_at_end': True,
 'metric_for_best_model': 'macro f1',
 'greater_is_better': True
}

Threshold:

  • Best Threshold: 0.40

Class Loss Weights

  • Same as Anıl's approach:
    [1.0,
     1.5167249178108022,
     1.7547338578655642,
     1.9610520059358458,
     1.8684086209021484,
     1.8019018017117145,
     2.110648663094536,
     3.081208739200435,
     1.7994815143101963]