| **Train-Test Set:** "teknofest_train_final.csv" | |
| **Model:** "dbmdz/bert-base-turkish-128k-uncased" | |
| **Önişleme** | |
| - Büyük karakterler öncesine special token (#) eklenip sonrasında karakterler küçültülmüştür | |
| - Noktalama işaretleri silinmiştir | |
| ## Tokenizer Parametreleri | |
| ``` | |
| max_length=64 | |
| padding=True | |
| truncation=True | |
| ``` | |
| ## Eğitim Parametreleri | |
| - **Epoch:** 3 | |
| - **Learning Rate:** 7e-5 | |
| - **Batch-Size:** 64 | |
| - **Tokenizer Length:** 64 | |
| - **Loss:** BCE | |
| - **Online Hard Example Mining:** Açık | |
| - **Class-Weighting:** Açık (^0.3) | |
| - **Early Stopping:** Kapalı | |
| - **Stratified Batch Sampling:** Açık | |
| - **Gradient Accumulation:** Kapalı | |
| - **LR Scheduler:** Cosine-with-Warmup | |
| - **Warmup Ratio:** 0.1 | |
| - **Weight Decay:** 0.01 | |
| - **LLRD:** 0.95 | |
| - **Label Smoothing:** 0.05 | |
| - **Gradient Clipping:** 1.0 | |
| - **MLM Pre-Training:** Kapalı | |
| ## CV10 Sonuçları | |
| ``` | |
| precision recall f1-score support | |
| INSULT 0.9172 0.9260 0.9216 2393 | |
| OTHER 0.9681 0.9646 0.9663 3528 | |
| PROFANITY 0.9627 0.9571 0.9599 2376 | |
| RACIST 0.9684 0.9651 0.9667 2033 | |
| SEXIST 0.9618 0.9668 0.9643 2081 | |
| accuracy 0.9562 12411 | |
| macro avg 0.9557 0.9559 0.9558 12411 | |
| weighted avg 0.9563 0.9562 0.9562 12411 | |
| ``` |