File size: 504 Bytes
c94cb93 bd4d5fb | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 | ---
license: apache-2.0
datasets:
- suayptalha/Treatment-Instructions
- suayptalha/Psychological-Support
- suayptalha/Diagnose-Instructions
language:
- en
base_model:
- answerdotai/ModernBERT-base
pipeline_tag: text-classification
library_name: transformers
tags:
- moe
---
# MoE Router Model
Classify clinical text into:
* **0:** Diagnosis
* **1:** Treatment
* **2:** Psychological Support
## Training
* **Base model:** ModernBERT-base
* **Epochs:** 3
* **Learning rate:** 3e-5
* **Batch size:** 16 |