metadata
license: apache-2.0
datasets:
- suayptalha/Treatment-Instructions
- suayptalha/Psychological-Support
- suayptalha/Diagnose-Instructions
language:
- en
base_model:
- answerdotai/ModernBERT-base
pipeline_tag: text-classification
library_name: transformers
tags:
- moe
MoE Router Model
Classify clinical text into:
- 0: Diagnosis
- 1: Treatment
- 2: Psychological Support
Training
- Base model: ModernBERT-base
- Epochs: 3
- Learning rate: 3e-5
- Batch size: 16