Kirundi-English MT5 Translator with LoRA
This is a LoRA-fine-tuned version of mT5-small for Kirundi-English translation.
Model Details
- Base Model: google/mt5-small
- LoRA rank: 8
- LoRA alpha: 32
- Target modules: q, v
- Training Data: {len(tokenized_dataset["train"])} examples
- Validation Data: {len(tokenized_dataset["test"])} examples
Training Parameters
- Learning Rate: 2e-5
- Batch Size: 8
- Epochs: 3
- Weight Decay: 0.01
Current Metrics
- BLEU Score: 0.000054