---
library_name: transformers
tags: []
---

# Kirundi-English MT5 Translator with LoRA

This is a LoRA-fine-tuned version of mT5-small for Kirundi-English translation.

## Model Details
- Base Model: google/mt5-small
- LoRA rank: 8
- LoRA alpha: 32
- Target modules: q, v
- Training Data: {len(tokenized_dataset["train"])} examples
- Validation Data: {len(tokenized_dataset["test"])} examples

## Training Parameters
- Learning Rate: 2e-5
- Batch Size: 8
- Epochs: 3
- Weight Decay: 0.01

## Current Metrics
- BLEU Score: 0.000054