---
tags:
- text-generation-inference
- transformers
license: apache-2.0
language:
- en
---

Fine-tuning for function calling purpose

Base model: Qwen/Qwen2.5-1.5B-Instruct

```
config = {
  "rank": 16,
  "alpha": 512,
  "learning_rate": 2e-5,
  "target_modules": ["attn", "mlps"]
}

```