File size: 288 Bytes
2c0eb8e 9458914 2c0eb8e e7c016c 88de83b |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 |
---
tags:
- text-generation-inference
- transformers
license: apache-2.0
language:
- en
---
Fine-tuning for function calling purpose
Base model: Qwen/Qwen2.5-1.5B-Instruct
```
config = {
"rank": 16,
"alpha": 512,
"learning_rate": 2e-5,
"target_modules": ["attn", "mlps"]
}
``` |