README.md

---
language:
- ko
- en
license: llama3.1
tags:
- mlx
---

# sosoai/hansoldeco-llama-3.1-8b-it-FFT-v0.2-mlx

The Model [sosoai/hansoldeco-llama-3.1-8b-it-FFT-v0.2-mlx](https://huggingface.co/sosoai/hansoldeco-llama-3.1-8b-it-FFT-v0.2-mlx) was converted to MLX format from [sosoai/hansoldeco-llama-3.1-8b-it-v0.2](https://huggingface.co/sosoai/hansoldeco-llama-3.1-8b-it-v0.2) using mlx-lm version **0.16.1**.

## Use with mlx

```bash
pip install mlx-lm
```

```python
from mlx_lm import load, generate

model, tokenizer = load("sosoai/hansoldeco-llama-3.1-8b-it-FFT-v0.2-mlx")
response = generate(model, tokenizer, prompt="hello", verbose=True)
```