sosoai's picture
76c75991a6667f17006953f53c136f1bc3a12703162e8edfdcb27b07a173ea11
7210eb0 verified
|
raw
history blame
596 Bytes
---
tags:
- mlx
---
# sosoai/hansoldeco-mistral-7b-v0.3-v0.1-mlx
The Model [sosoai/hansoldeco-mistral-7b-v0.3-v0.1-mlx](https://huggingface.co/sosoai/hansoldeco-mistral-7b-v0.3-v0.1-mlx) was converted to MLX format from [sosoai/hansoldeco-mistral-7b-v0.3-v0.1](https://huggingface.co/sosoai/hansoldeco-mistral-7b-v0.3-v0.1) using mlx-lm version **0.13.0**.
## Use with mlx
```bash
pip install mlx-lm
```
```python
from mlx_lm import load, generate
model, tokenizer = load("sosoai/hansoldeco-mistral-7b-v0.3-v0.1-mlx")
response = generate(model, tokenizer, prompt="hello", verbose=True)
```