README.md

---
tags:
- mlx
widget:
- example_title: Yi-34B-Chat
  text: hi
  output:
    text: ' Hello! How can I assist you today?'
- example_title: Yi-34B
  text: There's a place where time stands still. A place of breath taking wonder,
    but also
  output:
    text: " an eerie sense that something is just not right\u2026\nBetween the two\
      \ worlds lies The Forgotten Kingdom - home to creatures long since thought extinct\
      \ and ancient magic so strong it defies belief! Only here can you find what\
      \ has been lost for centuries: An Elixir Of Life which will restore youth and\
      \ vitality if only those who seek its power are brave enough to face up against\
      \ all manner of dangers lurking in this mysterious land! But beware; some say\
      \ there may even exist powerful entities beyond our comprehension whose intentions\
      \ towards humanity remain unclear at best ---- they might want nothing more\
      \ than destruction itself rather then anything else from their quest after immortality\
      \ (and maybe someone should tell them about modern medicine)? In any event though\
      \ \u2013 one thing remains true regardless : whether or not success comes easy\
      \ depends entirely upon how much effort we put into conquering whatever challenges\
      \ lie ahead along with having faith deep down inside ourselves too ;) So let\u2019\
      s get started now shall We?"
pipeline_tag: text-generation
license: apache-2.0
---

# mlx-community/Yi-9B-q
This model was converted to MLX format from [`01-ai/Yi-9B`]().
Refer to the [original model card](https://huggingface.co/01-ai/Yi-9B) for more details on the model.
## Use with mlx

```bash
pip install mlx-lm
```

```python
from mlx_lm import load, generate

model, tokenizer = load("mlx-community/Yi-9B-q")
response = generate(model, tokenizer, prompt="hello", verbose=True)
```