Create README.md

README.md

@@ -0,0 +1,42 @@
+---
+base_model: arcee-ai/Arcee-Maestro-7B-Preview
+library_name: transformers
+tags:
+- mlx
+license: apache-2.0
+---
+
+# mlx-community/Virtuoso-Medium-v2-bf16
+
+The Model [arcee-ai/Arcee-Maestro-7B-Preview-mlx](https://huggingface.co/arcee-ai/Arcee-Maestro-7B-Preview-mlx) was
+converted to MLX format from [arcee-ai/Arcee-Maestro-7B-Preview](https://huggingface.co/arcee-ai/Arcee-Maestro-7B-Preview)
+using mlx-lm version **0.21.1**.
+
+## Use with mlx
+
+```bash
+pip install mlx-lm
+```
+
+```python
+from mlx_lm import load, generate
+from huggingface_hub import snapshot_download
+
+path = snapshot_download(
+    repo_id="arcee-ai/Arcee-Maestro-7B-Preview-MLX",
+    allow_patterns="4bit/*",  # This will download everything in the 4bit folder
+    local_dir="Arcee-Maestro-7B-Preview-4bit"    # Optional: specify where to save
+)
+
+model, tokenizer = load("Arcee-Maestro-7B-Preview-4bit")
+
+prompt = "hello"
+
+if tokenizer.chat_template is not None:
+    messages = [{"role": "user", "content": prompt}]
+    prompt = tokenizer.apply_chat_template(
+        messages, add_generation_prompt=True
+    )
+
+response = generate(model, tokenizer, prompt=prompt, verbose=True)
+```