Update README.md
Browse files
README.md
CHANGED
@@ -15,7 +15,7 @@ model-index:
|
|
15 |
results: []
|
16 |
---
|
17 |
|
18 |
-
# BB-L-01-7B-
|
19 |
This model was converted to MLX format from [`rohansolo/BB-L-01-7B`]().
|
20 |
Refer to the [original model card](https://huggingface.co/rohansolo/BB-L-01-7B) for more details on the model.
|
21 |
## Use with mlx
|
@@ -23,5 +23,8 @@ Refer to the [original model card](https://huggingface.co/rohansolo/BB-L-01-7B)
|
|
23 |
pip install mlx
|
24 |
git clone https://github.com/ml-explore/mlx-examples.git
|
25 |
cd mlx-examples/llms/hf_llm
|
26 |
-
python generate.py --model
|
|
|
|
|
|
|
27 |
```
|
|
|
15 |
results: []
|
16 |
---
|
17 |
|
18 |
+
# BB-L-01-7B-mlx-4bit
|
19 |
This model was converted to MLX format from [`rohansolo/BB-L-01-7B`]().
|
20 |
Refer to the [original model card](https://huggingface.co/rohansolo/BB-L-01-7B) for more details on the model.
|
21 |
## Use with mlx
|
|
|
23 |
pip install mlx
|
24 |
git clone https://github.com/ml-explore/mlx-examples.git
|
25 |
cd mlx-examples/llms/hf_llm
|
26 |
+
python generate.py --model rohansolo/BB-L-01-7B-mlx-4bit --prompt "<|system|>
|
27 |
+
You are a helpful AI assistant</s>
|
28 |
+
<|user|>
|
29 |
+
एक पाइथन स्क्रिप्ट लिखो बबल सॉर्ट के लिए</s>"
|
30 |
```
|