Update README.md
Browse files
README.md
CHANGED
@@ -21,6 +21,14 @@ widget:
|
|
21 |
This model was converted to GGUF format from [`microsoft/Phi-3.5-mini-instruct`](https://huggingface.co/microsoft/Phi-3.5-mini-instruct) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
|
22 |
Refer to the [original model card](https://huggingface.co/microsoft/Phi-3.5-mini-instruct) for more details on the model.
|
23 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
24 |
## Use with llama.cpp
|
25 |
Install llama.cpp through brew (works on Mac and Linux)
|
26 |
|
|
|
21 |
This model was converted to GGUF format from [`microsoft/Phi-3.5-mini-instruct`](https://huggingface.co/microsoft/Phi-3.5-mini-instruct) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
|
22 |
Refer to the [original model card](https://huggingface.co/microsoft/Phi-3.5-mini-instruct) for more details on the model.
|
23 |
|
24 |
+
## Use with Ollama
|
25 |
+
Create the model in Ollama
|
26 |
+
|
27 |
+
```bash
|
28 |
+
ollama create Phi-3.5-mini-instruct-Q4_K_M-GGUF -f Modelfile
|
29 |
+
|
30 |
+
```
|
31 |
+
|
32 |
## Use with llama.cpp
|
33 |
Install llama.cpp through brew (works on Mac and Linux)
|
34 |
|