redhat6 commited on
Commit
5ea77da
1 Parent(s): 19c44ad

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -0
README.md CHANGED
@@ -21,6 +21,14 @@ widget:
21
  This model was converted to GGUF format from [`microsoft/Phi-3.5-mini-instruct`](https://huggingface.co/microsoft/Phi-3.5-mini-instruct) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
22
  Refer to the [original model card](https://huggingface.co/microsoft/Phi-3.5-mini-instruct) for more details on the model.
23
 
 
 
 
 
 
 
 
 
24
  ## Use with llama.cpp
25
  Install llama.cpp through brew (works on Mac and Linux)
26
 
 
21
  This model was converted to GGUF format from [`microsoft/Phi-3.5-mini-instruct`](https://huggingface.co/microsoft/Phi-3.5-mini-instruct) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
22
  Refer to the [original model card](https://huggingface.co/microsoft/Phi-3.5-mini-instruct) for more details on the model.
23
 
24
+ ## Use with Ollama
25
+ Create the model in Ollama
26
+
27
+ ```bash
28
+ ollama create Phi-3.5-mini-instruct-Q4_K_M-GGUF -f Modelfile
29
+
30
+ ```
31
+
32
  ## Use with llama.cpp
33
  Install llama.cpp through brew (works on Mac and Linux)
34