littlebird13
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -36,7 +36,7 @@ In the following demonstration, we assume that you are running commands under th
|
|
36 |
## How to use
|
37 |
Cloning the repo may be inefficient, and thus you can manually download the GGUF file that you need or use `huggingface-cli` (`pip install huggingface_hub`) as shown below:
|
38 |
```shell
|
39 |
-
huggingface-cli download Qwen/Qwen2-0.5B-Instruct-GGUF qwen2-
|
40 |
```
|
41 |
|
42 |
To run Qwen2, you can use `llama-cli` (the previous `main`) or `llama-server` (the previous `server`).
|
|
|
36 |
## How to use
|
37 |
Cloning the repo may be inefficient, and thus you can manually download the GGUF file that you need or use `huggingface-cli` (`pip install huggingface_hub`) as shown below:
|
38 |
```shell
|
39 |
+
huggingface-cli download Qwen/Qwen2-0.5B-Instruct-GGUF qwen2-0_5b-instruct-q5_k_m.gguf --local-dir . --local-dir-use-symlinks False
|
40 |
```
|
41 |
|
42 |
To run Qwen2, you can use `llama-cli` (the previous `main`) or `llama-server` (the previous `server`).
|