TheBloke commited on
Commit
de95587
1 Parent(s): f7451ea

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -134,7 +134,7 @@ pip3 install hf_transfer
134
  And set environment variable `HF_HUB_ENABLE_HF_TRANSFER` to `1`:
135
 
136
  ```shell
137
- HF_HUB_ENABLE_HF_TRANSFER=1 huggingface-cli download TheBloke/Mixtral-8x7B-v0.1-GGUF mixtral-8x7b-v0.1.Q4_K_M.gguf --local-dir . --local-dir-use-symlinks False
138
  ```
139
 
140
  Windows Command Line users: You can set the environment variable by running `set HF_HUB_ENABLE_HF_TRANSFER=1` before the download command.
@@ -147,7 +147,7 @@ Windows Command Line users: You can set the environment variable by running `set
147
  Make sure you are using `llama.cpp` from [PR 4406](https://github.com/ggerganov/llama.cpp/pull/4406)
148
 
149
  ```shell
150
- ./main -ngl 35 -m mixtral-8x7b-v0.1.Q4_K_M.gguf --color -c 32768 --temp 0.7 --repeat_penalty 1.1 -n -1 -p "{prompt}"
151
  ```
152
 
153
  Change `-ngl 32` to the number of layers to offload to GPU. Remove it if you don't have GPU acceleration.
 
134
  And set environment variable `HF_HUB_ENABLE_HF_TRANSFER` to `1`:
135
 
136
  ```shell
137
+ HF_HUB_ENABLE_HF_TRANSFER=1 huggingface-cli download TheBloke/Mixtral-8x7B-Instruct-v0.1-GGUF mixtral-8x7b-instruct-v0.1.Q4_K_M.gguf --local-dir . --local-dir-use-symlinks False
138
  ```
139
 
140
  Windows Command Line users: You can set the environment variable by running `set HF_HUB_ENABLE_HF_TRANSFER=1` before the download command.
 
147
  Make sure you are using `llama.cpp` from [PR 4406](https://github.com/ggerganov/llama.cpp/pull/4406)
148
 
149
  ```shell
150
+ ./main -ngl 35 -m mixtral-8x7b-instruct-v0.1.Q4_K_M.gguf --color -c 32768 --temp 0.7 --repeat_penalty 1.1 -n -1 -p "{prompt}"
151
  ```
152
 
153
  Change `-ngl 32` to the number of layers to offload to GPU. Remove it if you don't have GPU acceleration.