Update README.md
Browse files
README.md
CHANGED
@@ -109,7 +109,7 @@ python3 convert.py ../LLaMA-2-7B-32K-Instruct
|
|
109 |
10. you are now ready to run the actual quantization, e.g., using<br>
|
110 |
```
|
111 |
./quantize ../LLaMA-2-7B-32K-Instruct/ggml-model-f16.gguf \
|
112 |
-
../LLaMA-2-7B-32K/LLaMA-2-7B-32K-Instruct-Q4_0.gguf Q4_0
|
113 |
```
|
114 |
11. run any quantizations you need and stop the container when finished (the container will automatically
|
115 |
be deleted but the generated files will remain available on your host computer)
|
|
|
109 |
10. you are now ready to run the actual quantization, e.g., using<br>
|
110 |
```
|
111 |
./quantize ../LLaMA-2-7B-32K-Instruct/ggml-model-f16.gguf \
|
112 |
+
../LLaMA-2-7B-32K-Instruct/LLaMA-2-7B-32K-Instruct-Q4_0.gguf Q4_0
|
113 |
```
|
114 |
11. run any quantizations you need and stop the container when finished (the container will automatically
|
115 |
be deleted but the generated files will remain available on your host computer)
|