Update README.md
Browse files
README.md
CHANGED
|
@@ -3,7 +3,9 @@ license: llama3
|
|
| 3 |
base_model: meta-llama/Meta-Llama-3-8B-Instruct
|
| 4 |
---
|
| 5 |
|
| 6 |
-
# 32K GGUF config of LLAMA3 8B
|
|
|
|
|
|
|
| 7 |
|
| 8 |
> [!TIP]
|
| 9 |
> You have to set context with ***-c 32000*** in llama.cpp to take advantage of this when you run it.
|
|
|
|
| 3 |
base_model: meta-llama/Meta-Llama-3-8B-Instruct
|
| 4 |
---
|
| 5 |
|
| 6 |
+
# ///32K GGUF config of LLAMA3 8B///
|
| 7 |
+
|
| 8 |
+
## imatrix custom edge-quants included
|
| 9 |
|
| 10 |
> [!TIP]
|
| 11 |
> You have to set context with ***-c 32000*** in llama.cpp to take advantage of this when you run it.
|