Commit
•
245b288
1
Parent(s):
eb06243
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -179,7 +179,7 @@ Link: [here](https://huggingface.co/legraphista/llm-compiler-7b-IMat-GGUF/blob/m
|
|
| 179 |
| [llm-compiler-7b.Q8_0.gguf](https://huggingface.co/legraphista/llm-compiler-7b-IMat-GGUF/blob/main/llm-compiler-7b.Q8_0.gguf) | Q8_0 | 7.16GB | ✅ Available | ⚪ Static | 📦 No
|
| 180 |
| [llm-compiler-7b.Q6_K.gguf](https://huggingface.co/legraphista/llm-compiler-7b-IMat-GGUF/blob/main/llm-compiler-7b.Q6_K.gguf) | Q6_K | 5.53GB | ✅ Available | ⚪ Static | 📦 No
|
| 181 |
| [llm-compiler-7b.Q4_K.gguf](https://huggingface.co/legraphista/llm-compiler-7b-IMat-GGUF/blob/main/llm-compiler-7b.Q4_K.gguf) | Q4_K | 4.08GB | ✅ Available | 🟢 IMatrix | 📦 No
|
| 182 |
-
| llm-compiler-7b.Q3_K | Q3_K |
|
| 183 |
| llm-compiler-7b.Q2_K | Q2_K | - | ⏳ Processing | 🟢 IMatrix | -
|
| 184 |
|
| 185 |
|
|
@@ -187,7 +187,7 @@ Link: [here](https://huggingface.co/legraphista/llm-compiler-7b-IMat-GGUF/blob/m
|
|
| 187 |
| Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
|
| 188 |
| -------- | ---------- | --------- | ------ | ------------ | -------- |
|
| 189 |
| [llm-compiler-7b.BF16.gguf](https://huggingface.co/legraphista/llm-compiler-7b-IMat-GGUF/blob/main/llm-compiler-7b.BF16.gguf) | BF16 | 13.48GB | ✅ Available | ⚪ Static | 📦 No
|
| 190 |
-
| llm-compiler-7b.FP16 | F16 |
|
| 191 |
| [llm-compiler-7b.Q8_0.gguf](https://huggingface.co/legraphista/llm-compiler-7b-IMat-GGUF/blob/main/llm-compiler-7b.Q8_0.gguf) | Q8_0 | 7.16GB | ✅ Available | ⚪ Static | 📦 No
|
| 192 |
| [llm-compiler-7b.Q6_K.gguf](https://huggingface.co/legraphista/llm-compiler-7b-IMat-GGUF/blob/main/llm-compiler-7b.Q6_K.gguf) | Q6_K | 5.53GB | ✅ Available | ⚪ Static | 📦 No
|
| 193 |
| [llm-compiler-7b.Q5_K.gguf](https://huggingface.co/legraphista/llm-compiler-7b-IMat-GGUF/blob/main/llm-compiler-7b.Q5_K.gguf) | Q5_K | 4.78GB | ✅ Available | ⚪ Static | 📦 No
|
|
@@ -196,7 +196,7 @@ Link: [here](https://huggingface.co/legraphista/llm-compiler-7b-IMat-GGUF/blob/m
|
|
| 196 |
| llm-compiler-7b.Q4_K_S | Q4_K_S | - | ⏳ Processing | 🟢 IMatrix | -
|
| 197 |
| llm-compiler-7b.IQ4_NL | IQ4_NL | - | ⏳ Processing | 🟢 IMatrix | -
|
| 198 |
| llm-compiler-7b.IQ4_XS | IQ4_XS | - | ⏳ Processing | 🟢 IMatrix | -
|
| 199 |
-
| llm-compiler-7b.Q3_K | Q3_K |
|
| 200 |
| llm-compiler-7b.Q3_K_L | Q3_K_L | - | ⏳ Processing | 🟢 IMatrix | -
|
| 201 |
| llm-compiler-7b.Q3_K_S | Q3_K_S | - | ⏳ Processing | 🟢 IMatrix | -
|
| 202 |
| llm-compiler-7b.IQ3_M | IQ3_M | - | ⏳ Processing | 🟢 IMatrix | -
|
|
|
|
| 179 |
| [llm-compiler-7b.Q8_0.gguf](https://huggingface.co/legraphista/llm-compiler-7b-IMat-GGUF/blob/main/llm-compiler-7b.Q8_0.gguf) | Q8_0 | 7.16GB | ✅ Available | ⚪ Static | 📦 No
|
| 180 |
| [llm-compiler-7b.Q6_K.gguf](https://huggingface.co/legraphista/llm-compiler-7b-IMat-GGUF/blob/main/llm-compiler-7b.Q6_K.gguf) | Q6_K | 5.53GB | ✅ Available | ⚪ Static | 📦 No
|
| 181 |
| [llm-compiler-7b.Q4_K.gguf](https://huggingface.co/legraphista/llm-compiler-7b-IMat-GGUF/blob/main/llm-compiler-7b.Q4_K.gguf) | Q4_K | 4.08GB | ✅ Available | 🟢 IMatrix | 📦 No
|
| 182 |
+
| [llm-compiler-7b.Q3_K.gguf](https://huggingface.co/legraphista/llm-compiler-7b-IMat-GGUF/blob/main/llm-compiler-7b.Q3_K.gguf) | Q3_K | 3.30GB | ✅ Available | 🟢 IMatrix | 📦 No
|
| 183 |
| llm-compiler-7b.Q2_K | Q2_K | - | ⏳ Processing | 🟢 IMatrix | -
|
| 184 |
|
| 185 |
|
|
|
|
| 187 |
| Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
|
| 188 |
| -------- | ---------- | --------- | ------ | ------------ | -------- |
|
| 189 |
| [llm-compiler-7b.BF16.gguf](https://huggingface.co/legraphista/llm-compiler-7b-IMat-GGUF/blob/main/llm-compiler-7b.BF16.gguf) | BF16 | 13.48GB | ✅ Available | ⚪ Static | 📦 No
|
| 190 |
+
| [llm-compiler-7b.FP16.gguf](https://huggingface.co/legraphista/llm-compiler-7b-IMat-GGUF/blob/main/llm-compiler-7b.FP16.gguf) | F16 | 13.48GB | ✅ Available | ⚪ Static | 📦 No
|
| 191 |
| [llm-compiler-7b.Q8_0.gguf](https://huggingface.co/legraphista/llm-compiler-7b-IMat-GGUF/blob/main/llm-compiler-7b.Q8_0.gguf) | Q8_0 | 7.16GB | ✅ Available | ⚪ Static | 📦 No
|
| 192 |
| [llm-compiler-7b.Q6_K.gguf](https://huggingface.co/legraphista/llm-compiler-7b-IMat-GGUF/blob/main/llm-compiler-7b.Q6_K.gguf) | Q6_K | 5.53GB | ✅ Available | ⚪ Static | 📦 No
|
| 193 |
| [llm-compiler-7b.Q5_K.gguf](https://huggingface.co/legraphista/llm-compiler-7b-IMat-GGUF/blob/main/llm-compiler-7b.Q5_K.gguf) | Q5_K | 4.78GB | ✅ Available | ⚪ Static | 📦 No
|
|
|
|
| 196 |
| llm-compiler-7b.Q4_K_S | Q4_K_S | - | ⏳ Processing | 🟢 IMatrix | -
|
| 197 |
| llm-compiler-7b.IQ4_NL | IQ4_NL | - | ⏳ Processing | 🟢 IMatrix | -
|
| 198 |
| llm-compiler-7b.IQ4_XS | IQ4_XS | - | ⏳ Processing | 🟢 IMatrix | -
|
| 199 |
+
| [llm-compiler-7b.Q3_K.gguf](https://huggingface.co/legraphista/llm-compiler-7b-IMat-GGUF/blob/main/llm-compiler-7b.Q3_K.gguf) | Q3_K | 3.30GB | ✅ Available | 🟢 IMatrix | 📦 No
|
| 200 |
| llm-compiler-7b.Q3_K_L | Q3_K_L | - | ⏳ Processing | 🟢 IMatrix | -
|
| 201 |
| llm-compiler-7b.Q3_K_S | Q3_K_S | - | ⏳ Processing | 🟢 IMatrix | -
|
| 202 |
| llm-compiler-7b.IQ3_M | IQ3_M | - | ⏳ Processing | 🟢 IMatrix | -
|