Hugging Face's logo

legraphista
/
NuminaMath-7B-TIR-IMat-GGUF

Text Generation
GGUF
alignment-handbook
Generated from Trainer
quantized
GGUF
quantization
imat
imatrix
static
16bit
8bit
6bit
5bit
4bit
3bit
2bit
1bit
conversational
Model card Files Community
legraphista commited on
Commit
8d70d36
β€’
1 Parent(s): 9d5f578

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -75,12 +75,12 @@ Link: [here](https://huggingface.co/legraphista/NuminaMath-7B-TIR-IMat-GGUF/blob
75
  | [NuminaMath-7B-TIR.Q5_K.gguf](https://huggingface.co/legraphista/NuminaMath-7B-TIR-IMat-GGUF/blob/main/NuminaMath-7B-TIR.Q5_K.gguf) | Q5_K | 4.93GB | βœ… Available | βšͺ Static | πŸ“¦ No
76
  | [NuminaMath-7B-TIR.Q5_K_S.gguf](https://huggingface.co/legraphista/NuminaMath-7B-TIR-IMat-GGUF/blob/main/NuminaMath-7B-TIR.Q5_K_S.gguf) | Q5_K_S | 4.81GB | βœ… Available | βšͺ Static | πŸ“¦ No
77
  | [NuminaMath-7B-TIR.Q4_K.gguf](https://huggingface.co/legraphista/NuminaMath-7B-TIR-IMat-GGUF/blob/main/NuminaMath-7B-TIR.Q4_K.gguf) | Q4_K | 4.22GB | βœ… Available | 🟒 IMatrix | πŸ“¦ No
78
- | NuminaMath-7B-TIR.Q4_K_S | Q4_K_S | - | ⏳ Processing | 🟒 IMatrix | -
79
  | NuminaMath-7B-TIR.IQ4_NL | IQ4_NL | - | ⏳ Processing | 🟒 IMatrix | -
80
  | NuminaMath-7B-TIR.IQ4_XS | IQ4_XS | - | ⏳ Processing | 🟒 IMatrix | -
81
  | [NuminaMath-7B-TIR.Q3_K.gguf](https://huggingface.co/legraphista/NuminaMath-7B-TIR-IMat-GGUF/blob/main/NuminaMath-7B-TIR.Q3_K.gguf) | Q3_K | 3.46GB | βœ… Available | 🟒 IMatrix | πŸ“¦ No
82
- | NuminaMath-7B-TIR.Q3_K_L | Q3_K_L | - | ⏳ Processing | 🟒 IMatrix | -
83
- | NuminaMath-7B-TIR.Q3_K_S | Q3_K_S | - | ⏳ Processing | 🟒 IMatrix | -
84
  | NuminaMath-7B-TIR.IQ3_M | IQ3_M | - | ⏳ Processing | 🟒 IMatrix | -
85
  | NuminaMath-7B-TIR.IQ3_S | IQ3_S | - | ⏳ Processing | 🟒 IMatrix | -
86
  | NuminaMath-7B-TIR.IQ3_XS | IQ3_XS | - | ⏳ Processing | 🟒 IMatrix | -
 
75
  | [NuminaMath-7B-TIR.Q5_K.gguf](https://huggingface.co/legraphista/NuminaMath-7B-TIR-IMat-GGUF/blob/main/NuminaMath-7B-TIR.Q5_K.gguf) | Q5_K | 4.93GB | βœ… Available | βšͺ Static | πŸ“¦ No
76
  | [NuminaMath-7B-TIR.Q5_K_S.gguf](https://huggingface.co/legraphista/NuminaMath-7B-TIR-IMat-GGUF/blob/main/NuminaMath-7B-TIR.Q5_K_S.gguf) | Q5_K_S | 4.81GB | βœ… Available | βšͺ Static | πŸ“¦ No
77
  | [NuminaMath-7B-TIR.Q4_K.gguf](https://huggingface.co/legraphista/NuminaMath-7B-TIR-IMat-GGUF/blob/main/NuminaMath-7B-TIR.Q4_K.gguf) | Q4_K | 4.22GB | βœ… Available | 🟒 IMatrix | πŸ“¦ No
78
+ | [NuminaMath-7B-TIR.Q4_K_S.gguf](https://huggingface.co/legraphista/NuminaMath-7B-TIR-IMat-GGUF/blob/main/NuminaMath-7B-TIR.Q4_K_S.gguf) | Q4_K_S | 4.03GB | βœ… Available | 🟒 IMatrix | πŸ“¦ No
79
  | NuminaMath-7B-TIR.IQ4_NL | IQ4_NL | - | ⏳ Processing | 🟒 IMatrix | -
80
  | NuminaMath-7B-TIR.IQ4_XS | IQ4_XS | - | ⏳ Processing | 🟒 IMatrix | -
81
  | [NuminaMath-7B-TIR.Q3_K.gguf](https://huggingface.co/legraphista/NuminaMath-7B-TIR-IMat-GGUF/blob/main/NuminaMath-7B-TIR.Q3_K.gguf) | Q3_K | 3.46GB | βœ… Available | 🟒 IMatrix | πŸ“¦ No
82
+ | [NuminaMath-7B-TIR.Q3_K_L.gguf](https://huggingface.co/legraphista/NuminaMath-7B-TIR-IMat-GGUF/blob/main/NuminaMath-7B-TIR.Q3_K_L.gguf) | Q3_K_L | 3.75GB | βœ… Available | 🟒 IMatrix | πŸ“¦ No
83
+ | [NuminaMath-7B-TIR.Q3_K_S.gguf](https://huggingface.co/legraphista/NuminaMath-7B-TIR-IMat-GGUF/blob/main/NuminaMath-7B-TIR.Q3_K_S.gguf) | Q3_K_S | 3.14GB | βœ… Available | 🟒 IMatrix | πŸ“¦ No
84
  | NuminaMath-7B-TIR.IQ3_M | IQ3_M | - | ⏳ Processing | 🟒 IMatrix | -
85
  | NuminaMath-7B-TIR.IQ3_S | IQ3_S | - | ⏳ Processing | 🟒 IMatrix | -
86
  | NuminaMath-7B-TIR.IQ3_XS | IQ3_XS | - | ⏳ Processing | 🟒 IMatrix | -