legraphista/unsloth-Phi-3.5-mini-instruct-IMat-GGUF at 6a6a7b61ab90a77547a1ebfd46b66a83e4346c10

unsloth-Phi-3.5-mini-instruct-IMat-GGUF

1 contributor

History: 51 commits

legraphista's picture

Upload unsloth-Phi-3.5-mini-instruct.IQ1_M.gguf with huggingface_hub

6a6a7b6 verified 5 months ago

.gitattributes

3.42 kB

Upload unsloth-Phi-3.5-mini-instruct.IQ1_M.gguf with huggingface_hub 5 months ago
README.md

10.7 kB

Upload README.md with huggingface_hub 5 months ago
imatrix.dat

3.42 MB
LFS

Upload imatrix.dat with huggingface_hub 5 months ago
imatrix.dataset

280 kB

Upload imatrix.dataset with huggingface_hub 5 months ago
imatrix.log

12.4 kB

Upload imatrix.log with huggingface_hub 5 months ago
unsloth-Phi-3.5-mini-instruct.BF16.gguf

7.64 GB
LFS

Upload unsloth-Phi-3.5-mini-instruct.BF16.gguf with huggingface_hub 5 months ago
unsloth-Phi-3.5-mini-instruct.FP16.gguf

7.64 GB
LFS

Upload unsloth-Phi-3.5-mini-instruct.FP16.gguf with huggingface_hub 5 months ago
unsloth-Phi-3.5-mini-instruct.IQ1_M.gguf

950 MB
LFS

Upload unsloth-Phi-3.5-mini-instruct.IQ1_M.gguf with huggingface_hub 5 months ago
unsloth-Phi-3.5-mini-instruct.IQ2_M.gguf

1.35 GB
LFS

Upload unsloth-Phi-3.5-mini-instruct.IQ2_M.gguf with huggingface_hub 5 months ago
unsloth-Phi-3.5-mini-instruct.IQ2_S.gguf

1.26 GB
LFS

Upload unsloth-Phi-3.5-mini-instruct.IQ2_S.gguf with huggingface_hub 5 months ago
unsloth-Phi-3.5-mini-instruct.IQ2_XS.gguf

1.16 GB
LFS

Upload unsloth-Phi-3.5-mini-instruct.IQ2_XS.gguf with huggingface_hub 5 months ago
unsloth-Phi-3.5-mini-instruct.IQ2_XXS.gguf

1.06 GB
LFS

Upload unsloth-Phi-3.5-mini-instruct.IQ2_XXS.gguf with huggingface_hub 5 months ago
unsloth-Phi-3.5-mini-instruct.IQ3_M.gguf

1.78 GB
LFS

Upload unsloth-Phi-3.5-mini-instruct.IQ3_M.gguf with huggingface_hub 5 months ago
unsloth-Phi-3.5-mini-instruct.IQ3_S.gguf

1.68 GB
LFS

Upload unsloth-Phi-3.5-mini-instruct.IQ3_S.gguf with huggingface_hub 5 months ago
unsloth-Phi-3.5-mini-instruct.IQ3_XS.gguf

1.6 GB
LFS

Upload unsloth-Phi-3.5-mini-instruct.IQ3_XS.gguf with huggingface_hub 5 months ago
unsloth-Phi-3.5-mini-instruct.IQ3_XXS.gguf

1.48 GB
LFS

Upload unsloth-Phi-3.5-mini-instruct.IQ3_XXS.gguf with huggingface_hub 5 months ago
unsloth-Phi-3.5-mini-instruct.IQ4_NL.gguf

2.18 GB
LFS

Upload unsloth-Phi-3.5-mini-instruct.IQ4_NL.gguf with huggingface_hub 5 months ago
unsloth-Phi-3.5-mini-instruct.IQ4_XS.gguf

2.06 GB
LFS

Upload unsloth-Phi-3.5-mini-instruct.IQ4_XS.gguf with huggingface_hub 5 months ago
unsloth-Phi-3.5-mini-instruct.Q2_K.gguf

1.45 GB
LFS

Upload unsloth-Phi-3.5-mini-instruct.Q2_K.gguf with huggingface_hub 5 months ago
unsloth-Phi-3.5-mini-instruct.Q2_K_S.gguf

1.33 GB
LFS

Upload unsloth-Phi-3.5-mini-instruct.Q2_K_S.gguf with huggingface_hub 5 months ago
unsloth-Phi-3.5-mini-instruct.Q3_K.gguf

1.88 GB
LFS

Upload unsloth-Phi-3.5-mini-instruct.Q3_K.gguf with huggingface_hub 5 months ago
unsloth-Phi-3.5-mini-instruct.Q3_K_L.gguf

2.05 GB
LFS

Upload unsloth-Phi-3.5-mini-instruct.Q3_K_L.gguf with huggingface_hub 5 months ago
unsloth-Phi-3.5-mini-instruct.Q3_K_S.gguf

1.68 GB
LFS

Upload unsloth-Phi-3.5-mini-instruct.Q3_K_S.gguf with huggingface_hub 5 months ago
unsloth-Phi-3.5-mini-instruct.Q4_K.gguf

2.32 GB
LFS

Upload unsloth-Phi-3.5-mini-instruct.Q4_K.gguf with huggingface_hub 5 months ago
unsloth-Phi-3.5-mini-instruct.Q4_K_S.gguf

2.19 GB
LFS

Upload unsloth-Phi-3.5-mini-instruct.Q4_K_S.gguf with huggingface_hub 5 months ago
unsloth-Phi-3.5-mini-instruct.Q5_K.gguf

2.72 GB
LFS

Upload unsloth-Phi-3.5-mini-instruct.Q5_K.gguf with huggingface_hub 5 months ago
unsloth-Phi-3.5-mini-instruct.Q5_K_S.gguf

2.64 GB
LFS

Upload unsloth-Phi-3.5-mini-instruct.Q5_K_S.gguf with huggingface_hub 5 months ago
unsloth-Phi-3.5-mini-instruct.Q6_K.gguf

3.14 GB
LFS

Upload unsloth-Phi-3.5-mini-instruct.Q6_K.gguf with huggingface_hub 5 months ago
unsloth-Phi-3.5-mini-instruct.Q8_0.gguf

4.06 GB
LFS

Upload unsloth-Phi-3.5-mini-instruct.Q8_0.gguf with huggingface_hub 5 months ago