Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
mzwing
/
Phi-3-mini-128k-instruct-GGUF
like
0
GGUF
Inference Endpoints
conversational
Model card
Files
Files and versions
Community
Deploy
Use this model
main
Phi-3-mini-128k-instruct-GGUF
1 contributor
History:
2 commits
mzwing
GGUF model commit (made with llama.cpp release b2929)
4b2fe53
verified
10 months ago
.gitattributes
Safe
2.6 kB
GGUF model commit (made with llama.cpp release b2929)
10 months ago
Phi-3-mini-128k-instruct.F16.gguf
7.64 GB
LFS
GGUF model commit (made with llama.cpp release b2929)
10 months ago
Phi-3-mini-128k-instruct.IQ2_M.gguf
737 kB
GGUF model commit (made with llama.cpp release b2929)
10 months ago
Phi-3-mini-128k-instruct.IQ3_M.gguf
737 kB
GGUF model commit (made with llama.cpp release b2929)
10 months ago
Phi-3-mini-128k-instruct.IQ3_S.gguf
737 kB
GGUF model commit (made with llama.cpp release b2929)
10 months ago
Phi-3-mini-128k-instruct.IQ3_XS.gguf
737 kB
GGUF model commit (made with llama.cpp release b2929)
10 months ago
Phi-3-mini-128k-instruct.IQ3_XXS.gguf
737 kB
GGUF model commit (made with llama.cpp release b2929)
10 months ago
Phi-3-mini-128k-instruct.IQ4_NL.gguf
2.19 GB
LFS
GGUF model commit (made with llama.cpp release b2929)
10 months ago
Phi-3-mini-128k-instruct.IQ4_XS.gguf
2.08 GB
LFS
GGUF model commit (made with llama.cpp release b2929)
10 months ago
Phi-3-mini-128k-instruct.Q2_K.gguf
1.42 GB
LFS
GGUF model commit (made with llama.cpp release b2929)
10 months ago
Phi-3-mini-128k-instruct.Q3_K_L.gguf
2.09 GB
LFS
GGUF model commit (made with llama.cpp release b2929)
10 months ago
Phi-3-mini-128k-instruct.Q3_K_M.gguf
1.96 GB
LFS
GGUF model commit (made with llama.cpp release b2929)
10 months ago
Phi-3-mini-128k-instruct.Q3_K_S.gguf
1.68 GB
LFS
GGUF model commit (made with llama.cpp release b2929)
10 months ago
Phi-3-mini-128k-instruct.Q4_0.gguf
2.18 GB
LFS
GGUF model commit (made with llama.cpp release b2929)
10 months ago
Phi-3-mini-128k-instruct.Q4_K_M.gguf
2.39 GB
LFS
GGUF model commit (made with llama.cpp release b2929)
10 months ago
Phi-3-mini-128k-instruct.Q4_K_S.gguf
2.19 GB
LFS
GGUF model commit (made with llama.cpp release b2929)
10 months ago
Phi-3-mini-128k-instruct.Q5_0.gguf
2.64 GB
LFS
GGUF model commit (made with llama.cpp release b2929)
10 months ago
Phi-3-mini-128k-instruct.Q5_K_M.gguf
2.82 GB
LFS
GGUF model commit (made with llama.cpp release b2929)
10 months ago
Phi-3-mini-128k-instruct.Q5_K_S.gguf
2.64 GB
LFS
GGUF model commit (made with llama.cpp release b2929)
10 months ago
Phi-3-mini-128k-instruct.Q6_K.gguf
3.14 GB
LFS
GGUF model commit (made with llama.cpp release b2929)
10 months ago
Phi-3-mini-128k-instruct.Q8_0.gguf
4.06 GB
LFS
GGUF model commit (made with llama.cpp release b2929)
10 months ago
