Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Float16-cloud
/
llama3.2-typhoon2-3b-instruct-gguf
like
0
Follow
Float16.cloud
2
Text Generation
GGUF
llama-cpp
gguf-my-repo
Inference Endpoints
conversational
License:
llama3.2
Model card
Files
Files and versions
Community
Deploy
Use this model
main
llama3.2-typhoon2-3b-instruct-gguf
1 contributor
History:
2 commits
matichon
Upload 10 files
67a2b03
verified
8 days ago
.gitattributes
Safe
2.24 kB
Upload 10 files
8 days ago
README.md
Safe
1.92 kB
Upload 10 files
8 days ago
llama3.2-typhoon2-3b-instruct-fp16-00001-of-00002.gguf
Safe
3.97 GB
LFS
Upload 10 files
8 days ago
llama3.2-typhoon2-3b-instruct-fp16-00002-of-00002.gguf
Safe
2.47 GB
LFS
Upload 10 files
8 days ago
llama3.2-typhoon2-3b-instruct-iq4_nl.gguf
Safe
1.93 GB
LFS
Upload 10 files
8 days ago
llama3.2-typhoon2-3b-instruct-q4_0.gguf
Safe
1.92 GB
LFS
Upload 10 files
8 days ago
llama3.2-typhoon2-3b-instruct-q4_k_m.gguf
Safe
2.02 GB
LFS
Upload 10 files
8 days ago
llama3.2-typhoon2-3b-instruct-q5_0.gguf
Safe
2.27 GB
LFS
Upload 10 files
8 days ago
llama3.2-typhoon2-3b-instruct-q5_k_m.gguf
Safe
2.32 GB
LFS
Upload 10 files
8 days ago
llama3.2-typhoon2-3b-instruct-q6_k.gguf
Safe
2.64 GB
LFS
Upload 10 files
8 days ago
llama3.2-typhoon2-3b-instruct-q8_0.gguf
Safe
3.42 GB
LFS
Upload 10 files
8 days ago
