Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Float16-cloud
/
llama3.1-typhoon2-8b-instruct-gguf
like
1
Follow
Float16.cloud
2
Text Generation
GGUF
llama-cpp
gguf-my-repo
ollama
Inference Endpoints
conversational
License:
llama3.1
Model card
Files
Files and versions
Community
Deploy
Use this model
main
llama3.1-typhoon2-8b-instruct-gguf
1 contributor
History:
4 commits
matichon
Update README.md
9ac33f1
verified
6 days ago
.gitattributes
Safe
2.51 kB
Upload 12 files
6 days ago
README.md
Safe
1.93 kB
Update README.md
6 days ago
llama3.1-typhoon2-8b-instruct-fp16-00001-of-00005.gguf
Safe
3.91 GB
LFS
Upload 12 files
6 days ago
llama3.1-typhoon2-8b-instruct-fp16-00002-of-00005.gguf
Safe
3.93 GB
LFS
Upload 12 files
6 days ago
llama3.1-typhoon2-8b-instruct-fp16-00003-of-00005.gguf
Safe
3.93 GB
LFS
Upload 12 files
6 days ago
llama3.1-typhoon2-8b-instruct-fp16-00004-of-00005.gguf
Safe
3.14 GB
LFS
Upload 12 files
6 days ago
llama3.1-typhoon2-8b-instruct-fp16-00005-of-00005.gguf
Safe
1.17 GB
LFS
Upload 12 files
6 days ago
llama3.1-typhoon2-8b-instruct-iq4_nl.gguf
Safe
4.71 GB
LFS
Upload 12 files
6 days ago
llama3.1-typhoon2-8b-instruct-q4_0.gguf
Safe
4.66 GB
LFS
Upload 12 files
6 days ago
llama3.1-typhoon2-8b-instruct-q4_k_m.gguf
Safe
4.92 GB
LFS
Upload 12 files
6 days ago
llama3.1-typhoon2-8b-instruct-q5_0.gguf
Safe
5.6 GB
LFS
Upload 12 files
6 days ago
llama3.1-typhoon2-8b-instruct-q5_k_m.gguf
Safe
5.73 GB
LFS
Upload 12 files
6 days ago
llama3.1-typhoon2-8b-instruct-q6_k.gguf
Safe
6.6 GB
LFS
Upload 12 files
6 days ago
llama3.1-typhoon2-8b-instruct-q8_0.gguf
Safe
8.54 GB
LFS
Upload 12 files
6 days ago
