Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Hongrulee
/
Meta-Llama-3.1-8B-4bit-ANNIE
like
0
Transformers
GGUF
English
llama
text-generation-inference
unsloth
Inference Endpoints
License:
apache-2.0
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
Meta-Llama-3.1-8B-4bit-ANNIE
1 contributor
History:
7 commits
Hongrulee
(Trained with Unsloth)
97eaee4
verified
4 months ago
.gitattributes
1.74 kB
(Trained with Unsloth)
4 months ago
README.md
591 Bytes
Upload README.md with huggingface_hub
4 months ago
config.json
29 Bytes
(Trained with Unsloth)
4 months ago
unsloth.BF16.gguf
16.1 GB
LFS
(Trained with Unsloth)
4 months ago
unsloth.Q4_K_M.gguf
4.92 GB
LFS
(Trained with Unsloth)
4 months ago
unsloth.Q5_K_M.gguf
5.73 GB
LFS
(Trained with Unsloth)
4 months ago
unsloth.Q8_0.gguf
8.54 GB
LFS
(Trained with Unsloth)
4 months ago