Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
noxneural
/
Hermes-3-Llama-3.2-3B-awq-4-bit
like
0
Text Generation
Transformers
Safetensors
English
llama
Llama-3
instruct
finetune
chatml
gpt4
synthetic data
distillation
function calling
json mode
axolotl
roleplaying
chat
quantization
AWQ
conversational
text-generation-inference
Inference Endpoints
4-bit precision
awq
arxiv:
2408.11857
License:
llama3
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
Hermes-3-Llama-3.2-3B-awq-4-bit
1 contributor
History:
4 commits
noxneural
Update README.md
a52d994
verified
2 days ago
.gitattributes
1.57 kB
Pushing quantized 4-bit model
2 days ago
README.md
4.47 kB
Update README.md
2 days ago
config.json
1.17 kB
Pushing quantized 4-bit model
2 days ago
generation_config.json
214 Bytes
Pushing quantized 4-bit model
2 days ago
model.safetensors
2.25 GB
LFS
Pushing quantized 4-bit model
2 days ago
special_tokens_map.json
444 Bytes
Pushing quantized 4-bit model
2 days ago
tokenizer.json
17.2 MB
LFS
Pushing quantized 4-bit model
2 days ago
tokenizer_config.json
50.4 kB
Pushing quantized 4-bit model
2 days ago