Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
noxneural
/
Hermes-3-Llama-3.2-3B-awq-4-bit
like
0
Text Generation
Transformers
Safetensors
English
llama
Llama-3
instruct
finetune
chatml
gpt4
synthetic data
distillation
function calling
json mode
axolotl
roleplaying
chat
quantization
AWQ
conversational
text-generation-inference
Inference Endpoints
4-bit precision
awq
arxiv:
2408.11857
License:
llama3
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
Hermes-3-Llama-3.2-3B-awq-4-bit
/
model.safetensors
Commit History
Pushing quantized 4-bit model
6582644
verified
noxneural
commited on
3 days ago