Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
anthracite-org
/
magnum-v3-9b-chatml-gguf
like
6
Follow
Anthracite
297
GGUF
Inference Endpoints
imatrix
License:
gemma
Model card
Files
Files and versions
Community
1
Deploy
Use this model
main
magnum-v3-9b-chatml-gguf
2 contributors
History:
5 commits
jeiku
i8mm
2c5db12
verified
4 months ago
.gitattributes
Safe
2.11 kB
i8mm
4 months ago
README.md
Safe
6.01 kB
Update README.md
4 months ago
imatrix_data.dat
Safe
6.12 MB
LFS
Upload folder using huggingface_hub
4 months ago
magnum-v3-9b-chatml-IQ3_M.gguf
Safe
4.49 GB
LFS
Upload folder using huggingface_hub
4 months ago
magnum-v3-9b-chatml-IQ3_S.gguf
Safe
4.34 GB
LFS
Upload folder using huggingface_hub
4 months ago
magnum-v3-9b-chatml-IQ4_XS.gguf
Safe
5.18 GB
LFS
Upload folder using huggingface_hub
4 months ago
magnum-v3-9b-chatml-Q4_0_4_8.gguf
Safe
5.44 GB
LFS
i8mm
4 months ago
magnum-v3-9b-chatml-Q4_K_M.gguf
Safe
5.76 GB
LFS
Upload folder using huggingface_hub
4 months ago
magnum-v3-9b-chatml-Q5_K_M.gguf
Safe
6.65 GB
LFS
Upload folder using huggingface_hub
4 months ago
magnum-v3-9b-chatml-Q6_K.gguf
Safe
7.59 GB
LFS
Upload folder using huggingface_hub
4 months ago
magnum-v3-9b-chatml-Q8_0.gguf
Safe
9.83 GB
LFS
Upload folder using huggingface_hub
4 months ago