Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Nemotron-Mini-4B-Instruct-GGUF
like
1
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
b83df8b
Nemotron-Mini-4B-Instruct-GGUF
1 contributor
History:
16 commits
MaziyarPanahi
0095ebdd58bceb4902eff9cbcfba5084d01ae4f34dfcdd129598029612ab5bbe
b83df8b
verified
3 months ago
.gitattributes
2.7 kB
0095ebdd58bceb4902eff9cbcfba5084d01ae4f34dfcdd129598029612ab5bbe
3 months ago
Nemotron-Mini-4B-Instruct-GGUF_imatrix.dat
3.15 MB
LFS
202ac6eee0b55ddc5b3de0d6f8539ae062d302ccc0ab61ae2b983e234ffe299b
3 months ago
Nemotron-Mini-4B-Instruct.IQ1_M.gguf
1.41 GB
LFS
202ac6eee0b55ddc5b3de0d6f8539ae062d302ccc0ab61ae2b983e234ffe299b
3 months ago
Nemotron-Mini-4B-Instruct.IQ1_S.gguf
1.37 GB
LFS
37695276bc25092722d6ea2ff275059c4ffbaf3b1f788d02b89347c320fcddce
3 months ago
Nemotron-Mini-4B-Instruct.IQ2_XS.gguf
1.57 GB
LFS
6b7b4ad3f3a28b897665ec9a0c8128f29b7c35786f8b63fde98b1e19d7727d22
3 months ago
Nemotron-Mini-4B-Instruct.IQ3_XS.gguf
2.06 GB
LFS
53d7d3acbd3ba14815dceeebbfbb79ede82865d1d49173650c92dd61a0ce0a23
3 months ago
Nemotron-Mini-4B-Instruct.IQ4_XS.gguf
2.46 GB
LFS
512b53fbcc8609b5d23a423afe029c03c528c079903692110ea5cfbeca0d1135
3 months ago
Nemotron-Mini-4B-Instruct.Q2_K.gguf
1.9 GB
LFS
445ed6a7c11d55df7599c751b7c94c27f5a5a5fcdf0ce457ca844c02a41c5797
3 months ago
Nemotron-Mini-4B-Instruct.Q3_K_L.gguf
2.45 GB
LFS
64c45d290a3ace069945a486543cc7b3c5f85358eb92ffc14e53799e6ea39583
3 months ago
Nemotron-Mini-4B-Instruct.Q3_K_M.gguf
2.3 GB
LFS
64c834ec4863091aaf5139289b9d73777edca2e8376c80fa781ccb45cc04e37d
3 months ago
Nemotron-Mini-4B-Instruct.Q4_K_M.gguf
2.7 GB
LFS
4462562151b84f12f619086465961488344b8bfbf47622f2a4a80f5aae8c7399
3 months ago
Nemotron-Mini-4B-Instruct.Q4_K_S.gguf
2.58 GB
LFS
8c362133a5ba4f641ecc9f01a6e5a8e2290ead9a26c9caab6f273ea59ad1fa29
3 months ago
Nemotron-Mini-4B-Instruct.Q5_K_M.gguf
3.06 GB
LFS
8abde736bf382707a03d84e182996c12f495b39c6b3ef5011a69bd8a7e55dd20
3 months ago
Nemotron-Mini-4B-Instruct.Q5_K_S.gguf
2.99 GB
LFS
1cbb08df3b859dc79e112763e1132932acea6c621194f3061c5259581fc3ae31
3 months ago
Nemotron-Mini-4B-Instruct.Q6_K.gguf
3.45 GB
LFS
d8b1b09a22d52b8981e3fed51b29151312e879e6b42823873f53892bad2b17a2
3 months ago
Nemotron-Mini-4B-Instruct.Q8_0.gguf
4.46 GB
LFS
72ef2170c6ce71d2a705fa2c9f3cdf0b019c527e348a2e3b454bfb1cc1c73d74
3 months ago
Nemotron-Mini-4B-Instruct.fp16.gguf
8.39 GB
LFS
0095ebdd58bceb4902eff9cbcfba5084d01ae4f34dfcdd129598029612ab5bbe
3 months ago
