DevQuasar
/

ibm-granite.granite-guardian-3.0-8b-GGUF

Inference Endpoints

Model card Files Files and versions Community

ibm-granite.granite-guardian-3.0-8b-GGUF

1 contributor

History: 9 commits

csabakecskemeti's picture

csabakecskemeti

Update README.md

11a4e39 verified 23 days ago

.gitattributes

2.02 kB

Upload ibm-granite.granite-guardian-3.0-8b.Q3_K_M.gguf with huggingface_hub 2 months ago
README.md

300 Bytes

Update README.md 23 days ago
ibm-granite.granite-guardian-3.0-8b.Q2_K.gguf

3.1 GB
LFS

Upload ibm-granite.granite-guardian-3.0-8b.Q2_K.gguf with huggingface_hub 2 months ago
ibm-granite.granite-guardian-3.0-8b.Q3_K_M.gguf

4 GB
LFS

Upload ibm-granite.granite-guardian-3.0-8b.Q3_K_M.gguf with huggingface_hub 2 months ago
ibm-granite.granite-guardian-3.0-8b.Q4_K_M.gguf

4.94 GB
LFS

Upload ibm-granite.granite-guardian-3.0-8b.Q4_K_M.gguf with huggingface_hub 2 months ago
ibm-granite.granite-guardian-3.0-8b.Q5_K_M.gguf

5.8 GB
LFS

Upload ibm-granite.granite-guardian-3.0-8b.Q5_K_M.gguf with huggingface_hub 2 months ago
ibm-granite.granite-guardian-3.0-8b.Q6_K.gguf

6.71 GB
LFS

Upload ibm-granite.granite-guardian-3.0-8b.Q6_K.gguf with huggingface_hub 2 months ago
ibm-granite.granite-guardian-3.0-8b.Q8_0.gguf

8.68 GB
LFS

Upload ibm-granite.granite-guardian-3.0-8b.Q8_0.gguf with huggingface_hub 2 months ago