hs-hf
/

madlad400-3b-mt-gguf

Inference Endpoints

Model card Files Files and versions Community

madlad400-3b-mt-gguf

1 contributor

History: 3 commits

hs-hf's picture

Create README.md

15a0654 verified about 2 months ago

.gitattributes

1.96 kB

Converted the google/madlad400-3b-mt model into quantized GGUF format about 2 months ago
README.md

90 Bytes

Create README.md about 2 months ago
madlad400-3b-mt-FP16.gguf

5.89 GB
LFS

Converted the google/madlad400-3b-mt model into quantized GGUF format about 2 months ago
madlad400-3b-mt-q4_k_m.gguf

1.86 GB
LFS

Converted the google/madlad400-3b-mt model into quantized GGUF format about 2 months ago
madlad400-3b-mt-q4_k_s.gguf

1.73 GB
LFS

Converted the google/madlad400-3b-mt model into quantized GGUF format about 2 months ago
madlad400-3b-mt-q5_k_m.gguf

2.13 GB
LFS

Converted the google/madlad400-3b-mt model into quantized GGUF format about 2 months ago
madlad400-3b-mt-q5_k_s.gguf

2.06 GB
LFS

Converted the google/madlad400-3b-mt model into quantized GGUF format about 2 months ago
madlad400-3b-mt-q6_k.gguf

2.42 GB
LFS

Converted the google/madlad400-3b-mt model into quantized GGUF format about 2 months ago
madlad400-3b-mt-q8_0.gguf

3.13 GB
LFS

Converted the google/madlad400-3b-mt model into quantized GGUF format about 2 months ago