neopolita
/

trilm_2.4b_unpacked-gguf

Inference Endpoints

Model card Files Files and versions Community

trilm_2.4b_unpacked-gguf

1 contributor

History: 8 commits

neopolita's picture

Upload trilm_2.4b_unpacked_q6_k.gguf with huggingface_hub

fde5d3f verified 4 months ago

.gitattributes

1.91 kB

Upload trilm_2.4b_unpacked_q6_k.gguf with huggingface_hub 4 months ago
README.md

1.44 kB

Upload README.md with huggingface_hub 4 months ago
ggml-model-f16.gguf

4.93 GB
LFS

Upload ggml-model-f16.gguf with huggingface_hub 4 months ago
trilm_2.4b_unpacked_q2_k.gguf

953 MB
LFS

Upload trilm_2.4b_unpacked_q2_k.gguf with huggingface_hub 4 months ago
trilm_2.4b_unpacked_q3_k_m.gguf

1.22 GB
LFS

Upload trilm_2.4b_unpacked_q3_k_m.gguf with huggingface_hub 4 months ago
trilm_2.4b_unpacked_q4_k_m.gguf

1.5 GB
LFS

Upload trilm_2.4b_unpacked_q4_k_m.gguf with huggingface_hub 4 months ago
trilm_2.4b_unpacked_q5_k_m.gguf

1.75 GB
LFS

Upload trilm_2.4b_unpacked_q5_k_m.gguf with huggingface_hub 4 months ago
trilm_2.4b_unpacked_q6_k.gguf

2.02 GB
LFS

Upload trilm_2.4b_unpacked_q6_k.gguf with huggingface_hub 4 months ago