nthngdy
/

Llama-3.2-3B_qfilt

model_hub_mixin

pytorch_model_hub_mixin

Model card Files Files and versions Community

This model has been pushed to the Hub using the PytorchModelHubMixin integration:

Library: [More Information Needed]
Docs: [More Information Needed]

Downloads last month: 60

Safetensors

Model size

28.7k params

Tensor type

F32

·

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including nthngdy/Llama-3.2-3B_qfilt

Q-Filters

Pre-computed Q-Filters for efficient KV cache compression. • 15 items • Updated Mar 3 • 6