Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference status
Reset Inference status
Warm
Cold
Frozen
Misc
Reset Misc
Quantized
Inference Endpoints
Misc with no match
AutoTrain Compatible
text-generation-inference
Eval Results
Merge
4-bit precision
custom_code
text-embeddings-inference
8-bit precision
Carbon Emissions
Mixture of Experts
Apply filters
Models
68
Full-text search
Edit filters
Sort: Trending
Active filters:
Quantized
Clear all
erdiari/turkish-quantized
Updated
Jun 5
•
9
•
2
VPTQ-community/Llama-3.1-Nemotron-70B-Instruct-HF-v8-k65536-65536-woft
Updated
Nov 18
•
24
•
4
VPTQ-community/Meta-Llama-3.3-70B-Instruct-v8-k65536-65536-woft
Updated
10 days ago
•
8
•
1
VPTQ-community/Meta-Llama-3.3-70B-Instruct-v16-k65536-1024-woft
Updated
10 days ago
•
3
•
1
ABX-AI/WizardLM-2-7B-GGUF-IQ-Imatrix
Updated
Apr 15
•
808
•
21
VPTQ-community/Meta-Llama-3.1-70B-Instruct-v16-k65536-32768-woft
Updated
Nov 18
•
10
VPTQ-community/Meta-Llama-3.1-8B-Instruct-v8-k65536-65536-woft
Updated
Nov 18
•
200
VPTQ-community/Meta-Llama-3.1-8B-Instruct-v8-k65536-4096-woft
Updated
Nov 18
•
18
VPTQ-community/Meta-Llama-3.1-8B-Instruct-v8-k65536-256-woft
Updated
Nov 18
•
103
VPTQ-community/Qwen2.5-72B-Instruct-v16-k65536-65536-woft
Updated
Nov 18
•
14
•
4
VPTQ-community/Meta-Llama-3.1-70B-Instruct-v16-k65536-65536-woft
Updated
Nov 18
•
8
VPTQ-community/Meta-Llama-3.1-70B-Instruct-v8-k65536-256-woft
Updated
Nov 18
•
15
•
1
VPTQ-community/Qwen2.5-7B-Instruct-v8-k65536-256-woft
Updated
Nov 18
•
7
VPTQ-community/Qwen2.5-72B-Instruct-v16-k65536-32768-woft
Updated
Nov 18
•
13
•
3
VPTQ-community/Meta-Llama-3.1-70B-Instruct-v8-k32768-0-woft
Updated
Nov 18
•
32
•
1
VPTQ-community/Meta-Llama-3.1-70B-Instruct-v8-k65536-65536-woft
Updated
Nov 18
•
19
•
2
VPTQ-community/Meta-Llama-3.1-70B-Instruct-v8-k16384-0-woft
Updated
Nov 18
•
9
•
2
VPTQ-community/Meta-Llama-3.1-70B-Instruct-v8-k65536-0-woft
Updated
Nov 18
•
138
•
2
SandLogicTechnologies/Llama-3.2-3B-Instruct-GGUF
Text Generation
•
Updated
Sep 26
•
5
VPTQ-community/Qwen2.5-72B-Instruct-v8-k65536-4-woft-duplicated
Updated
Nov 18
•
12
•
1
VPTQ-community/Meta-Llama-3.1-405B-Instruct-v16-k65536-1024-woft
Updated
Nov 18
•
6
•
1
VPTQ-community/Meta-Llama-3.1-405B-Instruct-v8-k4096-0-woft
Updated
Nov 18
•
4
•
1
VPTQ-community/Meta-Llama-3.1-405B-Instruct-v16-k65536-64-woft
Updated
Nov 18
•
17
•
3
VPTQ-community/Meta-Llama-3.1-405B-Instruct-v16-k32768-32768-woft
Updated
Nov 18
•
8
•
1
VPTQ-community/Meta-Llama-3.1-405B-Instruct-v16-k65536-128-woft
Updated
Nov 18
•
6
•
1
VPTQ-community/Qwen2.5-72B-Instruct-v8-k65536-4-woft
Updated
Nov 18
•
6
•
2
VPTQ-community/Qwen2.5-72B-Instruct-v8-k65536-0-woft
Updated
Nov 18
•
46
•
2
VPTQ-community/Qwen2.5-72B-Instruct-v8-k512-512-woft
Updated
Nov 18
•
10
•
1
VPTQ-community/Qwen2.5-72B-Instruct-v8-k1024-512-woft
Updated
Nov 18
•
9
•
2
VPTQ-community/Meta-Llama-3.1-405B-Instruct-v16-k65536-256-woft
Updated
Nov 18
•
5
•
1
Previous
1
2
3
Next