https://arxiv.org/abs/2502.05003
IST Austria Distributed Algorithms and Systems Lab
university
AI & ML interests
None defined yet.
Recent Activity
View all activity
Collections
4
Models prequantized with [HIGGS](https://arxiv.org/abs/2411.17525) zero-shot quantization. Requires the latest `transformers` to run.
-
ISTA-DASLab/Llama-3.3-70B-Instruct-HIGGS-GPTQ-4bit
Updated • 66 • 2 -
ISTA-DASLab/Llama-3.1-8B-Instruct-HIGGS-GPTQ-4bit
Text Generation • Updated • 92 -
ISTA-DASLab/Llama-3.1-8B-Instruct-HIGGS-GPTQ-3bit
Text Generation • Updated • 19 -
ISTA-DASLab/Llama-3.1-8B-HIGGS-GPTQ-4bit
Text Generation • Updated • 83
models
81
ISTA-DASLab/DeepSeek-R1-HIGGS-4bit
Updated
ISTA-DASLab/DeepSeek-R1-Distill-Llama-70B-HIGGS-4bit
Text Generation
•
Updated
•
10
ISTA-DASLab/QuEST-800M-sparse-INT4
Updated
ISTA-DASLab/QuEST-800M-INT4
Updated
ISTA-DASLab/QuEST-800M-BF16
Updated
ISTA-DASLab/Llama-3.3-70B-Instruct-HIGGS-GPTQ-4bit
Updated
•
66
•
2
ISTA-DASLab/Llama-3.1-8B-HIGGS-GPTQ-4bit
Text Generation
•
Updated
•
83
ISTA-DASLab/Llama-3.1-8B-HIGGS-GPTQ-3bit
Text Generation
•
Updated
•
88
ISTA-DASLab/Llama-3.1-8B-Instruct-HIGGS-GPTQ-3bit
Text Generation
•
Updated
•
19
ISTA-DASLab/Llama-3.1-8B-Instruct-HIGGS-GPTQ-4bit
Text Generation
•
Updated
•
92
datasets
None public yet