IST Austria Distributed Algorithms and Systems Lab

ISTA-DASLab's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts

soroushtabesh 

authored a paper 14 days ago

HALO: Hadamard-Assisted Lossless Optimization for Efficient Low-Precision LLM Training and Fine-Tuning

Paper • 2501.02625 • Published 21 days ago • 1

BlackSamorez 

updated a collection about 1 month ago

HIGGS

Collection

Models prequantized with [HIGGS](https://arxiv.org/abs/2411.17525) zero-shot quantization. Requires the latest `transformers` to run. • 17 items • Updated Dec 24, 2024 • 5

BlackSamorez 

updated a model about 2 months ago

ISTA-DASLab/Llama-3.3-70B-Instruct-HIGGS-GPTQ-4bit

Updated Dec 12, 2024 • 23 • 2

BlackSamorez 

updated a collection about 2 months ago

HIGGS

Collection

Models prequantized with [HIGGS](https://arxiv.org/abs/2411.17525) zero-shot quantization. Requires the latest `transformers` to run. • 17 items • Updated Dec 24, 2024 • 5

BlackSamorez 

updated a model about 2 months ago

ISTA-DASLab/Llama-3.1-8B-HIGGS-GPTQ-4bit

Text Generation • Updated Dec 10, 2024 • 81

BlackSamorez 

updated a collection about 2 months ago

HIGGS

Collection

Models prequantized with [HIGGS](https://arxiv.org/abs/2411.17525) zero-shot quantization. Requires the latest `transformers` to run. • 17 items • Updated Dec 24, 2024 • 5

BlackSamorez 

updated 4 models about 2 months ago

ISTA-DASLab/Llama-3.1-8B-HIGGS-GPTQ-3bit

Text Generation • Updated Dec 10, 2024 • 78

ISTA-DASLab/Llama-3.1-8B-Instruct-HIGGS-GPTQ-3bit

Text Generation • Updated Dec 10, 2024 • 13

ISTA-DASLab/Llama-3.1-8B-Instruct-HIGGS-GPTQ-4bit

Text Generation • Updated Dec 10, 2024 • 80

ISTA-DASLab/Llama-3.3-70B-Instruct-HIGGS-4bit

Text Generation • Updated Dec 9, 2024 • 16 • 3

d-alistarh 

authored 8 papers about 2 months ago

Model compression via distillation and quantization

Paper • 1802.05668 • Published Feb 15, 2018 • 1

Sparse Finetuning for Inference Acceleration of Large Language Models

Paper • 2310.06927 • Published Oct 10, 2023 • 14

Towards End-to-end 4-Bit Inference on Generative Large Language Models

Paper • 2310.09259 • Published Oct 13, 2023 • 1

SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression

Paper • 2306.03078 • Published Jun 5, 2023 • 3

Error Feedback Can Accurately Compress Preconditioners

Paper • 2306.06098 • Published Jun 9, 2023

RoSA: Accurate Parameter-Efficient Fine-Tuning via Robust Adaptation

Paper • 2401.04679 • Published Jan 9, 2024 • 2

Extreme Compression of Large Language Models via Additive Quantization

Paper • 2401.06118 • Published Jan 11, 2024 • 12

Accurate Neural Network Pruning Requires Rethinking Sparse Optimization

Paper • 2308.02060 • Published Aug 3, 2023 • 1