Reproduced VPTQ Tech Report Baseline - a VPTQ-community Collection

VPTQ-community 's Collections

VPTQ Llama 3.3 70B Instruct without finetune

VPTQ Llama 3.1 Nemotron 70B Instruct HF without finetune

VPTQ Llama 3.1 405B Instruct without finetune

VPTQ Mistral Large Instruct 2407 without finetune

VPTQ Llama 3.1 70B Instruct without finetune

VPTQ Qwen 2.5 72B Instruct without finetune

VPTQ Qwen 2.5 32B Instruct without finetune

VPTQ Qwen 2.5 14B Instruct without finetune

VPTQ Llama 3.1 8B Instruct without finetune

VPTQ Qwen 2.5 7B Instruct without finetune

Hessian and InvHessian Checkpoints

Reproduced VPTQ Tech Report Baseline

Reproduced VPTQ Tech Report Baseline

updated Oct 18

Reproduced VPTQ Tech Report Baseline