ISTA-DASLab
/

Llama-2-7b-AQLM-2Bit-2x8-hf

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

Llama-2-7b-AQLM-2Bit-2x8-hf / modeling_llama_aqlm.py

Commit History

better checkpoint

f6db3f5

Andrei Panferov commited on Feb 6, 2024

try except import

400eeaa

Andrei Panferov commited on Jan 30, 2024

everythin

aebd979

Andrei Panferov commited on Jan 30, 2024