ISTA-DASLab
/

Meta-Llama-3-70B-AQLM-2Bit-1x16

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Meta-Llama-3-70B-AQLM-2Bit-1x16

1 contributor

History: 9 commits

SpiridonSunRotator's picture

SpiridonSunRotator

Updated metrics

ddb56ce verified 10 months ago

.gitattributes

1.52 kB

initial commit 10 months ago
README.md

711 Bytes

Updated metrics 10 months ago
config.json

9.38 kB

Uploaded improved version of quantized model 10 months ago
generation_config.json

126 Bytes

Uploaded Meta-Llama-3-70B with AQLM 1x16 quantization 10 months ago
model-00001-of-00005.safetensors

5 GB
LFS

Uploaded improved version of quantized model 10 months ago
model-00002-of-00005.safetensors

4.96 GB
LFS

Uploaded improved version of quantized model 10 months ago
model-00003-of-00005.safetensors

4.99 GB
LFS

Uploaded improved version of quantized model 10 months ago
model-00004-of-00005.safetensors

4.87 GB
LFS

Uploaded improved version of quantized model 10 months ago
model-00005-of-00005.safetensors

2.1 GB
LFS

Uploaded improved version of quantized model 10 months ago
model.safetensors.index.json

152 kB

Uploaded Meta-Llama-3-70B with AQLM 1x16 quantization 10 months ago
special_tokens_map.json

73 Bytes

Uploaded tokenizer 10 months ago
tokenizer.json

9.08 MB

Uploaded tokenizer 10 months ago
tokenizer_config.json

50.6 kB

Uploaded tokenizer 10 months ago