answerdotai
/

Llama-3.1-70B-Instruct-4-2-Bit-BI-20pct

Model card Files Files and versions Community

Llama-3.1-70B-Instruct-4-2-Bit-BI-20pct

1 contributor

History: 5 commits

keremturgutlu's picture

Upload folder using huggingface_hub

95e7187 verified 3 months ago

merged
Upload folder using huggingface_hub 3 months ago
vllm_bitblas
Upload folder using huggingface_hub 4 months ago
vllm_bitblas_bf16
Upload folder using huggingface_hub 3 months ago
vllm_gemlite_fp16
Upload folder using huggingface_hub 3 months ago
.gitattributes

1.52 kB

initial commit 4 months ago
config.json

2.87 kB

Upload folder using huggingface_hub 4 months ago
model_state_dict.safetensors

1.67 GB
LFS

Upload folder using huggingface_hub 4 months ago
optimizer.bin
Detected Pickle imports (4)
- "torch.BFloat16Storage",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
3.35 GB
LFS

Upload folder using huggingface_hub 4 months ago