4 contributors

History: 5 commits

可亲

fix(pad zero) pad intermediate_size to 29696 to make sure quantized model can use 8 tensor-parallel in vllm

d1eab90 about 1 month ago

.gitattributes

1.52 kB

initial commit about 2 months ago
LICENSE

6.96 kB

Create LICENSE about 2 months ago
README.md

18.5 kB

Create README.md about 2 months ago
added_tokens.json

392 Bytes

Upload folder using huggingface_hub about 2 months ago
chat_template.json

1.05 kB

Upload folder using huggingface_hub about 2 months ago
config.json

1.39 kB

fix(pad zero) pad intermediate_size to 29696 to make sure quantized model can use 8 tensor-parallel in vllm about 1 month ago
generation_config.json

247 Bytes

Upload folder using huggingface_hub about 2 months ago
merges.txt

1.67 MB

Upload folder using huggingface_hub about 2 months ago
model-00001-of-00021.safetensors

3.97 GB
LFS

Upload folder using huggingface_hub about 2 months ago
model-00002-of-00021.safetensors

3.93 GB
LFS

fix(pad zero) pad intermediate_size to 29696 to make sure quantized model can use 8 tensor-parallel in vllm about 1 month ago
model-00003-of-00021.safetensors

3.86 GB
LFS

fix(pad zero) pad intermediate_size to 29696 to make sure quantized model can use 8 tensor-parallel in vllm about 1 month ago
model-00004-of-00021.safetensors

3.93 GB
LFS

fix(pad zero) pad intermediate_size to 29696 to make sure quantized model can use 8 tensor-parallel in vllm about 1 month ago
model-00005-of-00021.safetensors

3.93 GB
LFS

fix(pad zero) pad intermediate_size to 29696 to make sure quantized model can use 8 tensor-parallel in vllm about 1 month ago
model-00006-of-00021.safetensors

3.86 GB
LFS

fix(pad zero) pad intermediate_size to 29696 to make sure quantized model can use 8 tensor-parallel in vllm about 1 month ago
model-00007-of-00021.safetensors

3.93 GB
LFS

fix(pad zero) pad intermediate_size to 29696 to make sure quantized model can use 8 tensor-parallel in vllm about 1 month ago
model-00008-of-00021.safetensors

3.93 GB
LFS

fix(pad zero) pad intermediate_size to 29696 to make sure quantized model can use 8 tensor-parallel in vllm about 1 month ago
model-00009-of-00021.safetensors

3.86 GB
LFS

fix(pad zero) pad intermediate_size to 29696 to make sure quantized model can use 8 tensor-parallel in vllm about 1 month ago
model-00010-of-00021.safetensors

3.93 GB
LFS

fix(pad zero) pad intermediate_size to 29696 to make sure quantized model can use 8 tensor-parallel in vllm about 1 month ago
model-00011-of-00021.safetensors

3.93 GB
LFS

fix(pad zero) pad intermediate_size to 29696 to make sure quantized model can use 8 tensor-parallel in vllm about 1 month ago
model-00012-of-00021.safetensors

3.86 GB
LFS

fix(pad zero) pad intermediate_size to 29696 to make sure quantized model can use 8 tensor-parallel in vllm about 1 month ago
model-00013-of-00021.safetensors

3.93 GB
LFS

fix(pad zero) pad intermediate_size to 29696 to make sure quantized model can use 8 tensor-parallel in vllm about 1 month ago
model-00014-of-00021.safetensors

3.93 GB
LFS

fix(pad zero) pad intermediate_size to 29696 to make sure quantized model can use 8 tensor-parallel in vllm about 1 month ago
model-00015-of-00021.safetensors

3.86 GB
LFS

fix(pad zero) pad intermediate_size to 29696 to make sure quantized model can use 8 tensor-parallel in vllm about 1 month ago
model-00016-of-00021.safetensors

3.93 GB
LFS

fix(pad zero) pad intermediate_size to 29696 to make sure quantized model can use 8 tensor-parallel in vllm about 1 month ago
model-00017-of-00021.safetensors

3.93 GB
LFS

fix(pad zero) pad intermediate_size to 29696 to make sure quantized model can use 8 tensor-parallel in vllm about 1 month ago
model-00018-of-00021.safetensors

3.86 GB
LFS

fix(pad zero) pad intermediate_size to 29696 to make sure quantized model can use 8 tensor-parallel in vllm about 1 month ago
model-00019-of-00021.safetensors

3.93 GB
LFS

fix(pad zero) pad intermediate_size to 29696 to make sure quantized model can use 8 tensor-parallel in vllm about 1 month ago
model-00020-of-00021.safetensors

1.73 GB
LFS

fix(pad zero) pad intermediate_size to 29696 to make sure quantized model can use 8 tensor-parallel in vllm about 1 month ago
model-00021-of-00021.safetensors

2.49 GB
LFS

Upload folder using huggingface_hub about 2 months ago
model.safetensors.index.json

244 kB

fix(pad zero) pad intermediate_size to 29696 to make sure quantized model can use 8 tensor-parallel in vllm about 1 month ago
preprocessor_config.json

594 Bytes

Upload folder using huggingface_hub about 2 months ago
quantize_config.json

207 Bytes

Upload folder using huggingface_hub about 2 months ago
special_tokens_map.json

613 Bytes

Upload folder using huggingface_hub about 2 months ago
tokenizer.json

7.03 MB

Upload folder using huggingface_hub about 2 months ago
tokenizer_config.json

4.3 kB

Upload folder using huggingface_hub about 2 months ago
vocab.json

2.78 MB

Upload folder using huggingface_hub about 2 months ago