PrunaAI
/

microsoft-Phi-3-small-8k-instruct-HQQ-2bit-smashed

Inference Endpoints

Model card Files Files and versions Community

microsoft-Phi-3-small-8k-instruct-HQQ-2bit-smashed

1 contributor

History: 3 commits

sharpenb's picture

68bcf9b7662c4c13c970cc63123576165b41cc6c54ea8e500cfc3dabb2aed647

402b2f8 verified 7 months ago

.gitattributes

1.52 kB

initial commit 7 months ago
README.md

5.55 kB

68bcf9b7662c4c13c970cc63123576165b41cc6c54ea8e500cfc3dabb2aed647 7 months ago
cl100k_base.tiktoken

1.68 MB

68bcf9b7662c4c13c970cc63123576165b41cc6c54ea8e500cfc3dabb2aed647 7 months ago
config.json

2.87 kB

68bcf9b7662c4c13c970cc63123576165b41cc6c54ea8e500cfc3dabb2aed647 7 months ago
qmodel.pt
Detected Pickle imports (8)
- "torch.ByteStorage",
- "torch.float16",
- "torch.uint8",
- "torch.HalfStorage",
- "torch._utils._rebuild_parameter",
- "collections.OrderedDict",
- "torch.Size",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
2.73 GB
LFS

9b8a5a19e6fab2b30a65d4a3ec73fb88d7f5bdfd8397c2b73ef5cb6742589f10 7 months ago
smash_config.json

1.02 kB

68bcf9b7662c4c13c970cc63123576165b41cc6c54ea8e500cfc3dabb2aed647 7 months ago
special_tokens_map.json

99 Bytes

68bcf9b7662c4c13c970cc63123576165b41cc6c54ea8e500cfc3dabb2aed647 7 months ago
tokenizer_config.json

769 Bytes

68bcf9b7662c4c13c970cc63123576165b41cc6c54ea8e500cfc3dabb2aed647 7 months ago