PrunaAI
/

PowerInfer-SmallThinker-3B-Preview-HQQ-8bit-smashed

Model card Files Files and versions Community

PowerInfer-SmallThinker-3B-Preview-HQQ-8bit-smashed

1 contributor

History: 3 commits

sharpenb's picture

231be49fa22d3e9643f7e8e1301119b9629554da6748f4bc8450e74f2d0ef1dc

f19429e verified 6 days ago

.gitattributes

1.52 kB

initial commit 6 days ago
README.md

5.48 kB

Upload folder using huggingface_hub (#1) 6 days ago
config.json

781 Bytes

Upload folder using huggingface_hub (#1) 6 days ago
qmodel.pt
Detected Pickle imports (8)
- "torch._utils._rebuild_parameter",
- "collections.OrderedDict",
- "torch.uint8",
- "torch.float16",
- "torch.ByteStorage",
- "torch._utils._rebuild_tensor_v2",
- "torch.Size",
- "torch.HalfStorage"
How to fix it?
3.57 GB
LFS

Upload folder using huggingface_hub (#1) 6 days ago
smash_config.json

451 Bytes

231be49fa22d3e9643f7e8e1301119b9629554da6748f4bc8450e74f2d0ef1dc 6 days ago