mobiuslabsgmbh
/

Mixtral-8x7B-Instruct-v0.1-hf-attn-4bit-moe-3bit-metaoffload-HQQ

Text Generation

Mixture of Experts

Model card Files Files and versions Community

Mixtral-8x7B-Instruct-v0.1-hf-attn-4bit-moe-3bit-metaoffload-HQQ

1 contributor

History: 6 commits

mobicham's picture

Update README.md

8a1272d verified 10 months ago

.gitattributes

1.52 kB

upload model 10 months ago
README.md

4.83 kB

Update README.md 10 months ago
config.json

773 Bytes

upload model 10 months ago
qmodel.pt
Detected Pickle imports (8)
- "torch.ByteStorage",
- "torch.HalfStorage",
- "torch._utils._rebuild_parameter",
- "torch.float16",
- "torch._utils._rebuild_tensor_v2",
- "torch.IntStorage",
- "torch.Size",
- "collections.OrderedDict"
How to fix it?
22.4 GB
LFS

upload model 10 months ago
special_tokens_map.json

414 Bytes

upload model 10 months ago
tokenizer.json

1.8 MB

upload model 10 months ago
tokenizer.model

493 kB
LFS

upload model 10 months ago
tokenizer_config.json

1.46 kB

upload model 10 months ago