YAML Metadata
Warning:
empty or missing yaml metadata in repo card
(https://huggingface.co/docs/hub/model-cards#model-card-metadata)
- from: [https://huggingface.co/miqudev/miqu-1-70b]
- to: [https://huggingface.co/152334H/miqu-1-70b-sf]
- quantized as: 4.65bpw exl2 with exllamav2 v0.0.13
- chat template with system prompt support included.
- Works with 48GB and FP8 cache @ 32k context in TabbyAPI
- Downloads last month
- 4
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.