YAML Metadata
Warning:
empty or missing yaml metadata in repo card
(https://huggingface.co/docs/hub/model-cards#model-card-metadata)
Airoboros 33b GPT4 1.2 merged with kaiokendev's 33b SuperHOT 8k LoRA, quantised using GPTQ-for-LLaMa.
To easily use this model, you can use Oobabooga's Text Generation WebUI and run it with the --monkeypatch
flag (and use the Exllama loader for best speeds. Note this must be manually installed unless you use the 1 click installer.)
- Downloads last month
- 5
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
the model is not deployed on the HF Inference API.