Hugging Face's logo

mlabonne
/
AlphaMonarch-7B

Text Generation
Transformers
Safetensors
English
mistral
Merge
lazymergekit
dpo
rlhf
conversational
Eval Results
text-generation-inference
Model card Files Community
7

AWQ version

#2
by LoneRanger44 - opened
Discussion
LoneRanger44

It would be nice if you could provide an AWQ version of this model since I want to run it with vLLM on my machine :) Thanks in advance.

dimidd

https://huggingface.co/LoneStriker/AlphaMonarch-7B-AWQ

mlabonne
 Owner

Adding it to the model card, thanks! (And thanks again @LoneStriker )

LoneRanger44 changed discussion status to closed
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment