How to run this version with vLLM

#2
by alecauduro - opened

Anybody got ir running with vLLM?

Unsloth AI org

Anybody got ir running with vLLM?

Not supported at the moment but will soon :)

Anybody got ir running with vLLM?

Not supported at the moment but will soon :)

can I convert this into gguf just like what you have done to the R1 model?

@alecauduro

Seems to be working on the latest version for me.

Sign up or log in to comment