No support on vllm/lmdeploy

#1
by solankibhargav - opened

I wanted to try this model on vllm and/or lmdeploy and seems like its not supported currently. I also upgraded transformers to the latest version.Are there any plans to support this model for any faster inference engine except transformers?

Sign up or log in to comment