How is the support for TGI and VLLM ?
#3
by
infinitylogesh
- opened
Great work ! Thank you for publishing the weights. Just want to understand if the model is supported by TGI or vLLM for efficient inference ?
As far as I know, the model is not supported by TGI or vLLM currently.
Thank you for the response
infinitylogesh
changed discussion status to
closed