Space GPU grant

#1
by merve HF staff - opened

Hello @HuanjinYao and congratulations on release!
Would you like to build a Space to the model? We can provide ZeroGPU, which is essentially free A100 for inference

Thank you! We would like to build a Space for the model.

@HuanjinYao great to hear!
I invited you to our ZeroGPU org, you need to accept the invitation to get access to ZeroGPUs. You can check out the org page for more info.

When building the Space, select the GPU type as zero and simply do:

+import spaces
your_pytorch_model.to('cuda')

[email protected]
def infer(image, prompt):
    return your_pytorch_model(**inputs)

gr.Interface(
    fn=infer,
    inputs=[gr.Image(), gr.Text()],
    outputs=gr.Textbox(),
).launch()

Thank you once again! We are honored by this opportunity. We will build the Space in the coming days.

HuanjinYao changed discussion status to closed

Sign up or log in to comment