thibaud

/

controlnet-sd21

like 393

Is there any way to run this with a fine-tuned SD-2.1 model?

I tried the following the example here (https://huggingface.co/blog/controlnet) and use this code:

        controlNet = ControlNetModel.from_pretrained(
            "thibaud/controlnet-canny-sd21", 
            torch_dtype=torch.float16
        )
        pipe = StableDiffusionControlNetPipeline.from_pretrained(
            "my-model-dir", 
            controlnet=controlNet,
            torch_dtype=torch.float16
        ).to("cuda")

but it gives me

OSError: thibaud/controlnet-canny-sd21 does not appear to have a file named diffusion_pytorch_model.bin.

What's the best way to download this? I thought from_pretrained did it automatically..?