wan-gguf / README.md
calcuis's picture
Update README.md
53eab2b verified
metadata
license: apache-2.0
language:
  - en
base_model:
  - Comfy-Org/Wan_2.1_ComfyUI_repackaged
pipeline_tag: text-to-video
tags:
  - gguf-node
widget:
  - text: >-
      a pig moving quickly in a beautiful winter scenery nature trees sunset
      tracking camera
    parameters:
      negative_prompt: blurry ugly bad
    output:
      url: samples\ComfyUI_00007_.webp
  - text: >-
      a pig moving quickly in a beautiful winter scenery nature trees sunset
      tracking camera
    parameters:
      negative_prompt: blurry ugly bad
    output:
      url: samples\ComfyUI_00009_.webp
  - text: >-
      a pig moving quickly in a beautiful winter scenery nature trees sunset
      tracking camera
    parameters:
      negative_prompt: blurry ugly bad
    output:
      url: samples\ComfyUI_00003_.webp
  - text: >-
      a pig moving quickly in a beautiful winter scenery nature trees sunset
      tracking camera
    parameters:
      negative_prompt: blurry ugly bad
    output:
      url: samples\ComfyUI_00004_.webp
  - text: >-
      a pig moving quickly in a beautiful winter scenery nature trees sunset
      tracking camera
    parameters:
      negative_prompt: blurry ugly bad
    output:
      url: samples\ComfyUI_00005_.webp
  - text: >-
      a pig moving quickly in a beautiful winter scenery nature trees sunset
      tracking camera
    parameters:
      negative_prompt: blurry ugly bad
    output:
      url: samples\ComfyUI_00006_.webp
  - text: >-
      a fox moving quickly in a beautiful winter scenery nature trees sunset
      tracking camera
    parameters:
      negative_prompt: blurry ugly bad
    output:
      url: samples\ComfyUI_00002_.webp
  - text: >-
      a cute anime girl with massive fennec ears and a big fluffy tail wearing a
      maid outfit turning around
    parameters:
      negative_prompt: blurry ugly bad
    output:
      url: samples\ComfyUI_00008_.webp
  - text: glass flower blossom
    output:
      url: samples\ComfyUI_00010_.webp

gguf quantized version of wan video

  • drag gguf to > ./ComfyUI/models/diffusion_models
  • drag t5xxl-um to > ./ComfyUI/models/text_encoders
  • drag vae to > ./ComfyUI/models/vae

screenshot

workflow

  • for i2v model, drag clip-vision-h to > ./ComfyUI/models/clip_vision
  • run the .bat file in the main directory (assume you are using gguf pack below)
  • if you opt to use fp8 scaled umt5xxl encoder (if applies to any fp8 scale t5 actually), please use cpu offload (switch from default to cpu under device in gguf clip loader; won't affect speed); btw, it works fine for both gguf umt5xxl and gguf vae
  • drag any demo video (below) to > your browser for workflow
Prompt
a pig moving quickly in a beautiful winter scenery nature trees sunset tracking camera
Negative Prompt
blurry ugly bad
Prompt
a pig moving quickly in a beautiful winter scenery nature trees sunset tracking camera
Negative Prompt
blurry ugly bad
Prompt
a pig moving quickly in a beautiful winter scenery nature trees sunset tracking camera
Negative Prompt
blurry ugly bad
Prompt
a pig moving quickly in a beautiful winter scenery nature trees sunset tracking camera
Negative Prompt
blurry ugly bad
Prompt
a pig moving quickly in a beautiful winter scenery nature trees sunset tracking camera
Negative Prompt
blurry ugly bad
Prompt
a pig moving quickly in a beautiful winter scenery nature trees sunset tracking camera
Negative Prompt
blurry ugly bad
Prompt
a fox moving quickly in a beautiful winter scenery nature trees sunset tracking camera
Negative Prompt
blurry ugly bad
Prompt
a cute anime girl with massive fennec ears and a big fluffy tail wearing a maid outfit turning around
Negative Prompt
blurry ugly bad
Prompt
glass flower blossom

review

  • pig is a lazy architecture for gguf node; it applies to all model, encoder and vae gguf file(s); if you try to run it in comfyui-gguf node, you might need to manually add pig in it's IMG_ARCH_LIST (under loader.py); easier than you edit the gguf file itself; btw, model architecture which compatible with comfyui-gguf, including wan, should work in gguf node
  • 1.3b t2v gguf is working fine; good for old or low end machine

reference