How could I also do these types of merge?
#1
by
YarvixPA
- opened
Hello, @Anibaaal I have been trying to merge in Forge WebUIy of Flux Q2 and Flux Q8, also in ComfyUI using Merge Simple but in both interfaces I have an error. I would like to know if it is possible for you to explain to me how to do this type of merge with the GGUF format?
I would like to experiment with these types of Flux GGUF merge
Hi! I don't think GGUF merging is supported yet but I'm not so sure about Forge.
In this case I used ComfyUI for merging in fp16 precision, then I used the merged model to create the quants with this tool:
https://github.com/city96/ComfyUI-GGUF/tree/main/tools
I hope that helps.
Could you give me your Discord username so I can ask you some questions?
YarvixPA
changed discussion status to
closed