Conversion from transformers format
#1
by
flowtyone
- opened
Hi, keep up the good work!
How do you suggest to convert the transformer checkpoints into a single sft? (like dev and schnell)
Thank you. I’ll start adding the single checkpoints as well as quantized versions when it gets to a more useable state. It is getting close, but not quite there yet.
Np, so you think its still not good enough to start training something? I'm not looking for inference
flowtyone
changed discussion status to
closed
Looking forward to quantized version sooon. Great work!
Almost two months later how does it go? I converted, used the conversion in ComfyUI, but in Kohya NotImplementedError: Cannot copy out of meta tensor; no data! Please use torch.nn.Module.to_empty() instead of torch.nn.Module.to() when moving module from meta to a different device.