Maybe rename it 15B

#5
by CHNtentes - opened

It uses a 9B LLM as text encoder so this 6B name is actually confusing

@CHNtentes Eh, I doubt so, everyone else doesn’t really care about text encoder size. Hunyuan has an 8b text encoder and 13b dit but it’s still called hunyuan 13b.

Flux is a 12b dit with 4b t5 text encoder but still usually called 12b params, same with pretty much every other model that has big text encoders.

@CHNtentes Eh, I doubt so, everyone else doesn’t really care about text encoder size. Hunyuan has an 8b text encoder and 13b dit but it’s still called hunyuan 13b.

Flux is a 12b dit with 4b t5 text encoder but still usually called 12b params, same with pretty much every other model that has big text encoders.

I don't think they are not the same. The two models you listed, their text encoders are still smaller than dit part. For this model, its text encoder is already larger than dit.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment