Jeff Cook's picture

Jeff Cook

jeffcookio

·

sjuxax

AI & ML interests

None yet

Recent Activity

liked a model 4 days ago

google/gemma-3-12b-it-qat-int4-unquantized

reacted to m-ric's post with 🚀 4 days ago

New king of open VLMs: InternVL3 takes Qwen 2.5's crown! 👑 InternVL have been a wildly successful series of model : and the latest iteration has just taken back their crown thanks to their superior, natively multimodal vision training pipeline. ➡️ Most of the vision language models (VLMs) these days are built like Frankenstein : take a good text-only Large Language Model (LLM) backbone, stitch a specific vision transformer (ViT) on top of it. Then the training is sequential 🔢 : 1. Freeze the LLM weights while you train the ViT only to work with the LLM part, then 2. Unfreeze all weights to train all weights in order to work together. 💫 The Shanghai Lab decided to challenge this paradigm and chose this approach that they call "native". For each of their model sizes, they still start from a good LLM (mostly Qwen-2.5 series, did I tell you I'm a huge fan of Qwen? ❤️), and stitch the ViT, but they don't freeze anything : they train all weights together with interleaved text and image understanding data in a single pre-training phase 🎨. They claim it results in more seamless interactions between modalities. And the results prove them right: they took the crown of top VLMs, at nearly all sizes, from their Qwen-2.5 parents. 👑

updated a model 4 days ago

jeffcookio/granite-3.3-8b-instruct-gptqmodel-4b-64g

View all activity

Organizations

None yet

jeffcookio's activity

New activity in briaai/BRIA-2.3-ControlNet-Recoloring 10 months ago

Using it in comfyui, there may be a problem with the VAE

#1 opened 10 months ago by

Using it in comfyui, there may be a problem with the VAE

#1 opened 10 months ago by