Finetuning with LoRA

#1
by YungGump - opened

Would it be possible to use this model with Huggingface PEFT to train a LoRA for this model on a personal dataset?

Sure, our code is bulit on LLaVA and their repo gives some instructions on LoRA tuning.

I'm not able to make an inference endpoint - it keeps failing for this model

@FluidInterfaces you can just duplicate the space and try to create an endpoint?
https://huggingface.co/spaces/LanguageBind/Video-LLaVA

Sign up or log in to comment