Installation
Clone the repository and navigate to the RRPO directory:
git clone https://github.com/pritamqu/RRPO
cd RRPO
conda create -n longvu python=3.10 -y
conda activate longvu
pip install -r longvu.txt
Download weights
# base model
git clone [email protected]:Vision-CAIR/LongVU_Qwen2_7B
# RRPO weights
git clone [email protected]:pritamqu/LongVU_Qwen2_7B-RRPO-16f-LORA
Inference
conda activate longvu
BASE_WEIGHTS="./LongVU_Qwen2_7B"
WEIGHTS_ROOT="./"
## using lora weights
python inference.py \
--base_model_name "longvu_qwen_7b" \
--model-path ${BASE_WEIGHTS} \
--model-path2 ${WEIGHTS_ROOT}"/LongVU_Qwen2_7B-RRPO-16f-LORA" \
--video_path "sample_video.mp4" \
--question "Describe this video." \
--model_max_length 1024
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
HF Inference deployability: The model has no library tag.
Model tree for pritamqu/LongVU_Qwen2_7B-RRPO-16f-LORA
Base model
Qwen/Qwen2-7B
Finetuned
Qwen/Qwen2-7B-Instruct
Finetuned
Vision-CAIR/LongVU_Qwen2_7B_img
Finetuned
Vision-CAIR/LongVU_Qwen2_7B