weizhiwang
commited on
Commit
•
402e4eb
1
Parent(s):
7545779
Update README.md
Browse files
README.md
CHANGED
@@ -15,7 +15,7 @@ A reproduced LLaVA LVLM based on Llama-3-8B LLM backbone. Not an official implem
|
|
15 |
Please follow my reproduced implementation [LLaVA-Llama-3](https://github.com/Victorwz/LLaVA-Llama-3/) for more details on fine-tuning LLaVA model with Llama-3 as the foundatiaon LLM.
|
16 |
|
17 |
## Model Details
|
18 |
-
Follows LLavA-1.5 pre-train and supervised fine-tuning pipeline. You do not need to change the LLaVA codebase to
|
19 |
|
20 |
## How to Use
|
21 |
|
@@ -72,10 +72,10 @@ The image features a blue and orange double-decker bus parked on a street. The b
|
|
72 |
In the background, there are two cars parked on the street, one on the left side and the other on the right side. Additionally, there is a traffic light visible in the scene, indicating that the bus is stopped at an intersection.
|
73 |
```
|
74 |
|
|
|
|
|
75 |
|
76 |
-
|
77 |
-
|
78 |
-
## Results
|
79 |
|
80 |
|
81 |
| Model | MMMU Val |
|
|
|
15 |
Please follow my reproduced implementation [LLaVA-Llama-3](https://github.com/Victorwz/LLaVA-Llama-3/) for more details on fine-tuning LLaVA model with Llama-3 as the foundatiaon LLM.
|
16 |
|
17 |
## Model Details
|
18 |
+
Follows LLavA-1.5 pre-train and supervised fine-tuning pipeline. You do not need to change the LLaVA codebase to accommodate Llama-3.
|
19 |
|
20 |
## How to Use
|
21 |
|
|
|
72 |
In the background, there are two cars parked on the street, one on the left side and the other on the right side. Additionally, there is a traffic light visible in the scene, indicating that the bus is stopped at an intersection.
|
73 |
```
|
74 |
|
75 |
+
# Fine-Tune LLaVA-Llama-3 on Your Visual Instruction Data
|
76 |
+
Please refer to a forked [LLaVA-Llama-3](https://github.com/Victorwz/LLaVA-Llama-3) git repo for fine-tuning data preparation and scripts. The data loading function and fastchat conversation template are changed due to a different tokenizer.
|
77 |
|
78 |
+
## Benchmark Results
|
|
|
|
|
79 |
|
80 |
|
81 |
| Model | MMMU Val |
|