Update README.md
Browse files
README.md
CHANGED
@@ -25,6 +25,7 @@ We investigate domain adaptation of MLLMs through post-training, focusing on dat
|
|
25 |
|
26 |
|
27 |
***************** **Updates** ********************
|
|
|
28 |
- [2024/12/9] Released AdaMLLM developed from llava-next-llama3-8b: [AdaMLLM-med-8B](https://huggingface.co/AdaptLLM/medicine-LLaVA-NeXT-Llama3-8B), [AdaMLLM-food-8B](https://huggingface.co/AdaptLLM/food-LLaVA-NeXT-Llama3-8B).
|
29 |
- [2024/12/7] Released [visual-instruction-synthesizer](https://huggingface.co/AdaptLLM/visual-instruction-synthesizer) used to synthesize task triplets based on image-caption pairs.
|
30 |
- [2024/12/6] Released AdaMLLM developed from Qwen2-VL-2B and Llama-3.2-11B-Vision: [AdaMLLM-med-2B](https://huggingface.co/AdaptLLM/medicine-Qwen2-VL-2B-Instruct), [AdaMLLM-food-2B](https://huggingface.co/AdaptLLM/food-Qwen2-VL-2B-Instruct), [AdaMLLM-med-11B](https://huggingface.co/AdaptLLM/medicine-Llama-3.2-11B-Vision-Instruct), [AdaMLLM-food-11B](https://huggingface.co/AdaptLLM/food-Llama-3.2-11B-Vision-Instruct),
|
@@ -38,12 +39,13 @@ We investigate domain adaptation of MLLMs through post-training, focusing on dat
|
|
38 |
| Model | Repo ID in HF 🤗 | Domain | Base Model | Training Data | Evaluation Benchmark |
|
39 |
|:----------------------------------------------------------------------------|:--------------------------------------------|:--------------|:-------------------------|:------------------------------------------------------------------------------------------------|-----------------------|
|
40 |
| [Visual Instruction Synthesizer](https://huggingface.co/AdaptLLM/visual-instruction-synthesizer) | AdaptLLM/visual-instruction-synthesizer | - | open-llava-next-llama3-8b | TBD | - |
|
41 |
-
| [AdaMLLM-med-2B](https://huggingface.co/AdaptLLM/medicine-Qwen2-VL-2B-Instruct) | AdaptLLM/medicine-Qwen2-VL-2B-Instruct | Biomedicine | Qwen2-VL-2B-Instruct | [medicine-visual-instructions](https://huggingface.co/datasets/AdaptLLM/medicine-visual-instructions) |
|
42 |
-
| [AdaMLLM-food-2B](https://huggingface.co/AdaptLLM/food-Qwen2-VL-2B-Instruct) | AdaptLLM/food-Qwen2-VL-2B-Instruct | Food | Qwen2-VL-2B-Instruct | TBD |
|
43 |
-
| [AdaMLLM-med-8B](https://huggingface.co/AdaptLLM/medicine-LLaVA-NeXT-Llama3-8B) | AdaptLLM/medicine-LLaVA-NeXT-Llama3-8B | Biomedicine | open-llava-next-llama3-8b | [medicine-visual-instructions](https://huggingface.co/datasets/AdaptLLM/medicine-visual-instructions) |
|
44 |
-
| [AdaMLLM-food-8B](https://huggingface.co/AdaptLLM/food-LLaVA-NeXT-Llama3-8B) |AdaptLLM/food-LLaVA-NeXT-Llama3-8B | Food | open-llava-next-llama3-8b | TBD |
|
45 |
-
| [AdaMLLM-med-11B](https://huggingface.co/AdaptLLM/medicine-Llama-3.2-11B-Vision-Instruct) | AdaptLLM/medicine-Llama-3.2-11B-Vision-Instruct | Biomedicine | Llama-3.2-11B-Vision-Instruct | [medicine-visual-instructions](https://huggingface.co/datasets/AdaptLLM/medicine-visual-instructions) |
|
46 |
-
| [AdaMLLM-food-11B](https://huggingface.co/AdaptLLM/food-Llama-3.2-11B-Vision-Instruct) | AdaptLLM/food-Llama-3.2-11B-Vision-Instruct | Food | Llama-3.2-11B-Vision-Instruct | TBD |
|
|
|
47 |
|
48 |
## Contact
|
49 |
Daixuan Cheng: `[email protected]`
|
|
|
25 |
|
26 |
|
27 |
***************** **Updates** ********************
|
28 |
+
- [2024/12/10] Released evaluation benchmark datasets for biomedicine and food domains: [med-vision-language-tasks](https://huggingface.co/datasets/AdaptLLM/med-vision-language-tasks), [food-vision-language-tasks](https://huggingface.co/datasets/AdaptLLM/food-vision-language-tasks).
|
29 |
- [2024/12/9] Released AdaMLLM developed from llava-next-llama3-8b: [AdaMLLM-med-8B](https://huggingface.co/AdaptLLM/medicine-LLaVA-NeXT-Llama3-8B), [AdaMLLM-food-8B](https://huggingface.co/AdaptLLM/food-LLaVA-NeXT-Llama3-8B).
|
30 |
- [2024/12/7] Released [visual-instruction-synthesizer](https://huggingface.co/AdaptLLM/visual-instruction-synthesizer) used to synthesize task triplets based on image-caption pairs.
|
31 |
- [2024/12/6] Released AdaMLLM developed from Qwen2-VL-2B and Llama-3.2-11B-Vision: [AdaMLLM-med-2B](https://huggingface.co/AdaptLLM/medicine-Qwen2-VL-2B-Instruct), [AdaMLLM-food-2B](https://huggingface.co/AdaptLLM/food-Qwen2-VL-2B-Instruct), [AdaMLLM-med-11B](https://huggingface.co/AdaptLLM/medicine-Llama-3.2-11B-Vision-Instruct), [AdaMLLM-food-11B](https://huggingface.co/AdaptLLM/food-Llama-3.2-11B-Vision-Instruct),
|
|
|
39 |
| Model | Repo ID in HF 🤗 | Domain | Base Model | Training Data | Evaluation Benchmark |
|
40 |
|:----------------------------------------------------------------------------|:--------------------------------------------|:--------------|:-------------------------|:------------------------------------------------------------------------------------------------|-----------------------|
|
41 |
| [Visual Instruction Synthesizer](https://huggingface.co/AdaptLLM/visual-instruction-synthesizer) | AdaptLLM/visual-instruction-synthesizer | - | open-llava-next-llama3-8b | TBD | - |
|
42 |
+
| [AdaMLLM-med-2B](https://huggingface.co/AdaptLLM/medicine-Qwen2-VL-2B-Instruct) | AdaptLLM/medicine-Qwen2-VL-2B-Instruct | Biomedicine | Qwen2-VL-2B-Instruct | [medicine-visual-instructions](https://huggingface.co/datasets/AdaptLLM/medicine-visual-instructions) | [med-vision-language-tasks](https://huggingface.co/datasets/AdaptLLM/med-vision-language-tasks) |
|
43 |
+
| [AdaMLLM-food-2B](https://huggingface.co/AdaptLLM/food-Qwen2-VL-2B-Instruct) | AdaptLLM/food-Qwen2-VL-2B-Instruct | Food | Qwen2-VL-2B-Instruct | TBD | [food-vision-language-tasks](https://huggingface.co/datasets/AdaptLLM/food-vision-language-tasks) |
|
44 |
+
| [AdaMLLM-med-8B](https://huggingface.co/AdaptLLM/medicine-LLaVA-NeXT-Llama3-8B) | AdaptLLM/medicine-LLaVA-NeXT-Llama3-8B | Biomedicine | open-llava-next-llama3-8b | [medicine-visual-instructions](https://huggingface.co/datasets/AdaptLLM/medicine-visual-instructions) | [med-vision-language-tasks](https://huggingface.co/datasets/AdaptLLM/med-vision-language-tasks) |
|
45 |
+
| [AdaMLLM-food-8B](https://huggingface.co/AdaptLLM/food-LLaVA-NeXT-Llama3-8B) |AdaptLLM/food-LLaVA-NeXT-Llama3-8B | Food | open-llava-next-llama3-8b | TBD | [food-vision-language-tasks](https://huggingface.co/datasets/AdaptLLM/food-vision-language-tasks) |
|
46 |
+
| [AdaMLLM-med-11B](https://huggingface.co/AdaptLLM/medicine-Llama-3.2-11B-Vision-Instruct) | AdaptLLM/medicine-Llama-3.2-11B-Vision-Instruct | Biomedicine | Llama-3.2-11B-Vision-Instruct | [medicine-visual-instructions](https://huggingface.co/datasets/AdaptLLM/medicine-visual-instructions) | [med-vision-language-tasks](https://huggingface.co/datasets/AdaptLLM/med-vision-language-tasks) |
|
47 |
+
| [AdaMLLM-food-11B](https://huggingface.co/AdaptLLM/food-Llama-3.2-11B-Vision-Instruct) | AdaptLLM/food-Llama-3.2-11B-Vision-Instruct | Food | Llama-3.2-11B-Vision-Instruct | TBD | [food-vision-language-tasks](https://huggingface.co/datasets/AdaptLLM/food-vision-language-tasks) |
|
48 |
+
|
49 |
|
50 |
## Contact
|
51 |
Daixuan Cheng: `[email protected]`
|