czczup commited on
Commit
2f33adf
1 Parent(s): bb437c0

Upload folder using huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +18 -2
README.md CHANGED
@@ -55,7 +55,15 @@ InternVL 2.0 is a multimodal large language model series, featuring models of va
55
 
56
  ### Video Benchmarks
57
 
58
- TBD
 
 
 
 
 
 
 
 
59
 
60
  Limitations: Although we have made efforts to ensure the safety of the model during the training process and to encourage the model to generate text that complies with ethical and legal requirements, the model may still produce unexpected outputs due to its size and probabilistic generation paradigm. For example, the generated responses may contain biases, discrimination, or other harmful content. Please do not propagate such content. We are not responsible for any consequences resulting from the dissemination of harmful information.
61
 
@@ -460,7 +468,15 @@ InternVL 2.0 是一个多模态大语言模型系列,包含各种规模的模
460
 
461
  ### 视频相关评测
462
 
463
- TBD
 
 
 
 
 
 
 
 
464
 
465
  限制:尽管在训练过程中我们非常注重模型的安全性,尽力促使模型输出符合伦理和法律要求的文本,但受限于模型大小以及概率生成范式,模型可能会产生各种不符合预期的输出,例如回复内容包含偏见、歧视等有害内容,请勿传播这些内容。由于传播不良信息导致的任何后果,本项目不承担责任。
466
 
 
55
 
56
  ### Video Benchmarks
57
 
58
+ | Benchmark | VideoChat2-HD-Mistral | Video-CCAM-9B | InternVL2-4B | InternVL2-8B |
59
+ | :-------------------------: | :-------------------: | :-----------: | :----------: | :----------: |
60
+ | Model Size | 7B | 9B | 4.2B | 8.1B |
61
+ | | | | | |
62
+ | MVBench | 60.4 | 60.7 | 63.7 | 66.4 |
63
+ | Video-MME<sub>wo subs</sub> | 42.3 | 50.6 | TBD | TBD |
64
+ | Video-MME<sub>w/ subs</sub> | 54.6 | 54.9 | TBD | TBD |
65
+
66
+ - We evaluate our models on MVBench by extracting 16 frames from each video, and each frame was resized to a 448x448 image.
67
 
68
  Limitations: Although we have made efforts to ensure the safety of the model during the training process and to encourage the model to generate text that complies with ethical and legal requirements, the model may still produce unexpected outputs due to its size and probabilistic generation paradigm. For example, the generated responses may contain biases, discrimination, or other harmful content. Please do not propagate such content. We are not responsible for any consequences resulting from the dissemination of harmful information.
69
 
 
468
 
469
  ### 视频相关评测
470
 
471
+ | 评测数据集 | VideoChat2-HD-Mistral | Video-CCAM-9B | InternVL2-4B | InternVL2-8B |
472
+ | :-------------------------: | :-------------------: | :-----------: | :----------: | :----------: |
473
+ | 模型大小 | 7B | 9B | 4.2B | 8.1B |
474
+ | | | | | |
475
+ | MVBench | 60.4 | 60.7 | 63.7 | 66.4 |
476
+ | Video-MME<sub>wo subs</sub> | 42.3 | 50.6 | TBD | TBD |
477
+ | Video-MME<sub>w/ subs</sub> | 54.6 | 54.9 | TBD | TBD |
478
+
479
+ - 我们通过从每个视频中提取16帧来评估我们的模型在MVBench上的性能,每个视频帧被调整为448x448的图像。
480
 
481
  限制:尽管在训练过程中我们非常注重模型的安全性,尽力促使模型输出符合伦理和法律要求的文本,但受限于模型大小以及概率生成范式,模型可能会产生各种不符合预期的输出,例如回复内容包含偏见、歧视等有害内容,请勿传播这些内容。由于传播不良信息导致的任何后果,本项目不承担责任。
482