ynhe commited on
Commit
60cdd03
β€’
1 Parent(s): e6d3144

Update constants.py

Browse files
Files changed (1) hide show
  1. constants.py +1 -1
constants.py CHANGED
@@ -19,7 +19,7 @@ LEADERBORAD_INTRODUCTION = """# MVBench Leaderboard
19
 
20
  Welcome to the leaderboard of the MVBench! πŸ†
21
 
22
- We introduce a comprehensive Multi-modal Video understanding Benchmark, namely MVBench, which covers 20 challenging video tasks that cannot be effectively solved with a single frame. Specifically, we first introduce a novel static-to-dynamic method to define these temporal-related tasks. By transforming various static tasks into dynamic ones, we enable the systematic generation of video tasks that require a broad spectrum of temporal skills, ranging from perception to cognition. Then, guided by the task definition, we automatically convert public video annotations into multiple-choice QA to evaluate each task. On one hand, such a distinct paradigm allows us to build MVBench efficiently, without much manual intervention. On the other hand, it guarantees evaluation fairness with ground-truth video annotations, avoiding the biased scoring of LLMs.
23
  """
24
 
25
  SUBMIT_INTRODUCTION = """# Submit on MVBench Benchmark Introduction
 
19
 
20
  Welcome to the leaderboard of the MVBench! πŸ†
21
 
22
+ Please follow the instructions in [video_chat2/mvbench.ipynb](https://github.com/OpenGVLab/Ask-Anything/blob/main/video_chat2/mvbench.ipynb) to upload the generated `upload_leaderboard.json` file here. After clicking the `Submit Eval` button, click the `Refresh` button.
23
  """
24
 
25
  SUBMIT_INTRODUCTION = """# Submit on MVBench Benchmark Introduction