Commit
•
baf2884
1
Parent(s):
cdcf3c0
Update README.md
Browse files
README.md
CHANGED
|
@@ -11,7 +11,6 @@ tags:
|
|
| 11 |
---
|
| 12 |
|
| 13 |
|
| 14 |
-
|
| 15 |
## Overview
|
| 16 |
|
| 17 |
In this work
|
|
@@ -22,24 +21,24 @@ In this work
|
|
| 22 |
|
| 23 |
| Checkpoints | Description | URL |
|
| 24 |
| ----------- | ----------- | ----------- |
|
| 25 |
-
| Initialization | Weights initialized from VideoLLaMA2 | [trace-init](https://huggingface.co/Yongxin-Guo/trace-init)
|
| 26 |
-
| Stage-1 | Model checkpoints trained after stage-1 | [trace-stage1](https://huggingface.co/Yongxin-Guo/trace-stage1)
|
| 27 |
-
| Stage-2 | Model checkpoints trained after stage-2 | [trace](https://huggingface.co/Yongxin-Guo/trace)
|
|
|
|
|
|
|
|
|
|
| 28 |
|
| 29 |
#### Results
|
| 30 |
|
| 31 |
| Youcook2 (Zero-Shot) | CIDER | METEOR | SODA_c | F1 |
|
| 32 |
| --- | --- | --- | --- | --- |
|
| 33 |
| TRACE | 8.1 | 2.8 | 2.2 | 22.4 |
|
| 34 |
-
|
| 35 |
| Charades-STA (Zero-Shot) | 0.3 | 0.5 | 0.7 | mIOU |
|
| 36 |
| --- | --- | --- | --- | --- |
|
| 37 |
| TRACE | 58.6 | 40.3 | 19.4 | 38.7 |
|
| 38 |
-
|
| 39 |
| QVHighlights (Zero-Shot) | mAP | Hit@1 |
|
| 40 |
| --- | --- | --- |
|
| 41 |
| TRACE | 26.8 | 42.7
|
| 42 |
-
|
| 43 |
| ActivityNet-DVC | CIDER | METEOR | SODA_c | F1 |
|
| 44 |
| --- | --- | --- | --- | --- |
|
| 45 |
| TRACE | 25.9 | 6.0 | 6.4 | 39.3 |
|
|
|
|
| 11 |
---
|
| 12 |
|
| 13 |
|
|
|
|
| 14 |
## Overview
|
| 15 |
|
| 16 |
In this work
|
|
|
|
| 21 |
|
| 22 |
| Checkpoints | Description | URL |
|
| 23 |
| ----------- | ----------- | ----------- |
|
| 24 |
+
| Initialization | Weights initialized from VideoLLaMA2 | [trace-init](https://huggingface.co/Yongxin-Guo/trace-init) |
|
| 25 |
+
| Stage-1 | Model checkpoints trained after stage-1 | [trace-stage1](https://huggingface.co/Yongxin-Guo/trace-stage1) |
|
| 26 |
+
| Stage-2 | Model checkpoints trained after stage-2 | [trace](https://huggingface.co/Yongxin-Guo/trace) |
|
| 27 |
+
| FT-Charades | Fine-tuned on Charades-STA dataset | [trace-ft-charades](https://huggingface.co/Yongxin-Guo/trace-ft-charades) |
|
| 28 |
+
| FT-Youcook2 | Fine-tuned on Youcook2 dataset | [trace-ft-youcook2](https://huggingface.co/Yongxin-Guo/trace-ft-youcook2) |
|
| 29 |
+
| FT-QVHighlights | Fine-tuned on QVHighlights dataset | [trace-ft-qvhighlights](https://huggingface.co/Yongxin-Guo/trace-ft-qvhighlights) |
|
| 30 |
|
| 31 |
#### Results
|
| 32 |
|
| 33 |
| Youcook2 (Zero-Shot) | CIDER | METEOR | SODA_c | F1 |
|
| 34 |
| --- | --- | --- | --- | --- |
|
| 35 |
| TRACE | 8.1 | 2.8 | 2.2 | 22.4 |
|
|
|
|
| 36 |
| Charades-STA (Zero-Shot) | 0.3 | 0.5 | 0.7 | mIOU |
|
| 37 |
| --- | --- | --- | --- | --- |
|
| 38 |
| TRACE | 58.6 | 40.3 | 19.4 | 38.7 |
|
|
|
|
| 39 |
| QVHighlights (Zero-Shot) | mAP | Hit@1 |
|
| 40 |
| --- | --- | --- |
|
| 41 |
| TRACE | 26.8 | 42.7
|
|
|
|
| 42 |
| ActivityNet-DVC | CIDER | METEOR | SODA_c | F1 |
|
| 43 |
| --- | --- | --- | --- | --- |
|
| 44 |
| TRACE | 25.9 | 6.0 | 6.4 | 39.3 |
|