Skip to content

Commit

Permalink
Merge pull request #11 from Jazzcharles/newpr
Browse files Browse the repository at this point in the history
update video retrieval R@5, R@10 results
  • Loading branch information
shepnerd authored Feb 4, 2023
2 parents 528b41f + 422680c commit e6f146a
Showing 1 changed file with 59 additions and 1 deletion.
60 changes: 59 additions & 1 deletion Downstream/Video-Text-Retrieval/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -318,6 +318,65 @@ All the test scripts for evaluating the finetuned checkpoints are provided in th
./eval_finetuned_scripts/eval_finetuned_msrvtt.sh
```

### Performance
#### MSRVTT Finetune
|R@1(t2v)|R@5(t2v)|R@10(t2v)|R@1(v2t)|R@5(v2t)|R@10(v2t)|
|----|----|----|----|----|----|
|55.2|79.6|87.5|57.9|79.2|86.4|
#### MSRVTT ZeroShot
|R@1(t2v)|R@5(t2v)|R@10(t2v)|R@1(v2t)|R@5(v2t)|R@10(v2t)|
|----|----|----|----|----|----|
|40.7|67.3|76.0|39.6|63.7|73.1|

#### MSVD Finetune
|R@1(t2v)|R@5(t2v)|R@10(t2v)|R@1(v2t)|R@5(v2t)|R@10(v2t)|
|----|----|----|----|----|----|
|58.4|84.5|90.4|76.3|96.8|98.7|
#### MSVD ZeroShot
|R@1(t2v)|R@5(t2v)|R@10(t2v)|R@1(v2t)|R@5(v2t)|R@10(v2t)|
|----|----|----|----|----|----|
|43.4|69.9|79.1|67.6|90.6|94.6|

#### LSMDC Finetune
|R@1(t2v)|R@5(t2v)|R@10(t2v)|R@1(v2t)|R@5(v2t)|R@10(v2t)|
|----|----|----|----|----|----|
|34.0|53.7|62.9|34.9|54.6|63.1|
#### LSMDC ZeroShot
|R@1(t2v)|R@5(t2v)|R@10(t2v)|R@1(v2t)|R@5(v2t)|R@10(v2t)|
|----|----|----|----|----|----|
|17.6|32.4|40.2|13.2|27.8|34.9|

#### ActivityNet Finetune
|R@1(t2v)|R@5(t2v)|R@10(t2v)|R@1(v2t)|R@5(v2t)|R@10(v2t)|
|----|----|----|----|----|----|
|62.2|85.9|93.2|62.8|86.2|93.3|
#### ActivityNet ZeroShot
|R@1(t2v)|R@5(t2v)|R@10(t2v)|R@1(v2t)|R@5(v2t)|R@10(v2t)|
|----|----|----|----|----|----|
|30.7|57.4|70.2|31.4|59.4|73.1|


#### DiDeMO Finetune
|R@1(t2v)|R@5(t2v)|R@10(t2v)|R@1(v2t)|R@5(v2t)|R@10(v2t)|
|----|----|----|----|----|----|
|57.9|82.4|88.9|59.1|81.8|89.0|
#### DiDeMo ZeroShot
|R@1(t2v)|R@5(t2v)|R@10(t2v)|R@1(v2t)|R@5(v2t)|R@10(v2t)|
|----|----|----|----|----|----|
|31.5|57.6|68.2|33.5|60.3|71.1|

#### VATEX Finetune
|R@1(t2v)|R@5(t2v)|R@10(t2v)|R@1(v2t)|R@5(v2t)|R@10(v2t)|
|----|----|----|----|----|----|
|71.1|94.7|97.6|87.2|99.2|100.0|
#### VATEX ZeroShot
|R@1(t2v)|R@5(t2v)|R@10(t2v)|R@1(v2t)|R@5(v2t)|R@10(v2t)|
|----|----|----|----|----|----|
|49.5|79.7|87.0|69.5|95.0|98.1|





## License

Expand All @@ -326,4 +385,3 @@ This project is released under the MIT license.
## Acknowledgments

Our codebase is based on [CLIP4clip](https://github.com/ArrowLuo/CLIP4Clip).

0 comments on commit e6f146a

Please sign in to comment.