X-modaler is a versatile and high-performance codebase for cross-modal analytics(e.g., image captioning, video captioning, vision-language pre-training, visual question answering, visual commonsense reasoning, and cross-modal retrieval).
pytorch implementation of video captioning
Video to Text: Natural language description generator for some given video. [Video Captioning]
Auto transcribe tool based on whisper
This repository contains the code for a video captioning system inspired by Sequence to Sequence -- Video to Text. This system takes as input a video and generates a caption in English describing the video.
Machine Learning and having it Deep and Structured (MLDS) in 2018 spring
[NeurIPS 2022 Spotlight] Expectation-Maximization Contrastive Learning for Compact Video-and-Language Representations
A new multi-shot video understanding benchmark Shot2Story with comprehensive video summaries and detailed shot-level captions.
[ECCV 2020] PyTorch code of MMT (a multimodal transformer captioning model) on TVCaption dataset
这是一个基于Pytorch平台、Transformer框架实现的视频描述生成 (Video Captioning) 深度学习模型。 视频描述生成任务指的是：输入一个视频，输出一句描述整个视频内容的文字（前提是视频较短且可以用一句话来描述）。本repo主要目的是帮助视力障碍者欣赏网络视频、感知周围环境，促进“无障碍视频”的发展。
A PyTorch implementation of state of the art video captioning models from 2015-2019 on MSVD and MSRVTT datasets.
What and How Well You Performed? A Multitask Learning Approach to Action Quality Assessment [CVPR 2019]
CrossCLR: Cross-modal Contrastive Learning For Multi-modal Video Representations, ICCV 2021
Video captioning baseline models on Video2Commonsense Dataset.
Attention Bidirectional Video Recurrent Net
🎬 Video Captioning: ICCV '15 paper implementation
[ICLR2024] Codes and Models for COSA: Concatenated Sample Pretrained Vision-Language Foundation Model
A PyTorch implementation of EmpiricalMVM
[ICCV 2023] Accurate and Fast Compressed Video Captioning
Add a description, image, and links to the video-captioning topic page so that developers can more easily learn about it.
To associate your repository with the video-captioning topic, visit your repo's landing page and select "manage topics."