a state-of-the-art-level open visual language model | 多模态预训练模型

CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agents. https://crab.camel-ai.org/

Commanding robots using only Language Models' prompts

https://arxiv.org/abs/2312.10807

Official repo for "AlignGPT: Multi-modal Large Language Models with Adaptive Alignment Capability"

Official Repo for the paper: VCR: Visual Caption Restoration. Check arxiv.org/pdf/2406.06462 for details.

Implementation of the "Learn No to Say Yes Better" paper.

Code implementation for paper titled "HOI-Ref: Hand-Object Interaction Referral in Egocentric Vision"

Build a simple basic multimodal large model from scratch. 从零搭建一个简单的基础多模态大模型🤖

Scene and animal attribute retrieval from camera trap data with domain-adapted vision-language models

Universal Adversarial Perturbations for Vision-Language Pre-trained Models

[NAACL 2024] Official Implementation of paper "Self-Adaptive Sampling for Efficient Video Question Answering on Image--Text Models"

This repository contains the data and code of the paper titled "IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models"

Chain of Images for Intuitively Reasoning

Code for the paper "Towards Concept-based Interpretability of Skin Lesion Diagnosis using Vision-Language Models", ISBI 2024 (Oral).

CLI for converting UForm models to CoreML.