Pinned Loading

1. LRV-Instruction LRV-Instruction Public

   [ICLR'24] Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning

   Python 267 13

2. VisualNews-Repository VisualNews-Repository Public

   [EMNLP'21] Visual News: Benchmark and Challenges in News Image Captioning

   Jupyter Notebook 89 9

3. MMC MMC Public

   [NAACL 2024] MMC: Advancing Multimodal Chart Understanding with LLM Instruction Tuning

   Python 89 4

4. NVlabs/EAGLE NVlabs/EAGLE Public

   Eagle Family: Exploring Model Designs, Data Recipes and Training Strategies for Frontier-Class Multimodal LLMs

   Python 539 37

5. tianyi-lab/HallusionBench tianyi-lab/HallusionBench Public

   [CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(ision), LLaVA-1.5, and Other Multi-modality Models

   Python 267 7

6. DocumentCLIP DocumentCLIP Public

   [ICPRAI 2024] DocumentCLIP: Linking Figures and Main Body Text in Reflowed Documents

   Python 16