X-PLUG

All

12 repositories

mPLUG-DocOwl
Public
mPLUG-DocOwl: Modularized Multimodal Large Language Model for Document Understanding
multimodal table-understanding document-understanding mllm multimodal-large-language-models chart-understanding
Python
•
Apache License 2.0
•116•2k•64•1•Updated Dec 24, 2024Dec 24, 2024
mPLUG-Owl
Public
mPLUG-Owl: The Powerful Multi-modal Large Language Model Family
video chatbot dialogue pytorch transformer llama gpt alpaca visual-recognition multimodal
Python
•
MIT License
•177•2.4k•96•1•Updated Nov 27, 2024Nov 27, 2024
SocialBench
Public
RoleInteract: Evaluating the Social Interaction of Role-Playing Agents
Python
•4•51•2•0•Updated Oct 12, 2024Oct 12, 2024
MobileAgent
Public
Mobile-Agent: The Powerful Mobile Device Operation Assistant Family
android agent harmony ios app gui automation mobile copilot multimodal
Python
•
MIT License
•306•3.2k•48•0•Updated Sep 26, 2024Sep 26, 2024
MM_StoryAgent
Public
Python
•
Apache License 2.0
•0•7•0•0•Updated Aug 23, 2024Aug 23, 2024
Multi-LLM-Agent
Public
Python
•24•205•5•0•Updated Apr 23, 2024Apr 23, 2024
mPLUG-HalOwl
Public
mPLUG-HalOwl: Multimodal Hallucination Evaluation and Mitigating
benchmark contrastive-learning hallucinations mllm multimodal-large-language-models multimodal-hallucination
Python
•
MIT License
•2•87•6•0•Updated Jan 29, 2024Jan 29, 2024
Youku-mPLUG
Public
Youku-mPLUG: A 10 Million Large-scale Chinese Video-Language Pre-training Dataset and Benchmarks
benchmark video dataset chinese youku multimodal video-retrieval video-question-answering multimodal-pretraining mllm
Python
•
Apache License 2.0
•11•288•25•0•Updated Jan 8, 2024Jan 8, 2024
ChatPLUG
Public
A Chinese Open-Domain Dialogue System
chat chatbot dialogue chinese personality encoder-decoder pretraining large-language-models knowledge-augment chatgpt
Python
•
Apache License 2.0
•28•318•0•0•Updated Aug 16, 2023Aug 16, 2023
mPLUG-2
Public
mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video (ICML 2023)
video vqa image-retrieval multimodal video-retrieval video-question-answering foundation-models multimodal-pretraining mllm mplug
Python
•
Apache License 2.0
•19•221•17•0•Updated Jul 21, 2023Jul 21, 2023
CValues
Public
面向中文大模型价值观的评估与对齐研究
benchmark evaluation safety responsibility human-values multi-choice llms chinese-llms
Python
•
Apache License 2.0
•20•484•2•0•Updated Jul 20, 2023Jul 20, 2023
mPLUG
Public
mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connections. (EMNLP 2022)
pytorch transformer vqa image-captioning visual-language image-text multimodal pretraining image-text-retrieval
Python
•7•85•11•0•Updated May 8, 2023May 8, 2023