lvlm

Eagle: Frontier Vision-Language Models with Data-Centric Strategies

🔥🔥🔥 A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).

OpenThinkIMG is an end-to-end open-source framework that empowers LVLMs to think with images.

[Fully open] [Encoder-free MLLM] Vision as LoRA

up-to-date curated list of state-of-the-art Large vision language models hallucinations research work, papers & resources

[NeurIPS 2024] This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"

Awesome-Backdoor-on-LMMs is a collection of state-of-the-art, novel, exciting backdoor methods on LMMs (VLPs, TDMs, VLMs, and Agents).

Latest Advances on (RL based) Multimodal Reasoning and Generation in Multimodal LLMs

[ICCV'25] The official code of paper "Combining Similarity and Importance for Video Token Reduction on Large Visual Language Models"

📜 Paper list on decoding methods for LLMs and LVLMs

[ICCV 2025] HQ-CLIP: Leveraging Large Vision-Language Models to Create High-Quality Image-Text Datasets

[AAAI 2025] HiRED strategically drops visual tokens in the image encoding stage to improve inference efficiency for High-Resolution Vision-Language Models (e.g., LLaVA-Next) under a fixed token budget.

CLIP-MoE: Mixture of Experts for CLIP

[ICLR 2026] AgilePruner: An Empirical Study of Attention and Diversity for Adaptive Visual Token Pruning in Large Vision-Language Models

The official repository of "SmartAgent: Chain-of-User-Thought for Embodied Personalized Agent in Cyber World".

Code for ICLR 2025 Paper: Visual Description Grounding Reduces Hallucinations and Boosts Reasoning in LVLMs

LEMMA: An effective and explainable way to detect multimodal misinformation with LVLM and external knowledge augmentation, incorporating the intuition and reasoning capbility inside LVLM.

[CVPR'25] Antidote: A Unified Framework for Mitigating LVLM Hallucinations in Counterfactual Presupposition and Object Perception

Large Visual Language Model(LVLM), Large Language Model(LLM), Multimodal Large Language Model(MLLM), Alignment, Agent, AI System, Survey

A benchmark dataset and simple code examples for measuring the perception and reasoning of multi-sensor Vision Language models.