Awesome-LLM-paper

This repository contains papers related to all kinds of LLMs.

We strongly encourage researchers in the hope of advancing their excellent work.

---

Contents

• Awesome-LLM-paper
  • Contents
• Resources
  • Workshops and Tutorials
• Papers
  • Survey
  • Benchmark and Evaluation
  • RAG
  • Embedding
  • LLM
  • Agent
  • MMLM
• 🌟 Contributors
• Star History

---

Resources

Workshops and Tutorials

Theme	Source	Link	Other
……	……	……	……
Descriptions	……

Papers

Survey

Paper	Source	Link	Other
A Survey on Multimodal Large Language Models for Autonomous Driving	arXiv:2311.12320	bilibili	……
Descriptions	……
Retrieval-Augmented Generation for Large Language Models: A Survey	Arxiv2023'Tongji University	……	……
Descriptions	This paper provides a comprehensive overview of the integration of retrieval mechanisms with generative processes within large language models to enhance their performance and knowledge capabilities.

Benchmark and Evaluation

Paper	Source	Link	Other
……	……	……	……
Descriptions	……

RAG

Paper	Source	Link	Other
Improving Text Embeddings with Large Language Models	Arxiv2024'Microsoft	……	……
ARES: An Automated Evaluation Framework for Retrieval-Augmented Generation Systems	NAACL 2024	bilibili	Code: stanford-futuredata/ARES
Descriptions	ARES, an Automated RAG Evaluation System, efficiently evaluates retrieval-augmented generation systems across multiple tasks using synthetic data and minimal human annotations, maintaining accuracy even with domain shifts.

Embedding

Paper	Source	Link	Other
……	……	……	……
Descriptions	……

LLM

Paper	Source	Link	Other
Higher Layers Need More LoRA Experts	Arxiv2024'Northwestern University	……	……
Descriptions	In deep learning models, higher layers require more LoRA (Low-Rank Adaptation) experts to enhance the model’s expressive power and adaptability.
LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression	Arxiv2023'Microsoft	……	……
Descriptions	To accelerate and enhance the performance of large language models (LLMs) in handling long texts, compressing prompts can be an effective method.
Can AI Assistants Know What They Don't Know?	Arxiv2024'Fudan University	……	Code: Say-I-Dont-Know
Descriptions	The paper explores if AI assistants can identify when they don't know something, creating a "I don't know" dataset to teach this, resulting in fewer false answers and increased accuracy.

Agent

Paper	Source	Link	Other
……	……	……	……
Descriptions	……

MMLM

Paper	Source	Link	Other
……	……	……	……
Descriptions	……

Reinforcement Learning

Paper	Source	Link	Other
Diffusion Policies as an Expressive Policy Class for Offline Reinforcement Learning	ICLR2023	……	……
Descriptions	Diffusion strategies, as a highly expressive class of policies, are used in offline reinforcement learning scenarios to improve learning efficiency and decision-making performance.

🌟 Contributors

Star History