Awesome-Efficient-Reasoning  by hemingkx

Paper list for efficient reasoning in large language models

Created 6 months ago
659 stars

Top 50.8% on SourcePulse

GitHubView on GitHub
Project Summary

This repository is a curated, regularly updated paper list focused on "Efficient Reasoning" in Large Language Models (LLMs). It serves researchers and practitioners by cataloging advancements in techniques that reduce computational cost and improve reasoning performance, covering areas like compression, distillation, sampling, and scaling.

How It Works

The list categorizes papers based on specific efficiency techniques applied to LLM reasoning. It covers broad survey papers, methods for efficient training (e.g., curriculum learning, RL), latent reasoning approaches, compression strategies, step decomposition, distillation for smaller models, collaboration between model sizes, and various test-time scaling and sampling methods. The organization allows users to quickly find relevant research across different efficiency paradigms.

Quick Start & Requirements

This is a paper list, not a software library. No installation or execution is required. Users can browse the categorized links to papers, code repositories, and related resources.

Highlighted Details

  • Comprehensive coverage of efficient reasoning techniques, including surveys, training, inference, and analysis.
  • Categorization by specific methods like Latent Chain-of-Thought, Compression, Balanced CoT, Reasoning Shortcuts, and Test-Time Scaling.
  • Includes links to papers, code, blogs, talks, and other related reading lists for deeper exploration.
  • Features recent publications, with many entries dated 2024 and 2025, reflecting the cutting edge of the field.

Maintenance & Community

The list is presented as "regularly updated" and encourages contributions from the community to include missed works. Links to related "Awesome" lists are provided, indicating community engagement.

Licensing & Compatibility

Not applicable, as this is a curated list of research papers and resources.

Limitations & Caveats

The list is a compilation of external research and does not provide any executable code or models itself. The quality and applicability of the listed papers depend on their original sources.

Health Check
Last Commit

14 hours ago

Responsiveness

1 day

Pull Requests (30d)
1
Issues (30d)
0
Star History
65 stars in the last 30 days

Explore Similar Projects

Starred by Elie Bursztein Elie Bursztein(Cybersecurity Lead at Google DeepMind), Joe Walnes Joe Walnes(Head of Experimental Projects at Stripe), and
1 more.

KAG by OpenSPG

0.4%
8k
Logical reasoning framework for domain knowledge bases
Created 1 year ago
Updated 1 month ago
Feedback? Help us improve.