Wing Lian

Adaptive LLM computation with dynamic recursion

mixture_of_recursions by raymin0223

5.7%

400

created 2 months ago

Hierarchical reasoning for complex tasks

Starred by

Didier Lopes(Founder of OpenBB).

cc by kn1026

Starred by

Anton Bukov(Cofounder of 1inch Network) and

Jeff Hammerbacher(Cofounder of Cloudera).

HRM by sapientinc

14.3%

created 1 month ago

Starred by

Tobi Lutke(Cofounder of Shopify),

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n), and

4 more.

matmulfreellm by ridgerchu

MatMul-free language models

Starred by

Stas Bekman(Author of "Machine Learning Engineering Open Book"; Research Engineer at Snowflake).

applied-ai by meta-pytorch

Applied AI experiments and examples for PyTorch

290

RL training pipeline for multi-turn tool use LLMs, optimized for real-world tasks

Starred by

Jeff Hammerbacher(Cofounder of Cloudera),

Zhiqiang Xie(Author of SGLang), and

3 more.

SkyRL by NovaSky-AI

3.4%

723

created 3 months ago

Research paper repo for math reasoning in small LLMs via deep thinking

Starred by

Yaowei Zheng(Author of LLaMA-Factory).

rStar by microsoft

1.0%

616

created 11 months ago

NeMo-Skills by NVIDIA

LLM skill-improvement pipelines for synthetic data generation, training, and evaluation

513

Absolute-Zero-Reasoner by LeapLabTHU

Self-play reasoning framework needing zero data

created 3 months ago

Starred by

Tobi Lutke(Cofounder of Shopify),

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n), and

16 more.

open-webui by open-webui

Self-hosted AI platform for local LLM deployment

107k

TTRL by PRIME-RL

RL technique for unlabeled data, especially test data

757

created 3 months ago

Starred by

Tobi Lutke(Cofounder of Shopify),

Patrick von Platen(Research Engineer at Mistral; Author of Hugging Face Diffusers), and

20 more.

axolotl by axolotl-ai-cloud

CLI tool for streamlined post-training of AI models

Starred by

Hiroshi Shibata(Core Contributor to Ruby),

Philipp Schmid(DevRel at Google DeepMind), and

6 more.

agno by agno-agi

Lightweight library for building AI Agents with memory, knowledge, and reasoning

32k

Starred by

Kent Dodds(Cofounder of Remix),

Travis Fischer(Founder of Agentic), and

1 more.

github-mcp-server by github

2.9%

MCP server for GitHub API automation and interaction

Synthetic data generation project using LLM agents

updated 23 hours ago

loong by camel-ai

1.3%

314

created 4 months ago

Starred by

Shizhe Diao(Research Scientist at NVIDIA; Author of LMFlow),

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), and

2 more.

SWE-Gym by SWE-Gym

Environment for training software engineering agents

522

Starred by

Yaowei Zheng(Author of LLaMA-Factory).

GamingAgent by lmgame-org

SDK for LLM/VLM gaming agents, enabling model evaluation via games

741

LLM research paper exploring masked diffusion language models

Starred by

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems").

LLaDA by ML-GSAI

1.7%

Starred by

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"),

Alex Cheema(Cofounder of EXO Labs), and

1 more.

recurrent-pretraining by seal-rg

Pretraining code for depth-recurrent language model research

812

TransMLA by fxmeng

Post-training method converts GQA-based LLMs to MLA models

339

Starred by

Shizhe Diao(Research Scientist at NVIDIA; Author of LMFlow).

MLGym by facebookresearch

Gym environment for ML research agents

544

Starred by

Yaowei Zheng(Author of LLaMA-Factory) and

Teknium(Cofounder of Nous Research).

coconut by facebookresearch

Research paper implementation for LLM reasoning in latent space

Sparse attention implementation from Deepseek's research paper

native-sparse-attention-pytorch by lucidrains

1.0%

719

ReasonFlux by Gen-Verse

LLM post-training algorithms for data selection, RL, and inference

478

Starred by

Travis Fischer(Founder of Agentic) and

Elvis Saravia(Founder of DAIR.AI).

LIMO by GAIR-NLP

Reasoning model using less data

Starred by

Lewis Tunstall(Research Engineer at Hugging Face),

Shizhe Diao(Research Scientist at NVIDIA; Author of LMFlow), and

5 more.

s1 by simplescaling

Test-time scaling recipe for strong reasoning performance

Procedural dataset generator for reasoning models

Starred by

Shizhe Diao(Research Scientist at NVIDIA; Author of LMFlow),

Junyang Lin(Core Maintainer of Alibaba Qwen), and

4 more.

reasoning-gym by open-thought

1.8%

Starred by

Ross Taylor(Cofounder of General Reasoning; Creator of Papers with Code),

Yaowei Zheng(Author of LLaMA-Factory), and

2 more.

curator by bespokelabsai

Synthetic data curation tool for post-training and structured data extraction

Starred by

Shizhe Diao(Research Scientist at NVIDIA; Author of LMFlow).

RAGEN by RAGEN-AI

Train LLM agents with reinforcement learning in interactive environments

Starred by

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"),

Yaowei Zheng(Author of LLaMA-Factory), and

2 more.

SkyThought by NovaSky-AI

Training recipes for Sky-T1 family of models

Recipes to scale inference-time compute of open models

Starred by

Philipp Schmid(DevRel at Google DeepMind),

Leandro von Werra(Head of Research at Hugging Face), and

2 more.

search-and-learn by huggingface

created 8 months ago

buffer-of-thought-llm by YangLing0818

Research paper implementation for thought-augmented LLM reasoning

654

HuatuoGPT-o1 by FreedomIntelligence

Medical LLM for advanced reasoning

LayerSkip by facebookresearch

Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding" research paper

327

Python tool for converting files to Markdown for LLM text analysis

Starred by

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"),

Elvis Saravia(Founder of DAIR.AI), and

13 more.

markitdown by microsoft

1.4%

72k

Starred by

Thomas Wolf(Cofounder of Hugging Face),

Lewis Tunstall(Research Engineer at Hugging Face), and

3 more.

NeMo-Aligner by NVIDIA

Toolkit for efficient model alignment

835

agency-swarm by VRSEN

Agentic framework built on OpenAI Assistants API for automating AI workflows

Starred by

Didier Lopes(Founder of OpenBB),

Jeff Hammerbacher(Cofounder of Cloudera), and

1 more.

instructlab by instructlab

CLI tool for LLM alignment tuning via synthetic data

Starred by

Yaowei Zheng(Author of LLaMA-Factory),

Zhiqiang Xie(Author of SGLang), and

8 more.

flash-linear-attention by fla-org

Efficient Torch/Triton implementations for linear attention models

TokenFormer by Haiyang-W

Research paper on a fully attention-based neural network with tokenized model parameters

568

Starred by

Clement Delangue(Cofounder of Hugging Face),

Thomas Wolf(Cofounder of Hugging Face), and

4 more.

evaluation-guidebook by huggingface

LLM evaluation guide for practitioners

created 10 months ago

Starred by

Thomas Wolf(Cofounder of Hugging Face),

Travis Fischer(Founder of Agentic), and

1 more.

dynasaur by adobe-research

LLM agent framework using dynamic action creation via Python code generation

348

Marco-o1 by AIDC-AI

Open reasoning model for real-world problem solving

Starred by

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"),

Philipp Schmid(DevRel at Google DeepMind), and

1 more.

SageAttention by thu-ml

Attention kernel for plug-and-play inference acceleration

created 10 months ago

Starred by

Elvis Saravia(Founder of DAIR.AI),

Carol Willing(Core Contributor to CPython, Jupyter), and

11 more.

metaflow by Netflix

Framework for building and managing AI/ML systems

Optimizer for neural network hidden layers

Starred by

Albert Gu(Cofounder of Cartesia; Professor at CMU) and

Jesse Clark(Cofounder of Marqo).

Muon by KellerJordan

3.0%

Starred by

Philipp Schmid(DevRel at Google DeepMind) and

Georgios Konstantopoulos(CTO, General Partner at Paradigm).

MathBlackBox by trotsky1997

Research paper for mathematical reasoning via LLMs

Starred by

Elvis Saravia(Founder of DAIR.AI),

Anton Bukov(Cofounder of 1inch Network), and

8 more.

BitNet by microsoft

Inference framework for 1-bit LLMs

Starred by

Simon Willison(Author of Django) and

Omar Sanseviero(DevRel at Google DeepMind).

Aria by rhymes-ai

Multimodal MoE model for video, document understanding, and dialog

created 10 months ago

Starred by

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems") and

David Cournapeau(Author of scikit-learn).

Hands-On-Large-Language-Models by HandsOnLLM

Code examples for "Hands-On Large Language Models" book

14k

Language model training speedrun on 8x H100 GPUs

Starred by

George Hotz(Author of tinygrad; Founder of the tiny corp, comma.ai),

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n), and

7 more.

modded-nanogpt by KellerJordan

1.3%

updated 4 weeks ago

Starred by

Ishaan Jaffer(Cofounder of LiteLLM),

Chaoyu Yang(Founder of Bento), and

6 more.

llama-stack by llamastack

Composable building blocks for Llama apps

Starred by

Jiaming Song(Chief Scientist at Luma AI).

Adam-mini by zyushun

PyTorch implementation of Adam-mini optimizer from a research paper

434

Starred by

Dan Guido(Cofounder of Trail of Bits),

Dmytro Dzhulgakov(Cofounder of Fireworks AI), and

5 more.

optillm by codelion

Optimizing inference proxy for LLMs

created 11 months ago

LLM ensembling framework using pairwise ranking and generative fusion

Starred by

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"),

Philipp Schmid(DevRel at Google DeepMind), and

3 more.

LLM-Blender by yuchenlin

957

Benchmark for evaluating LLMs on planning tasks

LLMs-Planning by karthikv792

393

Research paper for improving small LLM reasoning via mutual reasoning

Starred by

Jesse Clark(Cofounder of Marqo).

rStar by zhentingqi

955

distributed-training-guide by LambdaLabsML

PyTorch guide for distributed training of large language models

465

CLI tool for LLM compression via pruning, quantization, and distillation

nyuntam by nyunAI

683

Starred by

Will Brown(Research Lead at Prime Intellect) and

Victor Taelin(Author of Bend, Kind, HVM).

MisguidedAttention by cpldcpu

LLM reasoning benchmark for evaluating responses to misleading prompts

437

Reasoning tasks collection for LLMs

Starred by

Johannes Hagemann(Cofounder of Prime Intellect),

Philipp Schmid(DevRel at Google DeepMind), and

4 more.

Open-Reasoning-Tasks by NousResearch

448

Starred by

Yaowei Zheng(Author of LLaMA-Factory) and

Jiaming Song(Chief Scientist at Luma AI).

long-context-attention by feifeibear

Unified sequence parallel attention for long context LLM training/inference

546

updated 4 weeks ago

Starred by

Vincent Weisser(Cofounder of Prime Intellect) and

Johannes Hagemann(Cofounder of Prime Intellect).

DistillKit by arcee-ai

Open-source toolkit for LLM distillation research

708

Starred by

Nathan Lambert(Research Scientist at AI2).

do-not-answer by Libr-AI

Dataset for evaluating LLM safety mechanisms

277

Starred by

Stas Bekman(Author of "Machine Learning Engineering Open Book"; Research Engineer at Snowflake).

fms-fsdp by foundation-model-stack

Efficiently train foundation models with PyTorch

259

Starred by

Tim J. Baek(Founder of Open WebUI),

John Yang(Author of SWE-bench, SWE-agent), and

5 more.

OLMo by allenai

Open language model code for training, evaluation, and inference

Memory-efficient optimizer for large language model finetuning

Starred by

Yaowei Zheng(Author of LLaMA-Factory).

BAdam by Ledzy

265

AI research project for efficient LLM training and inference

Starred by

Elvis Saravia(Founder of DAIR.AI).

snowflake-arctic by Snowflake-Labs

546

Starred by

Vincent Weisser(Cofounder of Prime Intellect),

Ross Taylor(Cofounder of General Reasoning; Creator of Papers with Code), and

8 more.

open-instruct by allenai

Training codebase for instruction-following language models

mdistiller by megvii-research

PyTorch library for knowledge distillation research

868

Starred by

Didier Lopes(Founder of OpenBB),

Vincent Weisser(Cofounder of Prime Intellect), and

3 more.

augmentoolkit by e-p-armstrong

Data toolkit for custom LLM creation using open-source AI

awesome-synthetic-datasets by davanstrien

Curated list of synthetic text/vision datasets and generation tools

292

Starred by

Zhuohan Li(Author of vLLM).

calm by zeux

Single-GPU inference engine for rapid LLM prototyping

599

Starred by

Shizhe Diao(Research Scientist at NVIDIA; Author of LMFlow),

Elvis Saravia(Founder of DAIR.AI), and

3 more.

MobileLLM by facebookresearch

Sub-billion parameter LLM training code for on-device use

Starred by

Michael Han(Cofounder of Unsloth),

Simon Willison(Author of Django), and

5 more.

phoenix by Arize-ai

AI observability platform for experimentation, evaluation, and troubleshooting

Self-Play Preference Optimization (SPPO) aligns language models via self-play

Starred by

Johannes Hagemann(Cofounder of Prime Intellect).

SPPO by uclaml

574

Research paper for improving LLM instruction-following via self-play with execution feedback

Starred by

Yaowei Zheng(Author of LLaMA-Factory).

AutoIF by QwenLM

301

refusal_direction by andyrdt

Research paper code for analyzing refusal in language models

254

Sharded data parallelism framework for transformer-like neural networks

Starred by

Stas Bekman(Author of "Machine Learning Engineering Open Book"; Research Engineer at Snowflake) and

Elvis Saravia(Founder of DAIR.AI).

YaFSDP by yandex

973

Starred by

Nathan Lambert(Research Scientist at AI2),

Shizhe Diao(Research Scientist at NVIDIA; Author of LMFlow), and

1 more.

chat_templates by chujiezheng

Chat templates for HuggingFace LLMs

693

Starred by

Travis Fischer(Founder of Agentic) and

Jeff Hammerbacher(Cofounder of Cloudera).

LESS by princeton-nlp

Data selection research paper for targeted instruction tuning

476

Parameter-efficient fine-tuning via high-rank updating (MoRA)

Starred by

Jeremy Howard(Cofounder of fast.ai).

MoRA by kongds

358

Preference optimization algorithm for LLMs (NeurIPS 2024 paper)

Starred by

Shizhe Diao(Research Scientist at NVIDIA; Author of LMFlow) and

Philipp Schmid(DevRel at Google DeepMind).

SimPO by princeton-nlp

913

Starred by

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems") and

Elvis Saravia(Founder of DAIR.AI).

qodo-cover by qodo-ai

CLI tool for AI-powered test generation and code coverage enhancement

Gemma 2B with 10M context length using Infini-attention

Starred by

Vincent Weisser(Cofounder of Prime Intellect).

gemma-2B-10M by mustafaaljadery

947

Starred by

Lysandre Debut(Chief Open-Source Officer at Hugging Face),

Junyang Lin(Core Maintainer of Alibaba Qwen), and

1 more.

xtuner by InternLM

LLM fine-tuning toolkit for research

Starred by

Jesse Clark(Cofounder of Marqo) and

Omar Sanseviero(DevRel at Google DeepMind).

GLiNER by urchade

NER model for identifying any entity type using bidirectional transformer

Starred by

Travis Fischer(Founder of Agentic) and

Jeff Hammerbacher(Cofounder of Cloudera).

contriever by facebookresearch

Unsupervised dense information retrieval via contrastive learning

751

prometheus-eval by prometheus-eval

LLM evaluation framework using open LLMs

980

Starred by

Yaowei Zheng(Author of LLaMA-Factory),

Elvis Saravia(Founder of DAIR.AI), and

2 more.

LLMTest_NeedleInAHaystack by gkamradt

LLM testing tool for evaluating in-context retrieval accuracy

Research paper for self-alignment in code generation

Starred by

Philipp Schmid(DevRel at Google DeepMind).

selfcodealign by bigcode-project

309

Starred by

Jeremy Howard(Cofounder of fast.ai),

Philipp Schmid(DevRel at Google DeepMind), and

1 more.

llm-datasets by mlabonne

Curated datasets/tools for LLM post-training

Starred by

Jeremy Howard(Cofounder of fast.ai),

Ying Sheng(Author of SGLang), and

1 more.

rerope by bojone

Position embeddings research paper

380

Starred by

Elvis Saravia(Founder of DAIR.AI),

Julien Chaumond(Cofounder of Hugging Face), and

4 more.

LaVague by lavague-ai

Web agent framework for automating web processes

Starred by

Will Brown(Research Lead at Prime Intellect),

Alexander Wettig(Author of SWE-bench, SWE-agent), and

1 more.

ring-flash-attention by zhuzilin

FlashAttention extension for ring attention

836

LLMOps pipeline to fine-tune small LLMs for service LLM outage prep

Starred by

Omar Sanseviero(DevRel at Google DeepMind).

llamaduo by deep-diver

313

Starred by

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"),

Will Brown(Research Lead at Prime Intellect), and

5 more.

cohere-toolkit by cohere-ai

RAG toolkit for LLM application development and deployment

Starred by

Travis Fischer(Founder of Agentic),

Shawn Wang(Editor of Latent Space), and

3 more.

uptrain by uptrain-ai

Open-source platform to evaluate and improve GenAI apps

BitBLAS by microsoft

Library for mixed-precision matrix multiplications, targeting quantized LLM deployment

658

Starred by

Yaowei Zheng(Author of LLaMA-Factory),

Zhuohan Li(Author of vLLM), and

5 more.

arena-hard-auto by lmarena

Automatic LLM benchmark for instruction-tuned models, correlating with human preference

902

Training-free method for extending LLM context windows

ChunkLlama by HKUNLP

435

Starred by

Tobi Lutke(Cofounder of Shopify) and

Jeff Hammerbacher(Cofounder of Cloudera).

dstack by dstackai

Open-source tool for simplifying GPU allocation and AI workload orchestration

LLM pretraining research paper using selective language modeling (SLM)

rho by microsoft

429

Starred by

Tobi Lutke(Cofounder of Shopify),

Shizhe Diao(Research Scientist at NVIDIA; Author of LMFlow), and

11 more.

dify by langgenius

Open-source LLM app development platform

111k

updated 23 hours ago

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Suale Hasif(Cofounder of Cursor), and

2 more.

attorch by BobMcDear

PyTorch nn module subset, implemented in Python using Triton

568

Starred by

John Yang(Author of SWE-bench, SWE-agent) and

Elvis Saravia(Founder of DAIR.AI).

mixtral-offloading by dvmazur

Inference optimization for Mixtral-8x7B models

Starred by

Dan Guido(Cofounder of Trail of Bits),

Travis Fischer(Founder of Agentic), and

4 more.

auto-code-rover by AutoCodeRoverSG

Autonomous software engineer for program improvement

HuggingFace Transformers implementation of BitNet scaling for LLMs

BitNet-Transformers by Beomi

305

Recipes for language model context length extrapolation to 1M tokens

Starred by

Yaowei Zheng(Author of LLaMA-Factory),

Jiaming Song(Chief Scientist at Luma AI), and

1 more.

EasyContext by jzhang38

739

Starred by

Jeremy Howard(Cofounder of fast.ai),

Jeff Hammerbacher(Cofounder of Cloudera), and

1 more.

pyreft by stanfordnlp

Python library for representation finetuning (ReFT) of language models

Researcher's toolbench for GPT model exploration

Starred by

George Hotz(Author of tinygrad; Founder of the tiny corp, comma.ai) and

Daniel Han(Cofounder of Unsloth).

hlb-gpt by tysam-code

349

aideml by WecoAI

ML engineering agent for automated AI R&D, surpassing human experts

991

Starred by

Alex Cheema(Cofounder of EXO Labs),

Victor Taelin(Author of Bend, Kind, HVM), and

1 more.

BitNet by kyegomez

PyTorch implementation of BitNet research paper

Starred by

Aravind Srinivas(Cofounder of Perplexity),

François Chollet(Cofounder of Ndea, ARC Prize; Author of Keras), and

15 more.

horovod by horovod

Distributed training framework for TF, Keras, PyTorch, and MXNet

created 8 years ago

Starred by

Jeff Hammerbacher(Cofounder of Cloudera) and

Philipp Schmid(DevRel at Google DeepMind).

dataverse by UpstageAI

ETL pipeline for LLM data processing

556

Starred by

Daniel Han(Cofounder of Unsloth),

Yaowei Zheng(Author of LLaMA-Factory), and

1 more.

hqq by mobiusml

Model quantizer for fast, accurate post-training quantization, skipping calibration

861

Starred by

Alex Cheema(Cofounder of EXO Labs) and

Jeff Hammerbacher(Cofounder of Cloudera).

Triton-Puzzles by srush

Interactive puzzles for learning Triton

Starred by

Jeremy Howard(Cofounder of fast.ai) and

Will Brown(Research Lead at Prime Intellect).

repeng by vgel

Python library for representation engineering control vectors

624

Multimodal LLM research paper extending Mamba for efficient inference

cobra by h-zhao1997

285

Minimal code for running and finetuning a 7B transformer model

Starred by

Daniel Han(Cofounder of Unsloth).

hackathon by mistralai-sf24

447

Starred by

Jeff Huber(Cofounder of Chroma),

James Luan(VP Engineering at Zilliz), and

1 more.

raft by rapidsai

CUDA-accelerated primitives for ML/data mining algorithms

925

created 6 years ago

Starred by

Will Brown(Research Lead at Prime Intellect) and

Elvis Saravia(Founder of DAIR.AI).

maestro by Doriandarko

Framework for Claude Opus to orchestrate subagents

Research code for self-teaching language models

Starred by

Vincent Weisser(Cofounder of Prime Intellect),

Anton Osika(Cofounder of Lovable), and

1 more.

quiet-star by ezelikman

737

Starred by

Tobi Lutke(Cofounder of Shopify),

Jonathan Ragan-Kelley(Professor at MIT), and

16 more.

ml-engineering by stas00

Open book for LLM/VLM training engineers

Starred by

Tobi Lutke(Cofounder of Shopify),

Jeffrey Morgan(Cofounder of Ollama), and

8 more.

chatbot-ui by mckaywrigley

32k

Open-source AI chat app

Preference optimization without a reference model

Starred by

Yaowei Zheng(Author of LLaMA-Factory) and

Lewis Tunstall(Research Engineer at Hugging Face).

orpo by xfactlab

461

Starred by

Shizhe Diao(Research Scientist at NVIDIA; Author of LMFlow),

Travis Fischer(Founder of Agentic), and

9 more.

SWE-bench by SWE-bench

Benchmark for evaluating LLMs on real-world GitHub issues

Starred by

Michael Truell(Cofounder of Cursor),

Georgios Konstantopoulos(CTO, General Partner at Paradigm), and

25 more.

OpenHands by All-Hands-AI

AI platform for software development agents

62k

FastV by pkunlp-icler

Inference acceleration for large vision-language models (research paper)

471

Starred by

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems").

airllm by lyogavin

Inference optimization for LLMs on low-resource hardware

Starred by

Junyang Lin(Core Maintainer of Alibaba Qwen),

Max Stoiber(Director Engineering at Shopify; Author of styled-components), and

3 more.

daytona by daytonaio

Infrastructure for running AI-generated code

Vision transformer research paper

updated 22 hours ago

VisionLLaMA by Meituan-AutoML

386

Starred by

Jeff Hammerbacher(Cofounder of Cloudera),

Calvin French-Owen(Cofounder of Segment), and

4 more.

fsdp_qlora by AnswerDotAI

Training script for LLMs using QLoRA + FSDP

Starred by

Elie Bursztein(Cybersecurity Lead at Google DeepMind),

Andy Konwinski (Cofounder of Perplexity, Databricks), and

4 more.

h2o-llmstudio by h2oai

LLM Studio: framework for LLM fine-tuning via GUI or CLI

LLM for music understanding and generation

ChatMusician by hf-lin

266

Starred by

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems").

AnyGPT by OpenMOSS

Multimodal LLM research paper for any-to-any modality conversion

857

Starred by

Tobi Lutke(Cofounder of Shopify),

Elie Bursztein(Cybersecurity Lead at Google DeepMind), and

7 more.

FlagEmbedding by FlagOpen

Toolkit for retrieval and RAG applications

Training framework for self-rewarding language models

Starred by

Vincent Weisser(Cofounder of Prime Intellect),

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), and

4 more.

self-rewarding-lm-pytorch by lucidrains

Starred by

Tobi Lutke(Cofounder of Shopify),

Jeff Hammerbacher(Cofounder of Cloudera), and

11 more.

crewAI by crewAIInc

Framework for autonomous AI agent orchestration via role-playing and collaboration

36k

Starred by

Jeff Hammerbacher(Cofounder of Cloudera) and

Johannes Hagemann(Cofounder of Prime Intellect).

resource-stream by gpu-mode

CUDA resource collection for GPU programming

Starred by

Omar Sanseviero(DevRel at Google DeepMind),

Jeremy Howard(Cofounder of fast.ai), and

4 more.

metal-flash-attention by philipturner

Metal port of FlashAttention for Apple silicon

517

Educational resource for LLM construction in PyTorch

Starred by

Peter Norvig(Author of "Artificial Intelligence: A Modern Approach"; Research Director at Google),

Bojan Tunguz(AI Scientist; Formerly at NVIDIA), and

7 more.

LLMs-from-scratch by rasbt

1.3%

64k

Starred by

Jeff Hammerbacher(Cofounder of Cloudera),

Didier Lopes(Founder of OpenBB), and

8 more.

mlx-examples by ml-explore

Examples using the MLX framework

Starred by

Travis Fischer(Founder of Agentic).

ai-codereviewer by villesau

GitHub Action for AI-powered code review

930

Starred by

Shizhe Diao(Research Scientist at NVIDIA; Author of LMFlow) and

Yaowei Zheng(Author of LLaMA-Factory).

deita by hkust-nlp

Data-efficient instruction tuning for LLM alignment (ICLR 2024)

565

Starred by

Vincent Weisser(Cofounder of Prime Intellect),

Woosuk Kwon(Author of vLLM), and

5 more.

AutoAWQ by casper-hansen

AutoAWQ is a tool for 4-bit quantized LLM inference

ProxyAI by carlrobertoh

JetBrains IDE copilot for coding assistance

Starred by

Shizhe Diao(Research Scientist at NVIDIA; Author of LMFlow),

Philipp Schmid(DevRel at Google DeepMind), and

4 more.

EAGLE by SafeAILab

Speculative decoding research paper for faster LLM inference

Starred by

Yaowei Zheng(Author of LLaMA-Factory) and

Stas Bekman(Author of "Machine Learning Engineering Open Book"; Research Engineer at Snowflake).

HALOs by ContextualAI

Library for aligning LLMs using human-aware loss functions

878

Starred by

George Hotz(Author of tinygrad; Founder of the tiny corp, comma.ai),

Zhiyuan Li(Cofounder of Nexa AI), and

18 more.

mamba by state-spaces

Mamba SSM architecture for sequence modeling

16k

Inference server for open-source LLMs, offering an OpenAI-compatible API

updated 4 weeks ago

modelz-llm by tensorchord

276

Starred by

Tobi Lutke(Cofounder of Shopify),

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n), and

25 more.

unsloth by unslothai

Finetuning tool for LLMs, targeting speed and memory efficiency

44k

Starred by

Emile Vauge(Founder of Traefik),

Anton Troynikov(Cofounder of Chroma), and

7 more.

gpt-researcher by assafelovic

Autonomous agent for web/local research, generating cited reports

23k

Starred by

Chaoyu Yang(Founder of Bento),

Yaowei Zheng(Author of LLaMA-Factory), and

3 more.

functionary by MeetKai

Chat language model for tool use and result interpretation

Logic-LM: Framework for improved logical reasoning via LLMs and symbolic solvers

Logic-LLM by teacherpeterpan

338

Starred by

Travis Fischer(Founder of Agentic),

Elvis Saravia(Founder of DAIR.AI), and

4 more.

LLMSurvey by RUCAIBox

Survey paper for large language models

Starred by

Leandro von Werra(Head of Research at Hugging Face),

Jesse Clark(Cofounder of Marqo), and

10 more.

distilabel by argilla-io

Framework for synthetic data and AI feedback pipelines

Literature repository for long-context LLM methodologies

Starred by

Yaowei Zheng(Author of LLaMA-Factory).

long-llms-learning by Strivin0311

265

Starred by

Johannes Hagemann(Cofounder of Prime Intellect),

Yaowei Zheng(Author of LLaMA-Factory), and

1 more.

MergeLM by yule-BUAA

Codebase for merging language models via parameter averaging

843

Starred by

Jiaming Song(Chief Scientist at Luma AI).

Video-LLaVA by PKU-YuanGroup

Video-LLaVA: Multimodal model for video/image understanding via LLM

Starred by

Vincent Weisser(Cofounder of Prime Intellect).

medAlpaca by kbressem

LLM finetuned for medical question answering

535

Transformer toolkit for GenAI/LLM acceleration on Intel platforms

Starred by

Ettore Di Giacinto(Author of LocalAI) and

Omar Sanseviero(DevRel at Google DeepMind).

intel-extension-for-transformers by intel

Starred by

Jeff Hammerbacher(Cofounder of Cloudera),

Jeremy Howard(Cofounder of fast.ai), and

3 more.

multimodal by facebookresearch

PyTorch library for multimodal multi-task model training

Starred by

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"),

Johannes Hagemann(Cofounder of Prime Intellect), and

3 more.

S-LoRA by S-LoRA

System for scalable LoRA adapter serving

Starred by

Aravind Srinivas(Cofounder of Perplexity),

Stas Bekman(Author of "Machine Learning Engineering Open Book"; Research Engineer at Snowflake), and

27 more.

DeepSpeed by deepspeedai

Deep learning optimization library for distributed training and inference

40k

updated 22 hours ago

Starred by

Tobi Lutke(Cofounder of Shopify),

Wes McKinney(Author of Pandas), and

11 more.

continue by continuedev

IDE extension for custom AI code assistants

28k

Starred by

Didier Lopes(Founder of OpenBB),

Travis Fischer(Founder of Agentic), and

11 more.

llama-cookbook by meta-llama

Guide for building with Llama models

Cloud tool for task-oriented embedding finetuning of models like BERT and CLIP

Starred by

Omar Sanseviero(DevRel at Google DeepMind),

Jared Palmer(Ex-VP AI at Vercel; Founder of Turborepo; Author of Formik, TSDX), and

3 more.

finetuner by jina-ai

Starred by

Aravind Srinivas(Cofounder of Perplexity),

Wes McKinney(Author of Pandas), and

15 more.

ludwig by ludwig-ai

Low-code framework for custom AI models (LLMs, neural networks)

created 6 years ago

Starred by

Anastasios Angelopoulos(Cofounder of LMArena),

Phil Wang(Prolific Research Paper Implementer), and

10 more.

img2dataset by rom1504

CLI tool for creating large image datasets from URLs

Starred by

Georgios Konstantopoulos(CTO, General Partner at Paradigm).

distilling-step-by-step by google-research

Code for research paper on knowledge distillation

555

Cherry_LLM by tianyi-lab

Research paper for LLM instruction tuning via self-guided data selection

383

Research paper for LLM instruction tuning via data recycling

Starred by

Teknium(Cofounder of Nous Research) and

Jeremy Howard(Cofounder of fast.ai).

Reflection_Tuning by tianyi-lab

360

Starred by

David Cournapeau(Author of scikit-learn),

Jason Liu(Author of Instructor), and

19 more.

instructor by 567-labs

SDK for structured LLM outputs using Pydantic models

11k

Prompt engineering assistant for GenAI apps

Starred by

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"),

Elvis Saravia(Founder of DAIR.AI), and

1 more.

YiVal by YiVal

Starred by

Alexander Wettig(Author of SWE-bench, SWE-agent) and

John Yang(Author of SWE-bench, SWE-agent).

LLM-Shearing by princeton-nlp

Code for LLM pre-training acceleration via structured pruning (ICLR 2024)

629

Starred by

Zhiqiang Xie(Author of SGLang),

Joe Walnes(Head of Experimental Projects at Stripe), and

15 more.

letta by letta-ai

Agent framework for stateful agents with memory, reasoning, and context management

Starred by

Alex Yu(Research Scientist at OpenAI; Former Cofounder of Luma AI),

Elvis Saravia(Founder of DAIR.AI), and

5 more.

CogVLM by zai-org

VLM for image understanding and multi-turn dialogue

Starred by

Yaowei Zheng(Author of LLaMA-Factory),

Simon Willison(Author of Django), and

7 more.

ragas by explodinggradients

Toolkit for LLM application evaluation

Technique to improve instruction finetuning of LLMs

Starred by

Lewis Tunstall(Research Engineer at Hugging Face).

NEFTune by neelsjain

398

Starred by

Yaowei Zheng(Author of LLaMA-Factory).

FireAct by anchen1011

Language agent fine-tuning research paper

282

Starred by

Shizhe Diao(Research Scientist at NVIDIA; Author of LMFlow),

Zhiyuan Li(Cofounder of Nexa AI), and

14 more.

LLaVA by haotian-liu

Multimodal assistant with GPT-4 level capabilities

23k

Starred by

Eugene Yan(AI Scientist at AWS),

Philipp Schmid(DevRel at Google DeepMind), and

11 more.

alignment-handbook by huggingface

Handbook for aligning language models with human/AI preferences

Starred by

Tobi Lutke(Cofounder of Shopify),

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), and

4 more.

autolabel by refuel-ai

Python library to label text datasets using LLMs

Starred by

Carlos E. Jimenez(Author of SWE-bench, SWE-agent).

EmpatheticDialogues by facebookresearch

PyTorch code for empathetic dialogue research

503

created 6 years ago

updated 3 years ago

Starred by

Elvis Saravia(Founder of DAIR.AI) and

Jeff Hammerbacher(Cofounder of Cloudera).

world-models by wesg52

255

Research paper code for extracting spatial/temporal world models from LLMs

Framework for grounded instruction datasets and domain-expert LLMs

Starred by

Teknium(Cofounder of Nous Research) and

Omar Sanseviero(DevRel at Google DeepMind).

OpenGPT by CogStack

359

Starred by

Omar Sanseviero(DevRel at Google DeepMind),

Chaoyu Yang(Founder of Bento), and

5 more.

Medusa by FasterDecoding

Framework for accelerating LLM generation using multiple decoding heads

Starred by

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"),

Omar Sanseviero(DevRel at Google DeepMind), and

6 more.

open_flamingo by mlfoundations

Open-source framework for training large multimodal models

Synthetic data generator for LLM pretraining

Starred by

Omar Sanseviero(DevRel at Google DeepMind),

Philipp Schmid(DevRel at Google DeepMind), and

1 more.

textbook_quality by VikParuchuri

503

Starred by

Vincent Weisser(Cofounder of Prime Intellect),

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), and

9 more.

tree-of-thought-llm by princeton-nlp

Research paper implementation for Tree of Thoughts (ToT) prompting

Starred by

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"),

Shizhe Diao(Research Scientist at NVIDIA; Author of LMFlow), and

2 more.

LongLoRA by dvlab-research

LongLoRA: Efficient fine-tuning for long-context LLMs

Starred by

Jeff Hammerbacher(Cofounder of Cloudera).

kani by zhudotexe

Microframework for chat-based language models with tool use/function calling

588

Starred by

Jeff Hammerbacher(Cofounder of Cloudera).

DoLa by voidism

Decoding strategy research paper for improving factuality in LLMs

505

Tool for efficient large DNN model training on commodity hardware

Starred by

Vincent Weisser(Cofounder of Prime Intellect) and

Amanpreet Singh(Cofounder of Contextual AI).

varuna by microsoft

251

Inference optimization for batched LoRA adapters

Starred by

Jeremy Howard(Cofounder of fast.ai).

BLoRA by sabetAI

345

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

George Hotz(Author of tinygrad; Founder of the tiny corp, comma.ai), and

16 more.

TinyLlama by jzhang38

Tiny pretraining project for a 1.1B Llama model

Starred by

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"),

Jeff Hammerbacher(Cofounder of Cloudera), and

1 more.

sparsegpt by IST-DASLab

Code for massive language model one-shot pruning (ICML 2023 paper)

824

LLM-Pruner by horseee

LLM structural pruner for model compression

Starred by

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"),

Vincent Weisser(Cofounder of Prime Intellect), and

1 more.

graph-of-thoughts by spcl

Graph-of-Thoughts: LLM framework for complex problem-solving

Starred by

Yaowei Zheng(Author of LLaMA-Factory) and

Amanpreet Singh(Cofounder of Contextual AI).

tensor_parallel by BlackSamorez

PyTorch module for multi-GPU model parallelism

658

Starred by

Yaowei Zheng(Author of LLaMA-Factory).

relora by Guitaricet

PEFT pretraining code for ReLoRA research paper

461

Starred by

Lukas Biewald(Cofounder of Weights & Biases) and

Jerry Liu(Cofounder of LlamaIndex).

wandbot by wandb

Support bot for Weights & Biases' AI tools, running in Discord, Slack, ChatGPT, and Zendesk

304

Starred by

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"),

Junyang Lin(Core Maintainer of Alibaba Qwen), and

4 more.

LightLLM by ModelTC

Python framework for LLM inference and serving

Starred by

Michael Han(Cofounder of Unsloth),

Jesse Clark(Cofounder of Marqo), and

5 more.

lmdeploy by InternLM

Toolkit for LLM compression, deployment, and serving

Next.js app for Llama 3 chat UI development

llama-chat by replicate

841

Streamlit chatbot app for interacting with LLMs

Starred by

Mckay Wrigley(Founder of Takeoff AI) and

Charlie Holtz(Founder of Melty).

llama2-chatbot by a16z-infra

AI code interpreter for local data processing, like ChatGPT Code Interpreter

IncognitoPilot by silvanmelchior

445

Starred by

Tobi Lutke(Cofounder of Shopify),

Boris Cherny(Creator of Claude Code; MTS at Anthropic), and

9 more.

ai-town by a16z-infra

AI town starter kit for building a virtual world

Code LLM instruction tuning research paper

Starred by

Travis Fischer(Founder of Agentic),

Omar Sanseviero(DevRel at Google DeepMind), and

1 more.

octopack by bigcode-project

470

Starred by

Tobi Lutke(Cofounder of Shopify),

Clément Renault(Cofounder of Meilisearch), and

29 more.

outlines by dottxt-ai

SDK for structured LLM text generation

bubogpt by magic-research

Multi-modal LLM for joint text, vision, and audio understanding

512

Starred by

Elvis Saravia(Founder of DAIR.AI),

Didier Lopes(Founder of OpenBB), and

7 more.

MetaGPT by FoundationAgents

Multi-agent framework for collaborative AI software development

58k

Python library for reinforcement learning with human feedback (RLHF)

Starred by

Zhiyuan Li(Cofounder of Nexa AI),

Travis Fischer(Founder of Agentic), and

1 more.

pykoi-rlhf-finetuned-transformers by CambioML

410

ChainFury by NimbleBoxAI

Open-source chaining engine for production AI apps

448

Starred by

Tobi Lutke(Cofounder of Shopify),

Jason Knight(Director AI Compilers at NVIDIA; Cofounder of OctoML), and

19 more.

candle by huggingface

Minimalist ML framework for Rust, emphasizing performance and ease of use

Distributed trainer for LLMs

Starred by

Jeff Hammerbacher(Cofounder of Cloudera) and

Philipp Schmid(DevRel at Google DeepMind).

Megatron-LLM by epfLLM

578

Starred by

Ying Sheng(Author of SGLang),

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), and

6 more.

ToolBench by OpenBMB

Open platform for LLM tool learning (ICLR'24 spotlight)

Starred by

Lilian Weng(Cofounder of Thinking Machines Lab),

Anton Osika(Cofounder of Lovable), and

15 more.

gpt-engineer by AntonOsika

CLI platform for code generation experimentation

55k

RRHF for aligning LLMs to human preferences

Starred by

Philipp Schmid(DevRel at Google DeepMind) and

Yaowei Zheng(Author of LLaMA-Factory).

RRHF by GanjinZero

811

Starred by

Lysandre Debut(Chief Open-Source Officer at Hugging Face),

Calvin French-Owen(Cofounder of Segment), and

13 more.

LLaMA-Factory by hiyouga

Unified fine-tuning tool for 100+ LLMs & VLMs (ACL 2024)

56k

Llama implementation for memory-efficient quantized weights

Starred by

Tobi Lutke(Cofounder of Shopify),

Chaoyu Yang(Founder of Bento), and

5 more.

exllama by turboderp

PyTorch for optimizing data mixtures in language model datasets

Starred by

Shizhe Diao(Research Scientist at NVIDIA; Author of LMFlow).

doremi by sangmichaelxie

340

Starred by

Jeremy Howard(Cofounder of fast.ai),

Teknium(Cofounder of Nous Research), and

1 more.

UltraChat by thunlp

Multi-round dialogue dataset and models for chat language model training

Starred by

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"),

Andre Zayarni(Cofounder of Qdrant), and

4 more.

RealChar by Shaunwei

Real-time AI character/companion creation and interaction codebase

Starred by

Chenlin Meng(Cofounder of Pika),

Sebastián Ramírez(Author of FastAPI, Typer, SQLModel, Asyncer), and

11 more.

serve by jina-ai

Framework for building cloud-native multimodal AI apps

22k

updated 4 months ago

Starred by

Boris Cherny(Creator of Claude Code; MTS at Anthropic),

Nat Friedman(Former CEO of GitHub), and

27 more.

aider by Aider-AI

AI pair programming in your terminal

37k

Starred by

Tobi Lutke(Cofounder of Shopify),

Shizhe Diao(Research Scientist at NVIDIA; Author of LMFlow), and

9 more.

LMFlow by OptimalScale

Toolkit for finetuning and inference of large foundation models

Chat model trained via LoRA, using ChatGPT-generated dialogs

Starred by

Ying Sheng(Author of SGLang),

Bojan Tunguz(AI Scientist; Formerly at NVIDIA), and

3 more.

baize-chatbot by project-baize

Dataset for evaluating LLMs using external tools

ToolQA by night-chen

274

Starred by

Elie Bursztein(Cybersecurity Lead at Google DeepMind),

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), and

3 more.

SuperAGI by TransformerOptimus

Open-source framework for autonomous AI agent development

17k

Starred by

Yaowei Zheng(Author of LLaMA-Factory),

Jiayi Pan(Author of SWE-Gym; MTS at xAI), and

13 more.

audiocraft by facebookresearch

PyTorch library for audio processing and generation research

22k

Starred by

Tobi Lutke(Cofounder of Shopify),

Stas Bekman(Author of "Machine Learning Engineering Open Book"; Research Engineer at Snowflake), and

28 more.

guidance by guidance-ai

Guidance is a programming paradigm for steering LLMs

Starred by

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"),

Shizhe Diao(Research Scientist at NVIDIA; Author of LMFlow), and

12 more.

open_llama by openlm-research

Open-source reproduction of LLaMA models

Starred by

Vincent Weisser(Cofounder of Prime Intellect),

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), and

4 more.

RL4LMs by allenai

RL library to fine-tune language models to human preferences

Agent system for reasoning with LLMs via in-context reinforcement learning

SwiftSage by SwiftSage

311

Starred by

Tobi Lutke(Cofounder of Shopify),

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), and

8 more.

ctransformers by marella

Python bindings for fast Transformer model inference

Starred by

Chris Van Pelt(Cofounder of Weights & Biases),

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), and

20 more.

developer by smol-ai

Agent for embedding a developer in your app

Research paper implementation for memory-efficient LM fine-tuning

Starred by

Yaowei Zheng(Author of LLaMA-Factory).

MeZO by princeton-nlp

Starred by

James Luan(VP Engineering at Zilliz),

Junyang Lin(Core Maintainer of Alibaba Qwen), and

5 more.

ImageBind by facebookresearch

PyTorch implementation for multimodal embeddings research paper

Starred by

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems").

xtreme1 by xtreme1-io

Open-source platform for multimodal training data annotation

Starred by

Travis Fischer(Founder of Agentic).

sudolang-llm-support by paralleldrive

VS Code extension for LLM-based programming with SudoLang

poe-api by ading2210

Python API for Quora's Poe (unmaintained)

Starred by

Anil Dash(Former CEO of Glitch).

Local-LLM-Comparison-Colab-UI by Troyanovsky

Local LLM comparison via Colab WebUI links

Self-instruct tool for LLM finetuning

Starred by

Jeremy Howard(Cofounder of fast.ai),

Eugene Yan(AI Scientist at AWS), and

3 more.

airoboros by jondurbin

Starred by

Jeremy Howard(Cofounder of fast.ai),

Travis Fischer(Founder of Agentic), and

2 more.

PaLM by conceptofmind

Open-source PaLM implementation for language model research

821

Starred by

Jeff Hammerbacher(Cofounder of Cloudera),

Evan Hubinger(Head of Alignment Stress-Testing at Anthropic), and

1 more.

TruthfulQA by sylinrl

Benchmark dataset for evaluating truthfulness of language models

793

Starred by

Dan Guido(Cofounder of Trail of Bits),

Jerry Liu(Cofounder of LlamaIndex), and

11 more.

private-gpt by zylon-ai

Private AI API for local document interaction using LLMs

56k

Medical LLM for instruction-following in the medical domain

PMC-LLaMA by chaoyi-wu

660

OpenAI-compatible Python client for calling LLMs

Starred by

Jeff Hammerbacher(Cofounder of Cloudera),

Georgios Konstantopoulos(CTO, General Partner at Paradigm), and

2 more.

openlm by r2d4

372

Starred by

Nat Friedman(Former CEO of GitHub),

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), and

9 more.

FasterTransformer by NVIDIA

Optimized transformer library for inference

Starred by

John Yang(Author of SWE-bench, SWE-agent),

Junyang Lin(Core Maintainer of Alibaba Qwen), and

3 more.

unlimiformer by abertsch72

Research paper for long-range transformers with unlimited input

Starred by

Jeff Hammerbacher(Cofounder of Cloudera),

Stas Bekman(Author of "Machine Learning Engineering Open Book"; Research Engineer at Snowflake), and

16 more.

gpt-neox by EleutherAI

Framework for training large-scale autoregressive language models

Open-source implementation of Toolformer research paper

Starred by

Julien Chaumond(Cofounder of Hugging Face).

toolformer by conceptofmind

367

Starred by

Tobi Lutke(Cofounder of Shopify),

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), and

13 more.

bark by suno-ai

Generative audio model for realistic speech and sound effects

38k

Starred by

Yaowei Zheng(Author of LLaMA-Factory),

Eugene Yan(AI Scientist at AWS), and

4 more.

chat-langchain by langchain-ai

Chatbot for question answering over LangChain documentation

Small, efficient language models distilled from ChatGPT for research

Starred by

Simon Willison(Author of Django).

LaMini-LM by mbzuai-nlp

821

Starred by

Nat Friedman(Former CEO of GitHub),

Alex Yu(Research Scientist at OpenAI; Former Cofounder of Luma AI), and

4 more.

ChatRWKV by BlinkDL

Open-source chatbot powered by the RWKV RNN language model

Starred by

George Hotz(Author of tinygrad; Founder of the tiny corp, comma.ai),

Daniel Gross(Cofounder of Safe Superintelligence), and

23 more.

RWKV-LM by BlinkDL

RNN for LLM, transformer-level performance, parallelizable training

14k

Starred by

Tobi Lutke(Cofounder of Shopify),

Tim J. Baek(Founder of Open WebUI), and

11 more.

LocalAI by mudler

Open-source OpenAI alternative for local AI inference

35k

Starred by

Vincent Weisser(Cofounder of Prime Intellect),

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), and

15 more.

WizardLM by nlpxucan

LLMs built using Evol-Instruct for complex instruction following

Starred by

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems") and

Junyang Lin(Core Maintainer of Alibaba Qwen).

chameleon-llm by lupantech

Research paper code for plug-and-play compositional reasoning with LLMs

Starred by

Jeff Hammerbacher(Cofounder of Cloudera),

Simon Suo(Cofounder of LlamaIndex), and

1 more.

llama-lab by run-llama

LlamaIndex projects for LLM data augmentation

Starred by

Jeremy Howard(Cofounder of fast.ai).

EdgeGPT by acheong08

Reverse-engineered API for Microsoft Bing Chat (archived)

Research paper implementation for prompt compression via learned "gist" tokens

Starred by

Evan Hubinger(Head of Alignment Stress-Testing at Anthropic).

gisting by jayelm

290

API wrapper for local LLM inference, emulating OpenAI's GPT endpoints

Starred by

Teknium(Cofounder of Nous Research).

gpt-llama.cpp by keldenl

596

Transformer memory mass-editor (ICLR 2023 research paper)

Starred by

Bob van Luijt(Cofounder of Weaviate) and

Yaowei Zheng(Author of LLaMA-Factory).

memit by kmeng01

510

DL4MATH: Deep learning resources for mathematical reasoning

dl4math by lupantech

363

Starred by

Forrest Iandola(Research Scientist at Meta; Author of SqueezeNet),

Jesse Clark(Cofounder of Marqo), and

11 more.

MiniGPT-4 by Vision-CAIR

Vision-language model for multi-task learning

26k

Starred by

Elvis Saravia(Founder of DAIR.AI) and

Shizhe Diao(Research Scientist at NVIDIA; Author of LMFlow).

auto-cot by amazon-science

Research paper implementation for automatic chain-of-thought prompting

Starred by

Anton Osika(Cofounder of Lovable),

Jesse Clark(Cofounder of Marqo), and

12 more.

OpenChatKit by togethercomputer

Open-source toolkit for building specialized/general-purpose chat models

Python puzzle dataset for AI programming proficiency research

PythonProgrammingPuzzles by microsoft

984

Starred by

Nat Friedman(Former CEO of GitHub),

Alexey Milovidov(Cofounder of Clickhouse), and

7 more.

RedPajama-Data by togethercomputer

Dataset pipeline for training large language models

Starred by

Zhiyuan Li(Cofounder of Nexa AI),

Will Brown(Research Lead at Prime Intellect), and

10 more.

unstructured by Unstructured-IO

ETL solution for structuring unstructured data for language models

Starred by

Boris Cherny(Creator of Claude Code; MTS at Anthropic),

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n), and

29 more.

whisper by openai

Speech recognition model for multilingual transcription/translation

87k

LLM inference on Apple Silicon GPUs

Starred by

Jeff Hammerbacher(Cofounder of Cloudera).

LLaMA_MPS by jankais3r

588

Starred by

Matei Zaharia(Cofounder of Databricks),

Carol Willing(Core Contributor to CPython, Jupyter), and

11 more.

dolly by databrickslabs

Instruction-following LLM trained on the Databricks Machine Learning Platform

11k

Code for running and fine-tuning LLaMA models

Starred by

Teknium(Cofounder of Nous Research).

minimal-llama by zphang

459

Reasoning framework for LLMs, based on a NeurIPS 2022 paper

Starred by

Shizhe Diao(Research Scientist at NVIDIA; Author of LMFlow).

zero_shot_cot by kojima-takeshi188

426

Research paper implementations for sequence modeling with convolutions

Starred by

Jiaming Song(Chief Scientist at Luma AI),

Victor Taelin(Author of Bend, Kind, HVM), and

2 more.

safari by HazyResearch

895

LLM training/finetuning framework in JAX/Flax

Starred by

Jiayi Pan(Author of SWE-Gym; MTS at xAI),

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), and

7 more.

EasyLM by young-geng

Cleaned dataset for Alpaca LLM training

Starred by

Tobi Lutke(Cofounder of Shopify),

Omar Sanseviero(DevRel at Google DeepMind), and

5 more.

AlpacaDataCleaned by gururise

Starred by

Vincent Weisser(Cofounder of Prime Intellect),

Tim J. Baek(Founder of Open WebUI), and

23 more.

trl by huggingface

Library for transformer RL

Framework for chain-of-thought reasoning data and tools

Starred by

Vincent Weisser(Cofounder of Prime Intellect),

Elvis Saravia(Founder of DAIR.AI), and

1 more.

ThoughtSource by OpenBioLink

987

Starred by

Jeremy Howard(Cofounder of fast.ai),

Georgios Konstantopoulos(CTO, General Partner at Paradigm), and

5 more.

GPT-4-LLM by Instruction-Tuning-with-GPT-4

GPT-4 data for instruction-tuning LLMs via supervised/RL

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Georgios Konstantopoulos(CTO, General Partner at Paradigm), and

3 more.

lit-llama by Lightning-AI

LLaMA implementation for pretraining, finetuning, and inference

Starred by

Lilian Weng(Cofounder of Thinking Machines Lab),

Julien Chaumond(Cofounder of Hugging Face), and

37 more.

AutoGPT by Significant-Gravitas

AI agent platform for building, deploying, and running autonomous workflows

178k

Starred by

Jiaming Song(Chief Scientist at Luma AI),

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), and

4 more.

LLaMA-Adapter by OpenGVLab

Efficient fine-tuning for instruction-following LLaMA models

Python bindings for local LLM inference (deprecated)

Starred by

Eugene Yan(AI Scientist at AWS) and

Anastasios Angelopoulos(Cofounder of LMArena).

pygpt4all by nomic-ai

Open-source implementation for LLaMA-based ChatGPT, runnable on a single GPU

chatllama by henrywoo

Collection of libraries to optimize AI model performances

Starred by

Taranjeet Singh(Cofounder of Mem0),

Shizhe Diao(Research Scientist at NVIDIA; Author of LMFlow), and

5 more.

optimate by nebuly-ai

Starred by

Jeremy Howard(Cofounder of fast.ai),

Omar Sanseviero(DevRel at Google DeepMind), and

3 more.

GPTeacher by teknium1

GPT-4 generated datasets for instruction tuning

Collection of ChatGPT, GPT, and LLM resources

chatgpt-universe by cedrickchee

377

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Carol Willing(Core Contributor to CPython, Jupyter), and

54 more.

langchain by langchain-ai

Framework for building LLM-powered applications

114k

SDK for fine-tuning and customizing open-source LLMs

Starred by

Tobi Lutke(Cofounder of Shopify),

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), and

3 more.

xTuring by stochasticai

Starred by

Taranjeet Singh(Cofounder of Mem0),

Shawn Wang(Editor of Latent Space), and

3 more.

ai-pdf-chatbot-langchain by mayooear

AI chatbot agent for PDF document Q&A using LangChain & LangGraph

16k

Starred by

Aravind Srinivas(Cofounder of Perplexity),

David Cournapeau(Author of scikit-learn), and

6 more.

natbot by nat

Browser automation via GPT-3

Starred by

Vincent Weisser(Cofounder of Prime Intellect),

Elvis Saravia(Founder of DAIR.AI), and

4 more.

ReAct by ysymyth

GPT-3 prompting code for ReAct research paper

LoRA finetuning code for ChatGLM-6b

Starred by

Yaowei Zheng(Author of LLaMA-Factory).

ChatGLM-finetune-LoRA by lich99

720

Open academic research project improving LLaMA to SOTA LLM

Starred by

Thomas Wolf(Cofounder of Hugging Face),

Jesse Clark(Cofounder of Marqo), and

1 more.

Llama-X by AetherCortex

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Jiayi Pan(Author of SWE-Gym; MTS at xAI), and

25 more.

flash-attention by Dao-AILab

Fast, memory-efficient attention implementation

19k

Starred by

Anastasios Angelopoulos(Cofounder of LMArena),

Omar Sanseviero(DevRel at Google DeepMind), and

29 more.

FastChat by lm-sys

Open platform for training, serving, and evaluating LLM-based chatbots

39k

Starred by

Tobi Lutke(Cofounder of Shopify),

Clement Delangue(Cofounder of Hugging Face), and

25 more.

text-generation-inference by huggingface

Rust/Python/gRPC server for fast LLM text generation

Starred by

Elvis Saravia(Founder of DAIR.AI).

ChatDoctor by Kent0n-Li

Medical chat model fine-tuned on LLaMA for medical domain Q&A

Desktop app for local LLM inference, no GPU/API needed

Starred by

Carol Willing(Core Contributor to CPython, Jupyter),

Zhiyuan Li(Cofounder of Nexa AI), and

25 more.

gpt4all by nomic-ai

3.4%

76k

Starred by

Andreas Jansson(Cofounder of Replicate),

Max Howell(Author of Homebrew), and

1 more.

toolformer-pytorch by lucidrains

Pytorch implementation of Toolformer for language models using external tools

Starred by

Vincent Weisser(Cofounder of Prime Intellect),

Michael Han(Cofounder of Unsloth), and

19 more.

text-generation-webui by oobabooga

Web UI for LLM text generation

45k

Starred by

Yaowei Zheng(Author of LLaMA-Factory),

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), and

3 more.

gptq by IST-DASLab

Code for GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers

Starred by

Omar Sanseviero(DevRel at Google DeepMind),

Jeffrey Quesnelle(Cofounder of Nous Research), and

4 more.

PaLM-rlhf-pytorch by lucidrains

RLHF implementation on PaLM

Starred by

Nat Friedman(Former CEO of GitHub),

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), and

13 more.

trlx by CarperAI

Distributed RLHF for LLMs

Fine-tuning and inference tool for quantized LLaMA models

Starred by

Jeremy Howard(Cofounder of fast.ai).

alpaca_lora_4bit by johnsmith0031

535

Starred by

Nat Friedman(Former CEO of GitHub),

Jason Miller(Author of Preact), and

18 more.

chatgpt-retrieval-plugin by openai

Retrieval plugin for custom GPTs, function calling, or assistants APIs

Starred by

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"),

Georgios Konstantopoulos(CTO, General Partner at Paradigm), and

3 more.

GPTQ-for-LLaMa by qwopqwop200

4-bit quantization for LLaMA models using GPTQ

Starred by

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"),

Vincent Weisser(Cofounder of Prime Intellect), and

5 more.

dalai by cocktailpeanut

Local LLM inference via CLI tool and Node.js API

13k

Starred by

Junyang Lin(Core Maintainer of Alibaba Qwen),

Vincent Weisser(Cofounder of Prime Intellect), and

15 more.

alpaca-lora by tloen

LoRA fine-tuning for LLaMA

19k

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

John Yang(Author of SWE-bench, SWE-agent), and

20 more.

stanford_alpaca by tatsu-lab

Instruction-following LLaMA model training and data generation

30k

Starred by

Tobi Lutke(Cofounder of Shopify),

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), and

14 more.

ColossalAI by hpcaitech

AI system for large-scale parallel training

41k

Starred by

Kent Dodds(Cofounder of Remix),

Alejandro Matamala Ortiz(Cofounder of Runway), and

6 more.

agentic by transitive-bullshit

AI agent stdlib for LLM-based TypeScript tooling

Starred by

Travis Fischer(Founder of Agentic),

Solomon Hykes(Cofounder of Docker, Dagger), and

7 more.

dagger by dagger

Open-source runtime for composable workflows, ideal for AI agents

sdk-python by temporalio

Python SDK for Temporal, a distributed orchestration engine

714

Deprecated: Docker images for replicating the AWS Lambda environment locally

Starred by

Jared Palmer(Ex-VP AI at Vercel; Founder of Turborepo; Author of Formik, TSDX),

Travis Fischer(Founder of Agentic), and

4 more.

docker-lambda by lambci

created 9 years ago

Starred by

Boris Cherny(Creator of Claude Code; MTS at Anthropic),

Georgios Konstantopoulos(CTO, General Partner at Paradigm), and

16 more.

kong by Kong

Cloud-native API and AI gateway for microservice orchestration

42k

created 10 years ago

Starred by

Boris Cherny(Creator of Claude Code; MTS at Anthropic),

Vincent Weisser(Cofounder of Prime Intellect), and

21 more.

awesome-machine-learning by josephmisiti

Curated list of ML frameworks, libraries, and software

69k

created 11 years ago

Starred by

Shawn Wang(Editor of Latent Space),

Elvis Saravia(Founder of DAIR.AI), and

11 more.

hackathon-starter by sahat

Node.js boilerplate for web applications

35k

created 11 years ago