Wing Lian

Founder of Axolotl AI

Starred Projects (398)

HRM-Text by sapientinc

14.2%

Efficient text generation model pretraining framework

Starred by

Created 3 weeks ago

Updated 2 weeks ago

ECC by affaan-m

2.2%

213k

Enhance AI development with comprehensive Claude Code configurations

Starred by

Created 4 months ago

Updated 1 day ago

apex-quant by localai-org

3.0%

346

MoE-aware mixed-precision quantization for LLMs

Starred by

Created 2 months ago

Updated 2 weeks ago

no-mistakes by kunchenguid

66.3%

AI-powered Git validation for pristine PRs

Created 2 months ago

Updated 15 hours ago

gstack by garrytan

1.8%

109k

Specialized AI coding assistant framework

Starred by

+18

Created 3 months ago

Updated 1 day ago

claude-code-system-prompts by Piebald-AI

1.3%

11k

AI agentic development system prompt library

Starred by

Created 6 months ago

Updated 1 day ago

openevolve by algorithmicsuperintelligence

0.5%

Coding agent for scientific/algorithmic discovery, based on AlphaEvolve paper

Starred by

Created 1 year ago

Updated 2 months ago

OpenHarness by HKUDS

1.6%

14k

Lightweight harness for advanced AI agent development

Starred by

Created 2 months ago

Updated 1 week ago

oh-my-pi by can1357

8.6%

12k

AI coding agent toolkit for terminal-based development

Starred by

Created 5 months ago

Updated 12 hours ago

claude-code-guide by zebbern

1.2%

Claude Code CLI Guide

Starred by

Created 11 months ago

Updated 19 hours ago

claude-code-harness by Chachamaru127

2.7%

Autonomous development partner for disciplined software delivery

Created 6 months ago

Updated 16 hours ago

TileKernels by deepseek-ai

0.5%

Optimized GPU kernels for LLM operations

Starred by

Created 1 month ago

Updated 1 month ago

ml-intern by huggingface

1.1%

10k

AI engineer for autonomous ML research, training, and deployment

Starred by

Created 7 months ago

Updated 12 hours ago

code-review-graph by tirth8205

1.9%

18k

Codebase knowledge graph for AI assistants

Created 3 months ago

Updated 2 days ago

rtk by rtk-ai

2.6%

61k

CLI proxy for massive LLM token reduction

Starred by

Created 4 months ago

Updated 13 hours ago

sutando by sonichi

1.1%

347

Autonomous AI assistant for real-time interaction and self-improvement

Created 2 months ago

Updated 16 hours ago

autoagent by kevinrgu

0.3%

Autonomous agent harness engineering framework

Starred by

Created 2 months ago

Updated 2 months ago

mini-swe-agent by SWE-agent

3.0%

AI agent for solving GitHub issues and command-line tasks

Starred by

Created 11 months ago

Updated 23 hours ago

Adan by sail-sg

818

PyTorch implementation of Adan optimizer for faster deep model training

Starred by

Created 3 years ago

Updated 1 year ago

ASI-Evolve by GAIR-NLP

1.7%

727

Agentic framework for autonomous scientific discovery and optimization

Starred by

Created 2 months ago

Updated 1 month ago

turboquant_plus by TheTom

0.4%

LLM KV cache compression for efficient local inference

Starred by

Created 2 months ago

Updated 23 hours ago

ATLAS by itigges22

0.3%

Boosts frozen LLM performance for efficient, self-hosted AI

Starred by

Created 4 months ago

Updated 22 hours ago

agent-orchestrator by AgentWrapper

1.2%

Orchestrating parallel AI coding agents for autonomous software development

Created 3 months ago

Updated 3 days ago

autokernel by RightNow-AI

0.6%

Autonomous GPU kernel optimization for PyTorch

Starred by

Created 3 months ago

Updated 2 months ago

KernelAgent by meta-pytorch

0.9%

445

Autonomous GPU kernel generation and optimization via AI agents

Starred by

Created 11 months ago

Updated 6 days ago

cookbook by Liquid4All

0.6%

On-device AI models and SDK for edge applications

Starred by

Created 8 months ago

Updated 14 hours ago

simple-evals by openai

0.0%

Lightweight library for evaluating language models

Awesome-ML-SYS-Tutorial by zhaochenyang20

0.7%

ML SYS learning notes and code

Starred by

Created 1 year ago

Updated 3 days ago

ANE by maderix

0.4%

Direct neural network training on Apple Neural Engine

Starred by

Created 3 months ago

Updated 3 months ago

multi-agent-coding-system by Danau5tin

0.2%

AI coding system with orchestrator, explorer, and coder agents

Starred by

Created 9 months ago

Updated 7 months ago

CUDA-Agent by BytedTsinghua-SIA

1.4%

Agentic RL for high-performance CUDA kernel generation

Starred by

Created 4 months ago

Updated 3 months ago

OpenClaw-RL by Gen-Verse

0.5%

Personalize AI agents through conversational reinforcement learning

Starred by

Created 3 months ago

Updated 2 weeks ago

crush by charmbracelet

0.7%

25k

AI coding agent for your terminal

Starred by

Created 1 year ago

Updated 14 hours ago

slowrun by qlabs-eng

0.8%

482

LLM training benchmark prioritizing deep learning over speed

Starred by

Created 3 months ago

Updated 4 days ago

superpowers by obra

2.4%

224k

AI assistant superpowers via a comprehensive skills library

kvpress by NVIDIA

0.8%

LLM KV cache compression made easy

Starred by

Created 1 year ago

Updated 2 days ago

SkillRL by aiming-lab

1.2%

829

Recursive skill-augmented reinforcement learning for evolving LLM agents

Created 4 months ago

Updated 3 weeks ago

Open-AgentRL by Gen-Verse

0.9%

544

Reinforcement learning for LLM agents

Created 8 months ago

Updated 18 hours ago

discover by test-time-training

1.2%

585

Learning to discover at test time

Starred by

Created 4 months ago

Updated 2 weeks ago

mHC-manifold-constrained-hyper-connections by tokenbender

361

Research implementation of manifold-constrained hyper-connections for deep learning models

Created 5 months ago

Updated 3 months ago

IQuest-Coder-V1 by IQuestLab

0.1%

Code LLMs for autonomous software engineering

Created 5 months ago

Updated 3 months ago

OpenTinker by open-tinker

675

RL-as-a-Service infrastructure for foundation models

Starred by

Created 5 months ago

Updated 2 months ago

punica by punica-ai

LoRA serving system (research paper) for multi-tenant LLM inference

Starred by

Created 2 years ago

Updated 2 years ago

mLoRA by TUDB-Labs

378

Framework for efficient LoRA fine-tuning of multiple LLMs

Created 2 years ago

Updated 1 year ago

miles by radixark

1.5%

Enterprise RL for large-scale MoE models

Starred by

Created 8 months ago

Updated 12 hours ago

ROLL by alibaba

0.6%

RL library for large language models

Starred by

Created 1 year ago

Updated 18 hours ago

Kimi-Linear by MoonshotAI

0.1%

Efficient linear attention architecture accelerates long-context LLMs

Created 7 months ago

Updated 6 months ago

Fast-dLLM by NVlabs

0.7%

Diffusion LLM inference acceleration framework

Starred by

Created 1 year ago

Updated 1 week ago

auto-round by intel

0.8%

Quantization algorithm for LLMs and VLMs

Starred by

Created 2 years ago

Updated 12 hours ago

luminal by luminal-ai

0.0%

Deep learning library using composable compilers for high performance

Starred by

Created 2 years ago

Updated 1 day ago

MARS by AGI-Arena

0.1%

721

Optimization framework for training large models

Created 1 year ago

Updated 2 months ago

DeepResearch by Alibaba-NLP

0.5%

19k

Benchmark for LLMs in web traversal

Starred by

Created 1 year ago

Updated 3 months ago

gemlite by dropbox

0.6%

470

Triton kernels for efficient low-bit matrix multiplication

Starred by

Created 1 year ago

Updated 4 weeks ago

AgentGym-RL by WooooDyy

0.4%

773

Train LLM agents for long-horizon, multi-turn decision-making

Starred by

Created 9 months ago

Updated 3 months ago

LlamaGym by KhoomeiK

SDK for fine-tuning LLM agents with online reinforcement learning

Starred by

Created 2 years ago

Updated 2 years ago

flame by fla-org

391

Minimal, efficient framework for LLM training

Starred by

Created 1 year ago

Updated 1 month ago

Soft-Thinking by UCSB-AI

0.6%

338

Enhancing LLM reasoning via continuous concept spaces

Created 1 year ago

Updated 1 week ago

DFT by yongliang-wu

0.7%

576

Improving SFT generalization with reward rectification

Starred by

Created 10 months ago

Updated 5 months ago

dion by microsoft

0.2%

484

Orthonormal updates for faster distributed ML training

Created 1 year ago

Updated 4 days ago

mixture_of_recursions by raymin0223

0.2%

575

Adaptive LLM computation with dynamic recursion

Created 1 year ago

Updated 8 months ago

gem by axon-rl

0.2%

494

Agentic LLM training environment for interactive reinforcement learning

Starred by

Created 1 year ago

Updated 4 months ago

cc by kn1026

0.1%

710

Starred by

Created 10 months ago

Updated 10 months ago

HRM by sapientinc

0.1%

13k

Hierarchical reasoning for complex tasks

Starred by

Created 11 months ago

Updated 2 months ago

RL2 by ChenmienTan

0.1%

Reinforcement learning for large language models

Starred by

Created 1 year ago

Updated 3 weeks ago

matmulfreellm by ridgerchu

MatMul-free language models

Starred by

Created 2 years ago

Updated 6 months ago

applied-ai by meta-pytorch

323

Applied AI experiments and examples for PyTorch

Starred by

Created 3 years ago

Updated 9 months ago

COAT by NVlabs

265

FP8 training framework for memory efficiency

Created 1 year ago

Updated 10 months ago

SkyRL by NovaSky-AI

1.4%

RL training pipeline for multi-turn tool use LLMs, optimized for real-world tasks

scattermoe by shawntan

278

Triton-based Sparse Mixture-of-Experts for efficient deep learning

Starred by

Created 2 years ago

Updated 8 months ago

rStar by microsoft

0.1%

Research paper repo for math reasoning in small LLMs via deep thinking

Starred by

Created 1 year ago

Updated 9 months ago

Skills by NVIDIA-NeMo

0.6%

973

LLM skill-improvement pipelines for synthetic data generation, training, and evaluation

Starred by

Created 2 years ago

Updated 20 hours ago

Absolute-Zero-Reasoner by LeapLabTHU

0.1%

Self-play reasoning framework needing zero data

Starred by

Created 1 year ago

Updated 9 months ago

DeepSeekRL-Extended by brendanhogan

253

GRPO implementation for scaled RL research

Starred by

Created 1 year ago

Updated 9 months ago

open-webui by open-webui

0.6%

141k

Self-hosted AI platform for local LLM deployment

TTRL by PRIME-RL

0.3%

RL technique for unlabeled data, especially test data

Created 1 year ago

Updated 1 month ago

R2E-Gym by R2E-Gym

1.1%

290

Scaling open-weight SWE agents with procedural environments and hybrid verifiers

Starred by

Created 1 year ago

Updated 11 months ago

axolotl by axolotl-ai-cloud

0.2%

12k

CLI tool for streamlined post-training of AI models

agno by agno-agi

0.2%

41k

Lightweight library for building AI Agents with memory, knowledge, and reasoning

Starred by

Created 4 years ago

Updated 17 hours ago

github-mcp-server by github

0.5%

31k

MCP server for GitHub API automation and interaction

Starred by

Created 1 year ago

Updated 1 day ago

loong by camel-ai

0.2%

504

Synthetic data generation project using LLM agents

Created 1 year ago

Updated 4 weeks ago

SWE-Gym by SWE-Gym

0.3%

687

Environment for training software engineering agents

Starred by

Created 1 year ago

Updated 10 months ago

GamingAgent by lmgame-org

0.2%

937

SDK for LLM/VLM gaming agents, enabling model evaluation via games

Starred by

Created 1 year ago

Updated 6 months ago

LLaDA by ML-GSAI

0.2%

LLM research paper exploring masked diffusion language models

Starred by

Created 1 year ago

Updated 7 months ago

recurrent-pretraining by seal-rg

0.4%

894

Pretraining code for depth-recurrent language model research

Starred by

Created 1 year ago

Updated 5 months ago

TransArch by MuLabPKU

436

Post-training method converts GQA-based LLMs to MLA models

Created 1 year ago

Updated 3 weeks ago

MLGym by facebookresearch

601

Gym environment for ML research agents

Starred by

Created 1 year ago

Updated 10 months ago

native-sparse-attention-triton by XunhaoLai

279

Efficient sparse attention for LLMs

Created 1 year ago

Updated 1 year ago

coconut by facebookresearch

0.2%

Research paper implementation for LLM reasoning in latent space

Starred by

Created 1 year ago

Updated 1 day ago

native-sparse-attention-pytorch by lucidrains

798

Sparse attention implementation from Deepseek's research paper

Created 1 year ago

Updated 10 months ago

ReasonFlux by Gen-Verse

0.2%

538

LLM post-training algorithms for data selection, RL, and inference

Created 1 year ago

Updated 8 months ago

LIMO by GAIR-NLP

Reasoning model using less data

Starred by

Created 1 year ago

Updated 10 months ago

s1 by simplescaling

0.0%

Test-time scaling recipe for strong reasoning performance

Starred by

Created 1 year ago

Updated 11 months ago

reasoning-gym by open-thought

0.2%

Procedural dataset generator for reasoning models

Starred by

Created 1 year ago

Updated 1 month ago

curator by bespokelabsai

0.1%

Synthetic data curation tool for post-training and structured data extraction

Starred by

Created 1 year ago

Updated 1 day ago

RAGEN by mll-lab-nu

0.2%

Train LLM agents with reinforcement learning in interactive environments

Starred by

Created 1 year ago

Updated 1 month ago

SkyThought by NovaSky-AI

0.0%

Training recipes for Sky-T1 family of models

Starred by

Created 1 year ago

Updated 11 months ago

search-and-learn by huggingface

Recipes to scale inference-time compute of open models

Starred by

Created 1 year ago

Updated 2 weeks ago

buffer-of-thought-llm by YangLing0818

676

Research paper implementation for thought-augmented LLM reasoning

Created 2 years ago

Updated 11 months ago

HuatuoGPT-o1 by FreedomIntelligence

0.5%

Medical LLM for advanced reasoning

Created 1 year ago

Updated 1 year ago

LayerSkip by facebookresearch

372

Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding" research paper

Created 2 years ago

Updated 1 month ago

markitdown by microsoft

4.1%

151k

Python tool for converting files to Markdown for LLM text analysis

NeMo-Aligner by NVIDIA

851

Toolkit for efficient model alignment

Starred by

Created 2 years ago

Updated 8 months ago

agency-swarm by VRSEN

0.2%

Agentic framework built on OpenAI Assistants API for automating AI workflows

Starred by

Created 2 years ago

Updated 20 hours ago

instructlab by instructlab

CLI tool for LLM alignment tuning via synthetic data

Starred by

Created 2 years ago

Updated 2 months ago

flash-linear-attention by fla-org

0.4%

Efficient Torch/Triton implementations for linear attention models

Starred by

Created 2 years ago

Updated 1 day ago

TokenFormer by Haiyang-W

590

Research paper on a fully attention-based neural network with tokenized model parameters

Created 1 year ago

Updated 1 year ago

evaluation-guidebook by huggingface

0.1%

LLM evaluation guide for practitioners

Starred by

Created 1 year ago

Updated 6 months ago

dynasaur by adobe-research

359

LLM agent framework using dynamic action creation via Python code generation

Starred by

Created 1 year ago

Updated 1 year ago

Marco-o1 by AIDC-AI

0.1%

Open reasoning model for real-world problem solving

Created 1 year ago

Updated 3 months ago

SageAttention by thu-ml

0.2%

Attention kernel for plug-and-play inference acceleration

Starred by

Created 1 year ago

Updated 4 months ago

metaflow by Netflix

0.1%

10k

Framework for building and managing AI/ML systems

Muon by KellerJordan

0.4%

Optimizer for neural network hidden layers

Starred by

Created 1 year ago

Updated 2 weeks ago

MathBlackBox by trotsky1997

Research paper for mathematical reasoning via LLMs

Starred by

Created 2 years ago

Updated 1 year ago

BitNet by microsoft

0.2%

39k

Inference framework for 1-bit LLMs

Starred by

Created 1 year ago

Updated 3 months ago

Aria by rhymes-ai

Multimodal MoE model for video, document understanding, and dialog

Starred by

Created 1 year ago

Updated 1 year ago

Hands-On-Large-Language-Models by HandsOnLLM

0.6%

27k

Code examples for "Hands-On Large Language Models" book

Starred by

Created 1 year ago

Updated 1 month ago

modded-nanogpt by KellerJordan

0.7%

Language model training speedrun on 8x H100 GPUs

Starred by

Created 2 years ago

Updated 14 hours ago

ogx by ogx-ai

0.1%

Composable building blocks for Llama apps

Starred by

Created 1 year ago

Updated 1 day ago

Adam-mini by zyushun

458

PyTorch implementation of Adam-mini optimizer from a research paper

Starred by

Created 2 years ago

Updated 1 year ago

optillm by algorithmicsuperintelligence

0.3%

Optimizing inference proxy for LLMs

Starred by

Created 1 year ago

Updated 1 month ago

LLM-Blender by yuchenlin

983

LLM ensembling framework using pairwise ranking and generative fusion

Starred by

Created 3 years ago

Updated 1 year ago

EvolKit by arcee-ai

257

LLM instruction enhancement framework

Starred by

Created 1 year ago

Updated 1 year ago

LLMs-Planning by karthikv792

465

Benchmark for evaluating LLMs on planning tasks

Created 4 years ago

Updated 1 week ago

rStar by zhentingqi

0.1%

971

Research paper for improving small LLM reasoning via mutual reasoning

Starred by

Created 1 year ago

Updated 1 year ago

distributed-training-guide by LambdaLabsML

0.2%

616

PyTorch guide for distributed training of large language models

Starred by

Created 1 year ago

Updated 7 months ago

nyuntam by nyunAI

663

CLI tool for LLM compression via pruning, quantization, and distillation

Created 1 year ago

Updated 1 year ago

distillm by jongwooko

0.4%

265

Streamlined LLM distillation for efficient model training

Starred by

Created 2 years ago

Updated 1 year ago

MisguidedAttention by cpldcpu

476

LLM reasoning benchmark for evaluating responses to misleading prompts

Starred by

Created 2 years ago

Updated 10 months ago

Open-Reasoning-Tasks by NousResearch

0.2%

493

Reasoning tasks collection for LLMs

Starred by

Created 1 year ago

Updated 1 year ago

long-context-attention by feifeibear

672

Unified sequence parallel attention for long context LLM training/inference

Starred by

Created 2 years ago

Updated 3 weeks ago

DistillKit by arcee-ai

0.1%

959

Open-source toolkit for LLM distillation research

Starred by

Created 1 year ago

Updated 1 month ago

do-not-answer by Libr-AI

328

Dataset for evaluating LLM safety mechanisms

Starred by

Created 2 years ago

Updated 2 years ago

fms-fsdp by foundation-model-stack

286

Efficiently train foundation models with PyTorch

Starred by

Created 2 years ago

Updated 6 months ago

OLMo by allenai

0.3%

Open language model code for training, evaluation, and inference

Starred by

Created 3 years ago

Updated 6 months ago

BAdam by Ledzy

0.3%

289

Memory-efficient optimizer for large language model finetuning

Starred by

Created 2 years ago

Updated 1 year ago

snowflake-arctic by Snowflake-Labs

559

AI research project for efficient LLM training and inference

Starred by

Created 2 years ago

Updated 1 year ago

open-instruct by allenai

0.2%

Training codebase for instruction-following language models

mdistiller by megvii-research

901

PyTorch library for knowledge distillation research

Created 4 years ago

Updated 2 years ago

augmentoolkit by e-p-armstrong

0.1%

Data toolkit for custom LLM creation using open-source AI

Starred by

Created 2 years ago

Updated 1 month ago

awesome-synthetic-datasets by davanstrien

332

Curated list of synthetic text/vision datasets and generation tools

Created 2 years ago

Updated 5 months ago

calm by zeux

0.1%

642

Single-GPU inference engine for rapid LLM prototyping

Starred by

Created 2 years ago

Updated 1 year ago

MobileLLM by facebookresearch

0.1%

Sub-billion parameter LLM training code for on-device use

Starred by

Created 1 year ago

Updated 1 month ago

phoenix by Arize-ai

0.9%

10k

AI observability platform for experimentation, evaluation, and troubleshooting

Starred by

Created 3 years ago

Updated 14 hours ago

SPPO by uclaml

586

Self-Play Preference Optimization (SPPO) aligns language models via self-play

Starred by

Created 2 years ago

Updated 1 year ago

WildBench by allenai

0.4%

254

Benchmarking LLMs with challenging real-user tasks

Starred by

Created 2 years ago

Updated 1 year ago

AutoIF by QwenLM

332

Research paper for improving LLM instruction-following via self-play with execution feedback

Starred by

Created 2 years ago

Updated 1 year ago

refusal_direction by andyrdt

0.5%

403

Research paper code for analyzing refusal in language models

Starred by

Created 2 years ago

Updated 1 year ago

YaFSDP by yandex

0.1%

989

Sharded data parallelism framework for transformer-like neural networks

Starred by

Created 2 years ago

Updated 3 weeks ago

chat_templates by chujiezheng

718

Chat templates for HuggingFace LLMs

Starred by

Created 2 years ago

Updated 1 year ago

LESS by princeton-nlp

528

Data selection research paper for targeted instruction tuning

Starred by

Created 2 years ago

Updated 1 year ago

MixEval by JinjieNi

255

Dynamic LLM evaluation suite for accurate, cost-effective benchmarking

Starred by

Created 2 years ago

Updated 1 year ago

MoRA by kongds

362

Parameter-efficient fine-tuning via high-rank updating (MoRA)

Starred by

Created 2 years ago

Updated 1 year ago

SimPO by princeton-nlp

953

Preference optimization algorithm for LLMs (NeurIPS 2024 paper)

Starred by

Created 2 years ago

Updated 1 year ago

qodo-cover by qodo-ai

0.2%

CLI tool for AI-powered test generation and code coverage enhancement

Starred by

Created 2 years ago

Updated 2 months ago

mlx-bitnet by exo-explore

285

Efficient LLM inference on Apple Silicon

Starred by

Created 2 years ago

Updated 2 years ago

gemma-2B-10M by mustafaaljadery

933

Gemma 2B with 10M context length using Infini-attention

Starred by

Created 2 years ago

Updated 2 years ago

xtuner by InternLM

0.0%

LLM fine-tuning toolkit for research

Starred by

Created 2 years ago

Updated 16 hours ago

GLiNER by urchade

0.7%

NER model for identifying any entity type using bidirectional transformer

Starred by

Created 2 years ago

Updated 1 week ago

contriever by facebookresearch

778

Unsupervised dense information retrieval via contrastive learning

Starred by

Created 4 years ago

Updated 3 years ago

prometheus-eval by prometheus-eval

0.2%

LLM evaluation framework using open LLMs

Starred by

Created 2 years ago

Updated 1 year ago

needle-in-a-haystack by gkamradt

0.3%

LLM testing tool for evaluating in-context retrieval accuracy

Starred by

Created 2 years ago

Updated 4 days ago

selfcodealign by bigcode-project

322

Research paper for self-alignment in code generation

Starred by

Created 2 years ago

Updated 1 year ago

llm-datasets by mlabonne

0.3%

Curated datasets/tools for LLM post-training

Starred by

Created 2 years ago

Updated 1 month ago

rerope by bojone

394

Position embeddings research paper

Starred by

Created 2 years ago

Updated 2 years ago

LaVague by lavague-ai

0.1%

Web agent framework for automating web processes

Starred by

Created 2 years ago

Updated 1 year ago

ring-flash-attention by zhuzilin

0.1%

FlashAttention extension for ring attention

Starred by

Created 2 years ago

Updated 9 months ago

llamaduo by deep-diver

316

LLMOps pipeline to fine-tune small LLMs for service LLM outage prep

Starred by

Created 2 years ago

Updated 11 months ago

cohere-toolkit by cohere-ai

RAG toolkit for LLM application development and deployment

Starred by

Created 2 years ago

Updated 2 months ago

uptrain by uptrain-ai

0.1%

Open-source platform to evaluate and improve GenAI apps

Starred by

Created 3 years ago

Updated 1 year ago

BitBLAS by microsoft

0.1%

766

Library for mixed-precision matrix multiplications, targeting quantized LLM deployment

Created 2 years ago

Updated 10 months ago

arena-hard-auto by lmarena

0.2%

Automatic LLM benchmark for instruction-tuned models, correlating with human preference

Starred by

Created 2 years ago

Updated 11 months ago

ChunkLlama by HKUNLP

450

Training-free method for extending LLM context windows

Created 2 years ago

Updated 1 year ago

dstack by dstackai

0.2%

Open-source tool for simplifying GPU allocation and AI workload orchestration

Starred by

Created 4 years ago

Updated 20 hours ago

rho by microsoft

0.4%

468

LLM pretraining research paper using selective language modeling (SLM)

Starred by

Created 2 years ago

Updated 2 years ago

dify by langgenius

0.6%

145k

Open-source LLM app development platform

attorch by BobMcDear

0.2%

602

PyTorch nn module subset, implemented in Python using Triton

Starred by

Created 2 years ago

Updated 1 month ago

mixtral-offloading by dvmazur

Inference optimization for Mixtral-8x7B models

Starred by

Created 2 years ago

Updated 2 years ago

auto-code-rover by AutoCodeRoverSG

0.2%

Autonomous software engineer for program improvement

Starred by

Created 2 years ago

Updated 1 year ago

BitNet-Transformers by Beomi

315

HuggingFace Transformers implementation of BitNet scaling for LLMs

Created 2 years ago

Updated 2 years ago

EasyContext by jzhang38

760

Recipes for language model context length extrapolation to 1M tokens

Starred by

Created 2 years ago

Updated 1 year ago

pyreft by stanfordnlp

0.1%

Python library for representation finetuning (ReFT) of language models

Starred by

Created 2 years ago

Updated 3 months ago

hlb-gpt by tysam-code

357

Researcher's toolbench for GPT model exploration

Starred by

Created 3 years ago

Updated 1 year ago

aideml by WecoAI

0.7%

ML engineering agent for automated AI R&D, surpassing human experts

Starred by

Created 2 years ago

Updated 1 month ago

BitNet by kyegomez

PyTorch implementation of BitNet research paper

Starred by

Created 2 years ago

Updated 1 month ago

horovod by horovod

15k

Distributed training framework for TF, Keras, PyTorch, and MXNet

Starred by

+19

Created 8 years ago

Updated 6 months ago

dataverse by UpstageAI

564

ETL pipeline for LLM data processing

Starred by

Created 2 years ago

Updated 1 year ago

hqq by dropbox

0.2%

943

Model quantizer for fast, accurate post-training quantization, skipping calibration

Starred by

Created 2 years ago

Updated 3 months ago

Triton-Puzzles by gpu-mode

0.4%

Interactive puzzles for learning Triton

Starred by

Created 2 years ago

Updated 2 months ago

repeng by vgel

0.3%

731

Python library for representation engineering control vectors

Starred by

Created 2 years ago

Updated 8 months ago

cobra by OpenHelix-Team

296

Multimodal LLM research paper extending Mamba for efficient inference

Created 2 years ago

Updated 1 year ago

hackathon by mistralai-sf24

0.2%

445

Minimal code for running and finetuning a 7B transformer model

Starred by

Created 2 years ago

Updated 2 years ago

raft by rapidsai

0.3%

CUDA-accelerated primitives for ML/data mining algorithms

Starred by

Created 7 years ago

Updated 1 day ago

maestro by Doriandarko

0.1%

Framework for Claude Opus to orchestrate subagents

Starred by

Created 2 years ago

Updated 1 year ago

quiet-star by ezelikman

739

Research code for self-teaching language models

Starred by

Created 2 years ago

Updated 1 year ago

ml-engineering by stas00

0.1%

18k

Open book for LLM/VLM training engineers

chatbot-ui by mckaywrigley

33k

Open-source AI chat app

orpo by xfactlab

481

Preference optimization without a reference model

Starred by

Created 2 years ago

Updated 2 years ago

SWE-bench by SWE-bench

0.9%

Benchmark for evaluating LLMs on real-world GitHub issues

OpenHands by OpenHands

0.8%

76k

AI platform for software development agents

FastV by pkunlp-icler

580

Inference acceleration for large vision-language models (research paper)

Created 2 years ago

Updated 1 year ago

airllm by lyogavin

1.5%

20k

Inference optimization for LLMs on low-resource hardware

Starred by

Created 3 years ago

Updated 3 months ago

daytona by daytonaio

0.1%

72k

Infrastructure for running AI-generated code

Starred by

Created 2 years ago

Updated 12 hours ago

VisionLLaMA by Meituan-AutoML

392

Vision transformer research paper

Created 2 years ago

Updated 1 year ago

fsdp_qlora by AnswerDotAI

0.1%

Training script for LLMs using QLoRA + FSDP

Starred by

Created 2 years ago

Updated 1 year ago

h2o-llmstudio by h2oai

0.1%

LLM Studio: framework for LLM fine-tuning via GUI or CLI

Starred by

Created 3 years ago

Updated 6 days ago

ChatMusician by hf-lin

0.3%

310

LLM for music understanding and generation

Created 2 years ago

Updated 2 years ago

AnyGPT by OpenMOSS

882

Multimodal LLM research paper for any-to-any modality conversion

Starred by

Created 2 years ago

Updated 1 year ago

FlagEmbedding by FlagOpen

0.2%

12k

Toolkit for retrieval and RAG applications

Starred by

Created 2 years ago

Updated 1 month ago

self-rewarding-lm-pytorch by lucidrains

Training framework for self-rewarding language models

Starred by

Created 2 years ago

Updated 2 years ago

crewAI by crewAIInc

0.8%

53k

Framework for autonomous AI agent orchestration via role-playing and collaboration

resource-stream by gpu-mode

0.4%

CUDA resource collection for GPU programming

Starred by

Created 2 years ago

Updated 3 months ago

metal-flash-attention by philipturner

0.2%

605

Metal port of FlashAttention for Apple silicon

Starred by

Created 3 years ago

Updated 1 year ago

LLMs-from-scratch by rasbt

0.3%

97k

Educational resource for LLM construction in PyTorch

mlx-examples by ml-explore

0.5%

Examples using the MLX framework

Starred by

Created 2 years ago

Updated 2 months ago

ai-codereviewer by villesau

GitHub Action for AI-powered code review

Starred by

Created 3 years ago

Updated 1 year ago

deita by hkust-nlp

596

Data-efficient instruction tuning for LLM alignment (ICLR 2024)

Starred by

Created 2 years ago

Updated 1 year ago

AutoAWQ by casper-hansen

0.1%

AutoAWQ is a tool for 4-bit quantized LLM inference

Starred by

Created 2 years ago

Updated 1 year ago

ProxyAI by carlrobertoh

0.3%

JetBrains IDE copilot for coding assistance

Starred by

Created 3 years ago

Updated 2 weeks ago

EAGLE by SafeAILab

0.4%

Speculative decoding research paper for faster LLM inference

Starred by

Created 2 years ago

Updated 3 months ago

HALOs by ContextualAI

0.1%

906

Library for aligning LLMs using human-aware loss functions

Starred by

Created 2 years ago

Updated 8 months ago

mamba by state-spaces

0.2%

18k

Mamba SSM architecture for sequence modeling

modelz-llm by tensorchord

277

Inference server for open-source LLMs, offering an OpenAI-compatible API

Created 3 years ago

Updated 2 years ago

unsloth by unslothai

0.5%

66k

Finetuning tool for LLMs, targeting speed and memory efficiency

gpt-researcher by assafelovic

0.5%

28k

Autonomous agent for web/local research, generating cited reports

Starred by

Created 3 years ago

Updated 2 weeks ago

functionary by MeetKai

Chat language model for tool use and result interpretation

Starred by

Created 2 years ago

Updated 6 months ago

Logic-LLM by teacherpeterpan

0.3%

399

Logic-LM: Framework for improved logical reasoning via LLMs and symbolic solvers

Created 3 years ago

Updated 2 years ago

LLMSurvey by RUCAIBox

0.1%

12k

Survey paper for large language models

Starred by

Created 3 years ago

Updated 1 year ago

distilabel by argilla-io

0.3%

Framework for synthetic data and AI feedback pipelines

long-llms-learning by Strivin0311

274

Literature repository for long-context LLM methodologies

Starred by

Created 2 years ago

Updated 1 year ago

MergeLM by yule-BUAA

868

Codebase for merging language models via parameter averaging

Starred by

Created 2 years ago

Updated 2 years ago

Video-LLaVA by PKU-YuanGroup

Video-LLaVA: Multimodal model for video/image understanding via LLM

Starred by

Created 2 years ago

Updated 1 year ago

medAlpaca by kbressem

559

LLM finetuned for medical question answering

Starred by

Created 3 years ago

Updated 2 years ago

intel-extension-for-transformers by intel

Transformer toolkit for GenAI/LLM acceleration on Intel platforms

Starred by

Created 3 years ago

Updated 1 year ago

representation-engineering by andyzoujm

AI transparency via representation engineering

Starred by

Created 2 years ago

Updated 1 year ago

multimodal by facebookresearch

0.1%

PyTorch library for multimodal multi-task model training

Starred by

Created 4 years ago

Updated 4 days ago

S-LoRA by S-LoRA

System for scalable LoRA adapter serving

Starred by

Created 2 years ago

Updated 2 years ago

DeepSpeed by deepspeedai

0.1%

42k

Deep learning optimization library for distributed training and inference

continue by continuedev

0.3%

34k

IDE extension for custom AI code assistants

llama-cookbook by meta-llama

0.0%

18k

Guide for building with Llama models

finetuner by jina-ai

Cloud tool for task-oriented embedding finetuning of models like BERT and CLIP

Starred by

Created 4 years ago

Updated 2 years ago

ludwig by ludwig-ai

0.0%

12k

Low-code framework for custom AI models (LLMs, neural networks)

img2dataset by rom1504

CLI tool for creating large image datasets from URLs

distilling-step-by-step by google-research

0.3%

594

Code for research paper on knowledge distillation

Starred by

Created 3 years ago

Updated 2 years ago

Cherry_LLM by tianyi-lab

415

Research paper for LLM instruction tuning via self-guided data selection

Created 2 years ago

Updated 11 months ago

Reflection_Tuning by tianyi-lab

366

Research paper for LLM instruction tuning via data recycling

Starred by

Created 2 years ago

Updated 1 year ago

auto-j by GAIR-NLP

250

Generative judge for evaluating LLM alignment

Created 2 years ago

Updated 2 years ago

instructor by 567-labs

0.2%

13k

SDK for structured LLM outputs using Pydantic models

YiVal by YiVal

Prompt engineering assistant for GenAI apps

Starred by

Created 2 years ago

Updated 2 years ago

LLM-Shearing by princeton-nlp

643

Code for LLM pre-training acceleration via structured pruning (ICLR 2024)

Starred by

Created 2 years ago

Updated 2 years ago

letta by letta-ai

0.3%

23k

Agent framework for stateful agents with memory, reasoning, and context management

CogVLM by zai-org

0.0%

VLM for image understanding and multi-turn dialogue

Starred by

Created 2 years ago

Updated 2 years ago

ragas by vibrantlabsai

0.7%

14k

Toolkit for LLM application evaluation

NEFTune by neelsjain

412

Technique to improve instruction finetuning of LLMs

Starred by

Created 2 years ago

Updated 2 years ago

FireAct by anchen1011

294

Language agent fine-tuning research paper

Starred by

Created 2 years ago

Updated 2 years ago

LLaVA by haotian-liu

0.1%

25k

Multimodal assistant with GPT-4 level capabilities

alignment-handbook by huggingface

0.1%

Handbook for aligning language models with human/AI preferences

autolabel by refuel-ai

0.1%

Python library to label text datasets using LLMs

Starred by

Created 3 years ago

Updated 1 year ago

EmpatheticDialogues by facebookresearch

553

PyTorch code for empathetic dialogue research

Starred by

Created 7 years ago

Updated 4 years ago

world-models by wesg52

261

Research paper code for extracting spatial/temporal world models from LLMs

Starred by

Created 2 years ago

Updated 2 years ago

OpenGPT by CogStack

0.3%

366

Framework for grounded instruction datasets and domain-expert LLMs

Starred by

Created 3 years ago

Updated 3 years ago

Medusa by FasterDecoding

0.1%

Framework for accelerating LLM generation using multiple decoding heads

Starred by

Created 2 years ago

Updated 1 year ago

open_flamingo by mlfoundations

0.1%

Open-source framework for training large multimodal models

Starred by

Created 3 years ago

Updated 1 year ago

textbook_quality by VikParuchuri

508

Synthetic data generator for LLM pretraining

Starred by

Created 2 years ago

Updated 2 years ago

tree-of-thought-llm by princeton-nlp

0.1%

Research paper implementation for Tree of Thoughts (ToT) prompting

Starred by

Created 3 years ago

Updated 1 year ago

LongLoRA by JIA-Lab-research

LongLoRA: Efficient fine-tuning for long-context LLMs

Starred by

Created 2 years ago

Updated 1 year ago

kani by zhudotexe

603

Microframework for chat-based language models with tool use/function calling

Starred by

Created 2 years ago

Updated 2 days ago

DoLa by voidism

554

Decoding strategy research paper for improving factuality in LLMs

Starred by

Created 2 years ago

Updated 1 year ago

varuna by microsoft

251

Tool for efficient large DNN model training on commodity hardware

Starred by

Created 5 years ago

Updated 1 year ago

BLoRA by sabetAI

350

Inference optimization for batched LoRA adapters

Starred by

Created 2 years ago

Updated 2 years ago

TinyLlama by jzhang38

0.1%

Tiny pretraining project for a 1.1B Llama model

sparsegpt by IST-DASLab

884

Code for massive language model one-shot pruning (ICML 2023 paper)

Starred by

Created 3 years ago

Updated 1 year ago

LLM-Pruner by horseee

LLM structural pruner for model compression

Created 3 years ago

Updated 1 year ago

graph-of-thoughts by spcl

0.1%

Graph-of-Thoughts: LLM framework for complex problem-solving

Starred by

Created 2 years ago

Updated 2 months ago

tensor_parallel by BlackSamorez

655

PyTorch module for multi-GPU model parallelism

Starred by

Created 3 years ago

Updated 2 years ago

relora by Guitaricet

473

PEFT pretraining code for ReLoRA research paper

Starred by

Created 3 years ago

Updated 2 years ago

wandbot by wandb

310

Support bot for Weights & Biases' AI tools, running in Discord, Slack, ChatGPT, and Zendesk

Starred by

Created 3 years ago

Updated 3 weeks ago

LightLLM by ModelTC

0.2%

Python framework for LLM inference and serving

Starred by

Created 2 years ago

Updated 17 hours ago

lmdeploy by InternLM

0.2%

Toolkit for LLM compression, deployment, and serving

Starred by

Created 3 years ago

Updated 1 day ago

llama-chat by replicate

836

Next.js app for Llama 3 chat UI development

Created 2 years ago

Updated 5 months ago

llama2-chatbot by a16z-infra

Streamlit chatbot app for interacting with LLMs

Starred by

Created 2 years ago

Updated 2 years ago

IncognitoPilot by silvanmelchior

437

AI code interpreter for local data processing, like ChatGPT Code Interpreter

Created 2 years ago

Updated 2 years ago

ai-town by a16z-infra

0.3%

10k

AI town starter kit for building a virtual world

octopack by bigcode-project

479

Code LLM instruction tuning research paper

Starred by

Created 3 years ago

Updated 1 year ago

outlines by dottxt-ai

0.1%

14k

SDK for structured LLM text generation

bubogpt by magic-research

510

Multi-modal LLM for joint text, vision, and audio understanding

Created 2 years ago

Updated 2 years ago

MetaGPT by FoundationAgents

0.3%

69k

Multi-agent framework for collaborative AI software development

pykoi by CambioML

411

Python library for reinforcement learning with human feedback (RLHF)

Starred by

Created 2 years ago

Updated 8 months ago

ChainFury by NimbleBoxAI

449

Open-source chaining engine for production AI apps

Starred by

Created 3 years ago

Updated 2 years ago

candle by huggingface

0.2%

20k

Minimalist ML framework for Rust, emphasizing performance and ease of use

Megatron-LLM by epfLLM

589

Distributed trainer for LLMs

Starred by

Created 2 years ago

Updated 2 years ago

ToolBench by OpenBMB

0.0%

Open platform for LLM tool learning (ICLR'24 spotlight)

Starred by

Created 3 years ago

Updated 1 year ago

gpt-engineer by AntonOsika

0.0%

55k

CLI platform for code generation experimentation

RRHF by GanjinZero

806

RRHF for aligning LLMs to human preferences

Starred by

Created 3 years ago

Updated 2 years ago

LlamaFactory by hiyouga

0.2%

72k

Unified fine-tuning tool for 100+ LLMs & VLMs (ACL 2024)

exllama by turboderp

Llama implementation for memory-efficient quantized weights

Starred by

Created 3 years ago

Updated 2 years ago

doremi by sangmichaelxie

0.6%

356

PyTorch for optimizing data mixtures in language model datasets

Starred by

Created 3 years ago

Updated 2 years ago

UltraChat by thunlp

0.1%

Multi-round dialogue dataset and models for chat language model training

Starred by

Created 3 years ago

Updated 2 years ago

RealChar by Shaunwei

0.0%

Real-time AI character/companion creation and interaction codebase

Starred by

Created 3 years ago

Updated 4 months ago

serve by jina-ai

0.0%

22k

Framework for building cloud-native multimodal AI apps

aider by Aider-AI

0.5%

46k

AI pair programming in your terminal

LMFlow by OptimalScale

0.0%

Toolkit for finetuning and inference of large foundation models

Starred by

Created 3 years ago

Updated 3 weeks ago

baize-chatbot by project-baize

Chat model trained via LoRA, using ChatGPT-generated dialogs

Starred by

Created 3 years ago

Updated 2 years ago

ToolQA by night-chen

287

Dataset for evaluating LLMs using external tools

Created 3 years ago

Updated 2 years ago

SuperAGI by TransformerOptimus

0.1%

18k

Open-source framework for autonomous AI agent development

Starred by

Created 3 years ago

Updated 1 year ago

concept-erasure by EleutherAI

254

Concept erasure for neural representations

Starred by

Created 3 years ago

Updated 1 year ago

audiocraft by facebookresearch

0.1%

23k

PyTorch library for audio processing and generation research

guidance by guidance-ai

0.1%

21k

Guidance is a programming paradigm for steering LLMs

open_llama by openlm-research

0.0%

Open-source reproduction of LLaMA models

RL4LMs by allenai

0.0%

RL library to fine-tune language models to human preferences

Starred by

Created 3 years ago

Updated 2 years ago

SwiftSage by SwiftSage

327

Agent system for reasoning with LLMs via in-context reinforcement learning

Created 3 years ago

Updated 1 year ago

ctransformers by marella

Python bindings for fast Transformer model inference

Starred by

Created 3 years ago

Updated 2 years ago

developer by smol-ai

0.0%

12k

Agent for embedding a developer in your app

MeZO by princeton-nlp

Research paper implementation for memory-efficient LM fine-tuning

Starred by

Created 3 years ago

Updated 2 years ago

ImageBind by facebookresearch

0.0%

PyTorch implementation for multimodal embeddings research paper

Starred by

Created 3 years ago

Updated 6 months ago

xtreme1 by xtreme1-io

0.2%

Open-source platform for multimodal training data annotation

Starred by

Created 3 years ago

Updated 1 month ago

sudolang by paralleldrive

0.1%

VS Code extension for LLM-based programming with SudoLang

Starred by

Created 3 years ago

Updated 4 months ago

poe-api by ading2210

0.0%

Python API for Quora's Poe (unmaintained)

Created 3 years ago

Updated 2 years ago

Local-LLM-Comparison-Colab-UI by Troyanovsky

Local LLM comparison via Colab WebUI links

Starred by

Created 3 years ago

Updated 5 months ago

airoboros by jondurbin

Self-instruct tool for LLM finetuning

Starred by

Created 3 years ago

Updated 2 years ago

PaLM by conceptofmind

820

Open-source PaLM implementation for language model research

Starred by

Created 3 years ago

Updated 2 years ago

TruthfulQA by sylinrl

925

Benchmark dataset for evaluating truthfulness of language models

Starred by

Created 4 years ago

Updated 1 year ago

private-gpt by zylon-ai

0.1%

57k

Private AI API for local document interaction using LLMs

PMC-LLaMA by chaoyi-wu

0.3%

678

Medical LLM for instruction-following in the medical domain

Created 3 years ago

Updated 1 year ago

openlm by r2d4

369

OpenAI-compatible Python client for calling LLMs

Starred by

Created 3 years ago

Updated 3 years ago

FasterTransformer by NVIDIA

0.1%

Optimized transformer library for inference

unlimiformer by abertsch72

Research paper for long-range transformers with unlimited input

Starred by

Created 3 years ago

Updated 2 years ago

gpt-neox by EleutherAI

0.1%

Framework for training large-scale autoregressive language models

toolformer by conceptofmind

383

Open-source implementation of Toolformer research paper

Starred by

Created 3 years ago

Updated 3 years ago

bark by suno-ai

0.0%

39k

Generative audio model for realistic speech and sound effects

chat-langchain by langchain-ai

0.1%

Chatbot for question answering over LangChain documentation

Starred by

Created 3 years ago

Updated 2 days ago

LaMini-LM by mbzuai-nlp

822

Small, efficient language models distilled from ChatGPT for research

Starred by

Created 3 years ago

Updated 3 years ago

ChatRWKV by BlinkDL

0.0%

Open-source chatbot powered by the RWKV RNN language model

Starred by

Created 3 years ago

Updated 2 weeks ago

RWKV-LM by BlinkDL

0.1%

15k

RNN for LLM, transformer-level performance, parallelizable training

LocalAI by mudler

0.3%

47k

Open-source OpenAI alternative for local AI inference

WizardLM by nlpxucan

0.0%

LLMs built using Evol-Instruct for complex instruction following

chameleon-llm by lupantech

Research paper code for plug-and-play compositional reasoning with LLMs

Starred by

Created 3 years ago

Updated 2 years ago

llama-lab by run-llama

LlamaIndex projects for LLM data augmentation

Starred by

Created 3 years ago

Updated 2 years ago

EdgeGPT by acheong08

Reverse-engineered API for Microsoft Bing Chat (archived)

Starred by

Created 3 years ago

Updated 2 years ago

gisting by jayelm

0.3%

317

Research paper implementation for prompt compression via learned "gist" tokens

Starred by

Created 3 years ago

Updated 1 year ago

gpt-llama.cpp by keldenl

594

API wrapper for local LLM inference, emulating OpenAI's GPT endpoints

Starred by

Created 3 years ago

Updated 3 years ago

memit by kmeng01

549

Transformer memory mass-editor (ICLR 2023 research paper)

Starred by

Created 3 years ago

Updated 2 years ago

dl4math by lupantech

372

DL4MATH: Deep learning resources for mathematical reasoning

Created 3 years ago

Updated 2 years ago

MiniGPT-4 by Vision-CAIR

0.0%

26k

Vision-language model for multi-task learning

auto-cot by amazon-science

0.1%

Research paper implementation for automatic chain-of-thought prompting

Starred by

Created 3 years ago

Updated 2 years ago

OpenChatKit by togethercomputer

0.0%

Open-source toolkit for building specialized/general-purpose chat models

PythonProgrammingPuzzles by microsoft

998

Python puzzle dataset for AI programming proficiency research

Created 5 years ago

Updated 2 years ago

RedPajama-Data by togethercomputer

0.0%

Dataset pipeline for training large language models

Starred by

Created 3 years ago

Updated 1 week ago

unstructured by Unstructured-IO

0.4%

15k

ETL solution for structuring unstructured data for language models

whisper by openai

0.9%

102k

Speech recognition model for multilingual transcription/translation

LLaMA_MPS by jankais3r

584

LLM inference on Apple Silicon GPUs

Starred by

Created 3 years ago

Updated 3 years ago

dolly by databrickslabs

0.0%

11k

Instruction-following LLM trained on the Databricks Machine Learning Platform

minimal-llama by zphang

456

Code for running and fine-tuning LLaMA models

Starred by

Created 3 years ago

Updated 2 years ago

zero_shot_cot by kojima-takeshi188

441

Reasoning framework for LLMs, based on a NeurIPS 2022 paper

Starred by

Created 4 years ago

Updated 2 years ago

safari by HazyResearch

915

Research paper implementations for sequence modeling with convolutions

Starred by

Created 3 years ago

Updated 2 years ago

EasyLM by young-geng

LLM training/finetuning framework in JAX/Flax

Starred by

Created 3 years ago

Updated 1 year ago

AlpacaDataCleaned by gururise

Cleaned dataset for Alpaca LLM training

Starred by

Created 3 years ago

Updated 3 months ago

trl by huggingface

0.3%

19k

Library for transformer RL

ThoughtSource by OpenBioLink

0.1%

Framework for chain-of-thought reasoning data and tools

Starred by

Created 4 years ago

Updated 1 year ago

GPT-4-LLM by Instruction-Tuning-with-GPT-4

0.1%

GPT-4 data for instruction-tuning LLMs via supervised/RL

Starred by

Created 3 years ago

Updated 3 years ago

lit-llama by Lightning-AI

0.0%

LLaMA implementation for pretraining, finetuning, and inference

Starred by

Created 3 years ago

Updated 11 months ago

AutoGPT by Significant-Gravitas

0.1%

185k

AI agent platform for building, deploying, and running autonomous workflows

LLaMA-Adapter by OpenGVLab

0.0%

Efficient fine-tuning for instruction-following LLaMA models

Starred by

Created 3 years ago

Updated 2 years ago

pygpt4all by nomic-ai

Python bindings for local LLM inference (deprecated)

Starred by

Created 3 years ago

Updated 3 years ago

chatllama by henrywoo

Open-source implementation for LLaMA-based ChatGPT, runnable on a single GPU

Created 3 years ago

Updated 1 year ago

optimate by nebuly-ai

0.0%

Collection of libraries to optimize AI model performances

Starred by

Created 4 years ago

Updated 1 year ago

GPTeacher by teknium1

0.1%

GPT-4 generated datasets for instruction tuning

Starred by

Created 3 years ago

Updated 2 years ago

chatgpt-universe by cedrickchee

373

Collection of ChatGPT, GPT, and LLM resources

Created 3 years ago

Updated 1 year ago

langchain by langchain-ai

0.3%

139k

Framework for building LLM-powered applications

xTuring by stochasticai

0.0%

SDK for fine-tuning and customizing open-source LLMs

Starred by

Created 3 years ago

Updated 3 months ago

ai-pdf-chatbot-langchain by mayooear

0.1%

17k

AI chatbot agent for PDF document Q&A using LangChain & LangGraph

Starred by

Created 3 years ago

Updated 2 months ago

natbot by nat

Browser automation via GPT-3

Starred by

Created 3 years ago

Updated 2 years ago

ReAct by ysymyth

0.5%

GPT-3 prompting code for ReAct research paper

Starred by

Created 3 years ago

Updated 2 years ago

ChatGLM-finetune-LoRA by lich99

716

LoRA finetuning code for ChatGLM-6b

Starred by

Created 3 years ago

Updated 2 years ago

Llama-X by AetherCortex

Open academic research project improving LLaMA to SOTA LLM

Starred by

Created 3 years ago

Updated 2 years ago

flash-attention by Dao-AILab

0.2%

24k

Fast, memory-efficient attention implementation

FastChat by lm-sys

0.0%

39k

Open platform for training, serving, and evaluating LLM-based chatbots

text-generation-inference by huggingface

0.0%

11k

Rust/Python/gRPC server for fast LLM text generation

ChatDoctor by Kent0n-Li

0.0%

Medical chat model fine-tuned on LLaMA for medical domain Q&A

Starred by

Created 3 years ago

Updated 2 years ago

gpt4all by nomic-ai

0.0%

77k

Desktop app for local LLM inference, no GPU/API needed

toolformer-pytorch by lucidrains

0.1%

Pytorch implementation of Toolformer for language models using external tools

Starred by

Created 3 years ago

Updated 1 year ago

textgen by oobabooga

0.1%

47k

Web UI for LLM text generation

gptq by IST-DASLab

0.1%

Code for GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers

Starred by

Created 3 years ago

Updated 2 years ago

PaLM-rlhf-pytorch by lucidrains

0.0%

RLHF implementation on PaLM

Starred by

Created 3 years ago

Updated 2 weeks ago

trlx by CarperAI

0.0%

Distributed RLHF for LLMs

alpaca_lora_4bit by johnsmith0031

535

Fine-tuning and inference tool for quantized LLaMA models

Starred by

Created 3 years ago

Updated 2 years ago

chatgpt-retrieval-plugin by openai

21k

Retrieval plugin for custom GPTs, function calling, or assistants APIs

GPTQ-for-LLaMa by qwopqwop200

0.0%

4-bit quantization for LLaMA models using GPTQ

Starred by

Created 3 years ago

Updated 1 year ago

dalai by cocktailpeanut

0.0%

13k

Local LLM inference via CLI tool and Node.js API

Starred by

Created 3 years ago

Updated 2 years ago

alpaca-lora by tloen

0.0%

19k

LoRA fine-tuning for LLaMA

stanford_alpaca by tatsu-lab

0.0%

30k

Instruction-following LLaMA model training and data generation

ColossalAI by hpcaitech

0.0%

41k

AI system for large-scale parallel training

agentic by transitive-bullshit

0.0%

18k

AI agent stdlib for LLM-based TypeScript tooling

Starred by

Created 3 years ago

Updated 4 months ago

dagger by dagger

0.1%

16k

Open-source runtime for composable workflows, ideal for AI agents

Starred by

Created 6 years ago

Updated 15 hours ago

sdk-python by temporalio

0.4%

Python SDK for Temporal, a distributed orchestration engine

Starred by

Created 4 years ago

Updated 21 hours ago

docker-lambda by lambci

Deprecated: Docker images for replicating the AWS Lambda environment locally

Starred by

Created 10 years ago

Updated 3 years ago

kong by Kong

0.1%

44k

Cloud-native API and AI gateway for microservice orchestration

awesome-machine-learning by josephmisiti

0.1%

73k

Curated list of ML frameworks, libraries, and software

hackathon-starter by sahat

0.0%

35k

Node.js boilerplate for web applications

Feedback? Help us improve.