Wing Lian

Founder of Axolotl AI

Starred Projects (394)

apex-quant by mudler

4.4%

282

MoE-aware mixed-precision quantization for LLMs

Created 1 month ago

Updated 1 week ago

no-mistakes by kunchenguid

36.0%

571

AI-powered Git validation for pristine PRs

Created 1 month ago

Updated 1 day ago

gstack by garrytan

4.8%

94k

Specialized AI coding assistant framework

Starred by

+16

Created 2 months ago

Updated 21 hours ago

claude-code-system-prompts by Piebald-AI

2.0%

10k

AI agentic development system prompt library

Starred by

Created 5 months ago

Updated 1 day ago

openevolve by algorithmicsuperintelligence

1.4%

Coding agent for scientific/algorithmic discovery, based on AlphaEvolve paper

Starred by

Created 1 year ago

Updated 1 month ago

OpenHarness by HKUDS

3.5%

12k

Lightweight harness for advanced AI agent development

Starred by

Created 1 month ago

Updated 2 days ago

oh-my-pi by can1357

8.4%

AI coding agent toolkit for terminal-based development

Starred by

Created 4 months ago

Updated 19 hours ago

claude-code-guide by zebbern

0.8%

Claude Code CLI Guide

Starred by

Created 10 months ago

Updated 1 day ago

claude-code-harness by Chachamaru127

11.9%

839

Autonomous development partner for disciplined software delivery

Created 5 months ago

Updated 22 hours ago

TileKernels by deepseek-ai

3.7%

Optimized GPU kernels for LLM operations

Starred by

Created 2 weeks ago

Updated 2 weeks ago

ml-intern by huggingface

8.1%

AI engineer for autonomous ML research, training, and deployment

Starred by

Created 6 months ago

Updated 18 hours ago

code-review-graph by tirth8205

4.8%

16k

Codebase knowledge graph for AI assistants

Created 2 months ago

Updated 4 days ago

rtk by rtk-ai

8.8%

46k

CLI proxy for massive LLM token reduction

Starred by

Created 3 months ago

Updated 1 day ago

autoagent by kevinrgu

0.7%

Autonomous agent harness engineering framework

Starred by

Created 1 month ago

Updated 1 month ago

mini-swe-agent by SWE-agent

3.0%

AI agent for solving GitHub issues and command-line tasks

Starred by

Created 10 months ago

Updated 5 days ago

Adan by sail-sg

816

PyTorch implementation of Adan optimizer for faster deep model training

Starred by

Created 3 years ago

Updated 11 months ago

ASI-Evolve by GAIR-NLP

3.0%

647

Agentic framework for autonomous scientific discovery and optimization

Starred by

Created 1 month ago

Updated 3 weeks ago

turboquant_plus by TheTom

1.2%

LLM KV cache compression for efficient local inference

Starred by

Created 1 month ago

Updated 3 days ago

ATLAS by itigges22

0.6%

Boosts frozen LLM performance for efficient, self-hosted AI

Starred by

Created 3 months ago

Updated 20 hours ago

agent-orchestrator by ComposioHQ

2.1%

Orchestrating parallel AI coding agents for autonomous software development

Created 2 months ago

Updated 1 day ago

autokernel by RightNow-AI

0.9%

Autonomous GPU kernel optimization for PyTorch

Starred by

Created 2 months ago

Updated 1 month ago

KernelAgent by meta-pytorch

3.0%

405

Autonomous GPU kernel generation and optimization via AI agents

Starred by

Created 10 months ago

Updated 5 days ago

cookbook by Liquid4All

1.8%

On-device AI models and SDK for edge applications

Starred by

Created 7 months ago

Updated 6 days ago

simple-evals by openai

0.3%

Lightweight library for evaluating language models

Awesome-ML-SYS-Tutorial by zhaochenyang20

1.6%

ML SYS learning notes and code

Starred by

Created 1 year ago

Updated 2 weeks ago

ANE by maderix

0.2%

Direct neural network training on Apple Neural Engine

Starred by

Created 2 months ago

Updated 2 months ago

multi-agent-coding-system by Danau5tin

0.4%

AI coding system with orchestrator, explorer, and coder agents

Starred by

Created 8 months ago

Updated 6 months ago

CUDA-Agent by BytedTsinghua-SIA

0.8%

952

Agentic RL for high-performance CUDA kernel generation

Starred by

Created 3 months ago

Updated 2 months ago

OpenClaw-RL by Gen-Verse

1.1%

Personalize AI agents through conversational reinforcement learning

Starred by

Created 2 months ago

Updated 22 hours ago

crush by charmbracelet

1.1%

24k

AI coding agent for your terminal

Starred by

Created 11 months ago

Updated 1 day ago

slowrun by qlabs-eng

0.9%

460

LLM training benchmark prioritizing deep learning over speed

Starred by

Created 2 months ago

Updated 1 week ago

superpowers by obra

4.2%

186k

AI assistant superpowers via a comprehensive skills library

Starred by

+17

Created 7 months ago

Updated 1 day ago

kvpress by NVIDIA

0.6%

LLM KV cache compression made easy

Starred by

Created 1 year ago

Updated 20 hours ago

SkillRL by aiming-lab

0.7%

713

Recursive skill-augmented reinforcement learning for evolving LLM agents

Created 3 months ago

Updated 2 days ago

Open-AgentRL by Gen-Verse

1.6%

490

Reinforcement learning for LLM agents

Created 7 months ago

Updated 2 months ago

discover by test-time-training

1.4%

557

Learning to discover at test time

Starred by

Created 3 months ago

Updated 1 month ago

mHC-manifold-constrained-hyper-connections by tokenbender

0.3%

358

Research implementation of manifold-constrained hyper-connections for deep learning models

Created 4 months ago

Updated 2 months ago

IQuest-Coder-V1 by IQuestLab

0.1%

Code LLMs for autonomous software engineering

Created 4 months ago

Updated 2 months ago

OpenTinker by open-tinker

671

RL-as-a-Service infrastructure for foundation models

Starred by

Created 4 months ago

Updated 1 month ago

punica by punica-ai

LoRA serving system (research paper) for multi-tenant LLM inference

Starred by

Created 2 years ago

Updated 2 years ago

mLoRA by TUDB-Labs

0.5%

378

Framework for efficient LoRA fine-tuning of multiple LLMs

Created 2 years ago

Updated 1 year ago

miles by radixark

7.6%

Enterprise RL for large-scale MoE models

Starred by

Created 7 months ago

Updated 20 hours ago

ROLL by alibaba

0.7%

RL library for large language models

Starred by

Created 11 months ago

Updated 1 day ago

Kimi-Linear by MoonshotAI

0.3%

Efficient linear attention architecture accelerates long-context LLMs

Created 6 months ago

Updated 5 months ago

Fast-dLLM by NVlabs

0.8%

963

Diffusion LLM inference acceleration framework

Starred by

Created 11 months ago

Updated 6 days ago

auto-round by intel

2.7%

Quantization algorithm for LLMs and VLMs

Starred by

Created 2 years ago

Updated 19 hours ago

luminal by luminal-ai

0.4%

Deep learning library using composable compilers for high performance

Starred by

Created 2 years ago

Updated 1 day ago

MARS by AGI-Arena

718

Optimization framework for training large models

Created 1 year ago

Updated 1 month ago

DeepResearch by Alibaba-NLP

0.3%

19k

Benchmark for LLMs in web traversal

Starred by

Created 1 year ago

Updated 2 months ago

gemlite by dropbox

447

Triton kernels for efficient low-bit matrix multiplication

Starred by

Created 1 year ago

Updated 2 weeks ago

AgentGym-RL by WooooDyy

1.2%

727

Train LLM agents for long-horizon, multi-turn decision-making

Starred by

Created 8 months ago

Updated 2 months ago

LlamaGym by KhoomeiK

0.1%

SDK for fine-tuning LLM agents with online reinforcement learning

Starred by

Created 2 years ago

Updated 2 years ago

flame by fla-org

0.5%

387

Minimal, efficient framework for LLM training

Starred by

Created 1 year ago

Updated 2 weeks ago

Soft-Thinking by eric-ai-lab

0.3%

335

Enhancing LLM reasoning via continuous concept spaces

Created 11 months ago

Updated 3 months ago

DFT by yongliang-wu

0.5%

564

Improving SFT generalization with reward rectification

Starred by

Created 9 months ago

Updated 4 months ago

dion by microsoft

0.2%

476

Orthonormal updates for faster distributed ML training

Created 11 months ago

Updated 2 days ago

mixture_of_recursions by raymin0223

0.2%

571

Adaptive LLM computation with dynamic recursion

Created 11 months ago

Updated 7 months ago

gem by axon-rl

1.2%

486

Agentic LLM training environment for interactive reinforcement learning

Starred by

Created 11 months ago

Updated 3 months ago

cc by kn1026

HRM by sapientinc

0.1%

12k

Hierarchical reasoning for complex tasks

Starred by

Created 10 months ago

Updated 1 month ago

RL2 by ChenmienTan

0.2%

Reinforcement learning for large language models

Starred by

Created 1 year ago

Updated 2 days ago

matmulfreellm by ridgerchu

MatMul-free language models

Starred by

Created 2 years ago

Updated 5 months ago

applied-ai by meta-pytorch

321

Applied AI experiments and examples for PyTorch

Starred by

Created 3 years ago

Updated 8 months ago

COAT by NVlabs

0.4%

263

FP8 training framework for memory efficiency

Created 1 year ago

Updated 9 months ago

SkyRL by NovaSky-AI

0.7%

RL training pipeline for multi-turn tool use LLMs, optimized for real-world tasks

scattermoe by shawntan

0.4%

273

Triton-based Sparse Mixture-of-Experts for efficient deep learning

Starred by

Created 2 years ago

Updated 7 months ago

rStar by microsoft

0.1%

Research paper repo for math reasoning in small LLMs via deep thinking

Starred by

Created 1 year ago

Updated 8 months ago

Skills by NVIDIA-NeMo

0.3%

949

LLM skill-improvement pipelines for synthetic data generation, training, and evaluation

Starred by

Created 2 years ago

Updated 1 day ago

Absolute-Zero-Reasoner by LeapLabTHU

0.3%

Self-play reasoning framework needing zero data

Starred by

Created 1 year ago

Updated 8 months ago

DeepSeekRL-Extended by brendanhogan

252

GRPO implementation for scaled RL research

Starred by

Created 1 year ago

Updated 8 months ago

open-webui by open-webui

0.8%

137k

Self-hosted AI platform for local LLM deployment

TTRL by PRIME-RL

0.7%

RL technique for unlabeled data, especially test data

Created 1 year ago

Updated 4 weeks ago

R2E-Gym by R2E-Gym

1.9%

271

Scaling open-weight SWE agents with procedural environments and hybrid verifiers

Starred by

Created 1 year ago

Updated 10 months ago

axolotl by axolotl-ai-cloud

0.4%

12k

CLI tool for streamlined post-training of AI models

agno by agno-agi

0.4%

40k

Lightweight library for building AI Agents with memory, knowledge, and reasoning

Starred by

Created 4 years ago

Updated 19 hours ago

github-mcp-server by github

0.7%

30k

MCP server for GitHub API automation and interaction

Starred by

Created 1 year ago

Updated 19 hours ago

loong by camel-ai

502

Synthetic data generation project using LLM agents

Created 1 year ago

Updated 1 week ago

SWE-Gym by SWE-Gym

0.3%

674

Environment for training software engineering agents

Starred by

Created 1 year ago

Updated 9 months ago

GamingAgent by lmgame-org

0.2%

926

SDK for LLM/VLM gaming agents, enabling model evaluation via games

Starred by

Created 1 year ago

Updated 5 months ago

LLaDA by ML-GSAI

0.3%

LLM research paper exploring masked diffusion language models

Starred by

Created 1 year ago

Updated 6 months ago

recurrent-pretraining by seal-rg

0.2%

883

Pretraining code for depth-recurrent language model research

Starred by

Created 1 year ago

Updated 4 months ago

TransArch by MuLabPKU

0.6%

436

Post-training method converts GQA-based LLMs to MLA models

Created 1 year ago

Updated 1 month ago

MLGym by facebookresearch

0.3%

598

Gym environment for ML research agents

Starred by

Created 1 year ago

Updated 9 months ago

native-sparse-attention-triton by XunhaoLai

276

Efficient sparse attention for LLMs

Created 1 year ago

Updated 11 months ago

coconut by facebookresearch

0.3%

Research paper implementation for LLM reasoning in latent space

Starred by

Created 1 year ago

Updated 1 month ago

native-sparse-attention-pytorch by lucidrains

798

Sparse attention implementation from Deepseek's research paper

Created 1 year ago

Updated 9 months ago

ReasonFlux by Gen-Verse

0.2%

535

LLM post-training algorithms for data selection, RL, and inference

Created 1 year ago

Updated 7 months ago

LIMO by GAIR-NLP

0.1%

Reasoning model using less data

Starred by

Created 1 year ago

Updated 9 months ago

s1 by simplescaling

0.0%

Test-time scaling recipe for strong reasoning performance

Starred by

Created 1 year ago

Updated 10 months ago

reasoning-gym by open-thought

0.3%

Procedural dataset generator for reasoning models

Starred by

Created 1 year ago

Updated 3 weeks ago

curator by bespokelabsai

0.1%

Synthetic data curation tool for post-training and structured data extraction

Starred by

Created 1 year ago

Updated 3 weeks ago

RAGEN by mll-lab-nu

0.3%

Train LLM agents with reinforcement learning in interactive environments

Starred by

Created 1 year ago

Updated 4 weeks ago

SkyThought by NovaSky-AI

0.1%

Training recipes for Sky-T1 family of models

Starred by

Created 1 year ago

Updated 10 months ago

search-and-learn by huggingface

0.2%

Recipes to scale inference-time compute of open models

Starred by

Created 1 year ago

Updated 1 month ago

buffer-of-thought-llm by YangLing0818

675

Research paper implementation for thought-augmented LLM reasoning

Created 1 year ago

Updated 10 months ago

HuatuoGPT-o1 by FreedomIntelligence

0.1%

Medical LLM for advanced reasoning

Created 1 year ago

Updated 1 year ago

LayerSkip by facebookresearch

368

Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding" research paper

Created 2 years ago

Updated 4 weeks ago

markitdown by microsoft

1.6%

123k

Python tool for converting files to Markdown for LLM text analysis

NeMo-Aligner by NVIDIA

0.1%

854

Toolkit for efficient model alignment

Starred by

Created 2 years ago

Updated 7 months ago

agency-swarm by VRSEN

2.2%

Agentic framework built on OpenAI Assistants API for automating AI workflows

Starred by

Created 2 years ago

Updated 2 days ago

instructlab by instructlab

CLI tool for LLM alignment tuning via synthetic data

Starred by

Created 2 years ago

Updated 1 month ago

flash-linear-attention by fla-org

0.7%

Efficient Torch/Triton implementations for linear attention models

Starred by

Created 2 years ago

Updated 1 day ago

TokenFormer by Haiyang-W

0.3%

590

Research paper on a fully attention-based neural network with tokenized model parameters

Created 1 year ago

Updated 1 year ago

evaluation-guidebook by huggingface

0.2%

LLM evaluation guide for practitioners

Starred by

Created 1 year ago

Updated 5 months ago

dynasaur by adobe-research

358

LLM agent framework using dynamic action creation via Python code generation

Starred by

Created 1 year ago

Updated 1 year ago

Marco-o1 by AIDC-AI

Open reasoning model for real-world problem solving

Created 1 year ago

Updated 2 months ago

SageAttention by thu-ml

0.3%

Attention kernel for plug-and-play inference acceleration

Starred by

Created 1 year ago

Updated 3 months ago

metaflow by Netflix

0.1%

10k

Framework for building and managing AI/ML systems

Muon by KellerJordan

0.8%

Optimizer for neural network hidden layers

Starred by

Created 1 year ago

Updated 3 months ago

MathBlackBox by trotsky1997

0.1%

Research paper for mathematical reasoning via LLMs

Starred by

Created 1 year ago

Updated 1 year ago

BitNet by microsoft

0.3%

39k

Inference framework for 1-bit LLMs

Starred by

Created 1 year ago

Updated 2 months ago

Aria by rhymes-ai

0.1%

Multimodal MoE model for video, document understanding, and dialog

Starred by

Created 1 year ago

Updated 1 year ago

Hands-On-Large-Language-Models by HandsOnLLM

1.3%

26k

Code examples for "Hands-On Large Language Models" book

Starred by

Created 1 year ago

Updated 2 weeks ago

modded-nanogpt by KellerJordan

0.4%

Language model training speedrun on 8x H100 GPUs

Starred by

Created 1 year ago

Updated 19 hours ago

ogx by ogx-ai

0.1%

Composable building blocks for Llama apps

Starred by

Created 1 year ago

Updated 19 hours ago

Adam-mini by zyushun

458

PyTorch implementation of Adam-mini optimizer from a research paper

Starred by

Created 1 year ago

Updated 1 year ago

optillm by algorithmicsuperintelligence

1.8%

Optimizing inference proxy for LLMs

Starred by

Created 1 year ago

Updated 5 days ago

LLM-Blender by yuchenlin

0.2%

982

LLM ensembling framework using pairwise ranking and generative fusion

Starred by

Created 2 years ago

Updated 1 year ago

EvolKit by arcee-ai

257

LLM instruction enhancement framework

Starred by

Created 1 year ago

Updated 1 year ago

LLMs-Planning by karthikv792

0.4%

465

Benchmark for evaluating LLMs on planning tasks

Created 4 years ago

Updated 7 months ago

rStar by zhentingqi

970

Research paper for improving small LLM reasoning via mutual reasoning

Starred by

Created 1 year ago

Updated 1 year ago

distributed-training-guide by LambdaLabsML

0.2%

611

PyTorch guide for distributed training of large language models

Starred by

Created 1 year ago

Updated 6 months ago

nyuntam by nyunAI

664

CLI tool for LLM compression via pruning, quantization, and distillation

Created 1 year ago

Updated 1 year ago

distillm by jongwooko

261

Streamlined LLM distillation for efficient model training

Starred by

Created 2 years ago

Updated 1 year ago

MisguidedAttention by cpldcpu

473

LLM reasoning benchmark for evaluating responses to misleading prompts

Starred by

Created 2 years ago

Updated 9 months ago

Open-Reasoning-Tasks by NousResearch

484

Reasoning tasks collection for LLMs

Starred by

Created 1 year ago

Updated 1 year ago

long-context-attention by feifeibear

667

Unified sequence parallel attention for long context LLM training/inference

Starred by

Created 2 years ago

Updated 3 months ago

DistillKit by arcee-ai

0.3%

936

Open-source toolkit for LLM distillation research

Starred by

Created 1 year ago

Updated 1 month ago

do-not-answer by Libr-AI

0.3%

325

Dataset for evaluating LLM safety mechanisms

Starred by

Created 2 years ago

Updated 1 year ago

fms-fsdp by foundation-model-stack

285

Efficiently train foundation models with PyTorch

Starred by

Created 2 years ago

Updated 5 months ago

OLMo by allenai

0.1%

Open language model code for training, evaluation, and inference

Starred by

Created 3 years ago

Updated 5 months ago

BAdam by Ledzy

286

Memory-efficient optimizer for large language model finetuning

Starred by

Created 2 years ago

Updated 1 year ago

snowflake-arctic by Snowflake-Labs

560

AI research project for efficient LLM training and inference

Starred by

Created 2 years ago

Updated 1 year ago

open-instruct by allenai

0.2%

Training codebase for instruction-following language models

mdistiller by megvii-research

0.1%

900

PyTorch library for knowledge distillation research

Created 4 years ago

Updated 2 years ago

augmentoolkit by e-p-armstrong

0.4%

Data toolkit for custom LLM creation using open-source AI

Starred by

Created 2 years ago

Updated 2 weeks ago

awesome-synthetic-datasets by davanstrien

331

Curated list of synthetic text/vision datasets and generation tools

Created 2 years ago

Updated 4 months ago

calm by zeux

0.1%

638

Single-GPU inference engine for rapid LLM prototyping

Starred by

Created 2 years ago

Updated 11 months ago

MobileLLM by facebookresearch

0.2%

Sub-billion parameter LLM training code for on-device use

Starred by

Created 1 year ago

Updated 1 week ago

phoenix by Arize-ai

0.9%

10k

AI observability platform for experimentation, evaluation, and troubleshooting

Starred by

Created 3 years ago

Updated 23 hours ago

SPPO by uclaml

587

Self-Play Preference Optimization (SPPO) aligns language models via self-play

Starred by

Created 1 year ago

Updated 1 year ago

WildBench by allenai

252

Benchmarking LLMs with challenging real-user tasks

Starred by

Created 2 years ago

Updated 1 year ago

AutoIF by QwenLM

331

Research paper for improving LLM instruction-following via self-play with execution feedback

Starred by

Created 1 year ago

Updated 1 year ago

refusal_direction by andyrdt

0.5%

386

Research paper code for analyzing refusal in language models

Starred by

Created 1 year ago

Updated 11 months ago

YaFSDP by yandex

0.2%

988

Sharded data parallelism framework for transformer-like neural networks

Starred by

Created 1 year ago

Updated 1 week ago

chat_templates by chujiezheng

717

Chat templates for HuggingFace LLMs

Starred by

Created 2 years ago

Updated 1 year ago

LESS by princeton-nlp

0.2%

527

Data selection research paper for targeted instruction tuning

Starred by

Created 2 years ago

Updated 1 year ago

MixEval by JinjieNi

256

Dynamic LLM evaluation suite for accurate, cost-effective benchmarking

Starred by

Created 1 year ago

Updated 1 year ago

MoRA by kongds

362

Parameter-efficient fine-tuning via high-rank updating (MoRA)

Starred by

Created 2 years ago

Updated 1 year ago

SimPO by princeton-nlp

0.1%

954

Preference optimization algorithm for LLMs (NeurIPS 2024 paper)

Starred by

Created 2 years ago

Updated 1 year ago

qodo-cover by qodo-ai

0.1%

CLI tool for AI-powered test generation and code coverage enhancement

Starred by

Created 2 years ago

Updated 1 month ago

mlx-bitnet by exo-explore

0.3%

277

Efficient LLM inference on Apple Silicon

Starred by

Created 2 years ago

Updated 2 years ago

gemma-2B-10M by mustafaaljadery

934

Gemma 2B with 10M context length using Infini-attention

Starred by

Created 2 years ago

Updated 2 years ago

xtuner by InternLM

LLM fine-tuning toolkit for research

Starred by

Created 2 years ago

Updated 20 hours ago

GLiNER by urchade

0.8%

NER model for identifying any entity type using bidirectional transformer

Starred by

Created 2 years ago

Updated 1 day ago

contriever by facebookresearch

775

Unsupervised dense information retrieval via contrastive learning

Starred by

Created 4 years ago

Updated 3 years ago

prometheus-eval by prometheus-eval

0.6%

LLM evaluation framework using open LLMs

Starred by

Created 2 years ago

Updated 1 year ago

LLMTest_NeedleInAHaystack by gkamradt

0.1%

LLM testing tool for evaluating in-context retrieval accuracy

Starred by

Created 2 years ago

Updated 1 year ago

selfcodealign by bigcode-project

323

Research paper for self-alignment in code generation

Starred by

Created 2 years ago

Updated 1 year ago

llm-datasets by mlabonne

0.3%

Curated datasets/tools for LLM post-training

Starred by

Created 2 years ago

Updated 1 week ago

rerope by bojone

395

Position embeddings research paper

Starred by

Created 2 years ago

Updated 2 years ago

LaVague by lavague-ai

0.1%

Web agent framework for automating web processes

Starred by

Created 2 years ago

Updated 1 year ago

ring-flash-attention by zhuzilin

0.2%

FlashAttention extension for ring attention

Starred by

Created 2 years ago

Updated 8 months ago

llamaduo by deep-diver

317

LLMOps pipeline to fine-tune small LLMs for service LLM outage prep

Starred by

Created 2 years ago

Updated 10 months ago

cohere-toolkit by cohere-ai

0.0%

RAG toolkit for LLM application development and deployment

Starred by

Created 2 years ago

Updated 1 month ago

uptrain by uptrain-ai

Open-source platform to evaluate and improve GenAI apps

Starred by

Created 3 years ago

Updated 1 year ago

BitBLAS by microsoft

0.1%

762

Library for mixed-precision matrix multiplications, targeting quantized LLM deployment

Created 2 years ago

Updated 9 months ago

arena-hard-auto by lmarena

0.1%

Automatic LLM benchmark for instruction-tuned models, correlating with human preference

Starred by

Created 2 years ago

Updated 10 months ago

ChunkLlama by HKUNLP

450

Training-free method for extending LLM context windows

Created 2 years ago

Updated 1 year ago

dstack by dstackai

0.3%

Open-source tool for simplifying GPU allocation and AI workload orchestration

Starred by

Created 4 years ago

Updated 19 hours ago

rho by microsoft

466

LLM pretraining research paper using selective language modeling (SLM)

Starred by

Created 2 years ago

Updated 2 years ago

dify by langgenius

0.7%

141k

Open-source LLM app development platform

attorch by BobMcDear

600

PyTorch nn module subset, implemented in Python using Triton

Starred by

Created 2 years ago

Updated 9 months ago

mixtral-offloading by dvmazur

0.0%

Inference optimization for Mixtral-8x7B models

Starred by

Created 2 years ago

Updated 2 years ago

auto-code-rover by AutoCodeRoverSG

0.0%

Autonomous software engineer for program improvement

Starred by

Created 2 years ago

Updated 1 year ago

BitNet-Transformers by Beomi

316

HuggingFace Transformers implementation of BitNet scaling for LLMs

Created 2 years ago

Updated 2 years ago

EasyContext by jzhang38

758

Recipes for language model context length extrapolation to 1M tokens

Starred by

Created 2 years ago

Updated 1 year ago

pyreft by stanfordnlp

Python library for representation finetuning (ReFT) of language models

Starred by

Created 2 years ago

Updated 2 months ago

hlb-gpt by tysam-code

356

Researcher's toolbench for GPT model exploration

Starred by

Created 3 years ago

Updated 1 year ago

aideml by WecoAI

0.6%

ML engineering agent for automated AI R&D, surpassing human experts

Starred by

Created 2 years ago

Updated 1 week ago

BitNet by kyegomez

0.2%

PyTorch implementation of BitNet research paper

Starred by

Created 2 years ago

Updated 2 weeks ago

horovod by horovod

0.0%

15k

Distributed training framework for TF, Keras, PyTorch, and MXNet

Starred by

+19

Created 8 years ago

Updated 5 months ago

dataverse by UpstageAI

564

ETL pipeline for LLM data processing

Starred by

Created 2 years ago

Updated 1 year ago

hqq by dropbox

0.4%

938

Model quantizer for fast, accurate post-training quantization, skipping calibration

Starred by

Created 2 years ago

Updated 2 months ago

Triton-Puzzles by gpu-mode

0.4%

Interactive puzzles for learning Triton

Starred by

Created 2 years ago

Updated 1 month ago

repeng by vgel

724

Python library for representation engineering control vectors

Starred by

Created 2 years ago

Updated 7 months ago

cobra by OpenHelix-Team

0.3%

296

Multimodal LLM research paper extending Mamba for efficient inference

Created 2 years ago

Updated 1 year ago

hackathon by mistralai-sf24

445

Minimal code for running and finetuning a 7B transformer model

Starred by

Created 2 years ago

Updated 2 years ago

raft by rapidsai

0.1%

CUDA-accelerated primitives for ML/data mining algorithms

Starred by

Created 7 years ago

Updated 1 day ago

maestro by Doriandarko

0.0%

Framework for Claude Opus to orchestrate subagents

Starred by

Created 2 years ago

Updated 1 year ago

quiet-star by ezelikman

740

Research code for self-teaching language models

Starred by

Created 2 years ago

Updated 1 year ago

ml-engineering by stas00

0.3%

18k

Open book for LLM/VLM training engineers

chatbot-ui by mckaywrigley

0.0%

33k

Open-source AI chat app

orpo by xfactlab

482

Preference optimization without a reference model

Starred by

Created 2 years ago

Updated 1 year ago

SWE-bench by SWE-bench

1.1%

Benchmark for evaluating LLMs on real-world GitHub issues

OpenHands by OpenHands

0.7%

73k

AI platform for software development agents

FastV by pkunlp-icler

0.3%

577

Inference acceleration for large vision-language models (research paper)

Created 2 years ago

Updated 1 year ago

airllm by lyogavin

2.4%

18k

Inference optimization for LLMs on low-resource hardware

Starred by

Created 2 years ago

Updated 2 months ago

daytona by daytonaio

0.2%

72k

Infrastructure for running AI-generated code

Starred by

Created 2 years ago

Updated 1 day ago

VisionLLaMA by Meituan-AutoML

392

Vision transformer research paper

Created 2 years ago

Updated 1 year ago

fsdp_qlora by AnswerDotAI

0.1%

Training script for LLMs using QLoRA + FSDP

Starred by

Created 2 years ago

Updated 1 year ago

h2o-llmstudio by h2oai

0.9%

LLM Studio: framework for LLM fine-tuning via GUI or CLI

Starred by

Created 3 years ago

Updated 1 week ago

ChatMusician by hf-lin

0.3%

310

LLM for music understanding and generation

Created 2 years ago

Updated 2 years ago

AnyGPT by OpenMOSS

879

Multimodal LLM research paper for any-to-any modality conversion

Starred by

Created 2 years ago

Updated 1 year ago

FlagEmbedding by FlagOpen

0.2%

12k

Toolkit for retrieval and RAG applications

Starred by

Created 2 years ago

Updated 2 weeks ago

self-rewarding-lm-pytorch by lucidrains

0.1%

Training framework for self-rewarding language models

Starred by

Created 2 years ago

Updated 2 years ago

crewAI by crewAIInc

1.0%

51k

Framework for autonomous AI agent orchestration via role-playing and collaboration

resource-stream by gpu-mode

0.4%

CUDA resource collection for GPU programming

Starred by

Created 2 years ago

Updated 2 months ago

metal-flash-attention by philipturner

0.3%

601

Metal port of FlashAttention for Apple silicon

Starred by

Created 2 years ago

Updated 1 year ago

LLMs-from-scratch by rasbt

1.0%

93k

Educational resource for LLM construction in PyTorch

mlx-examples by ml-explore

0.3%

Examples using the MLX framework

Starred by

Created 2 years ago

Updated 1 month ago

ai-codereviewer by villesau

0.1%

GitHub Action for AI-powered code review

Starred by

Created 3 years ago

Updated 1 year ago

deita by hkust-nlp

0.3%

595

Data-efficient instruction tuning for LLM alignment (ICLR 2024)

Starred by

Created 2 years ago

Updated 1 year ago

AutoAWQ by casper-hansen

0.0%

AutoAWQ is a tool for 4-bit quantized LLM inference

Starred by

Created 2 years ago

Updated 1 year ago

ProxyAI by carlrobertoh

0.3%

JetBrains IDE copilot for coding assistance

Starred by

Created 3 years ago

Updated 5 days ago

EAGLE by SafeAILab

0.4%

Speculative decoding research paper for faster LLM inference

Starred by

Created 2 years ago

Updated 2 months ago

HALOs by ContextualAI

904

Library for aligning LLMs using human-aware loss functions

Starred by

Created 2 years ago

Updated 7 months ago

mamba by state-spaces

0.3%

18k

Mamba SSM architecture for sequence modeling

modelz-llm by tensorchord

277

Inference server for open-source LLMs, offering an OpenAI-compatible API

Created 3 years ago

Updated 2 years ago

unsloth by unslothai

0.6%

64k

Finetuning tool for LLMs, targeting speed and memory efficiency

gpt-researcher by assafelovic

0.5%

27k

Autonomous agent for web/local research, generating cited reports

Starred by

Created 3 years ago

Updated 3 weeks ago

functionary by MeetKai

0.1%

Chat language model for tool use and result interpretation

Starred by

Created 2 years ago

Updated 5 months ago

Logic-LLM by teacherpeterpan

0.3%

394

Logic-LM: Framework for improved logical reasoning via LLMs and symbolic solvers

Created 3 years ago

Updated 1 year ago

LLMSurvey by RUCAIBox

0.1%

12k

Survey paper for large language models

Starred by

Created 3 years ago

Updated 1 year ago

distilabel by argilla-io

0.3%

Framework for synthetic data and AI feedback pipelines

long-llms-learning by Strivin0311

274

Literature repository for long-context LLM methodologies

Starred by

Created 2 years ago

Updated 1 year ago

MergeLM by yule-BUAA

867

Codebase for merging language models via parameter averaging

Starred by

Created 2 years ago

Updated 2 years ago

Video-LLaVA by PKU-YuanGroup

0.0%

Video-LLaVA: Multimodal model for video/image understanding via LLM

Starred by

Created 2 years ago

Updated 1 year ago

medAlpaca by kbressem

559

LLM finetuned for medical question answering

Starred by

Created 3 years ago

Updated 2 years ago

intel-extension-for-transformers by intel

0.1%

Transformer toolkit for GenAI/LLM acceleration on Intel platforms

Starred by

Created 3 years ago

Updated 1 year ago

representation-engineering by andyzoujm

0.2%

992

AI transparency via representation engineering

Starred by

Created 2 years ago

Updated 1 year ago

multimodal by facebookresearch

0.1%

PyTorch library for multimodal multi-task model training

Starred by

Created 4 years ago

Updated 1 day ago

S-LoRA by S-LoRA

0.2%

System for scalable LoRA adapter serving

Starred by

Created 2 years ago

Updated 2 years ago

DeepSpeed by deepspeedai

0.1%

42k

Deep learning optimization library for distributed training and inference

continue by continuedev

0.4%

33k

IDE extension for custom AI code assistants

llama-cookbook by meta-llama

0.1%

18k

Guide for building with Llama models

finetuner by jina-ai

Cloud tool for task-oriented embedding finetuning of models like BERT and CLIP

Starred by

Created 4 years ago

Updated 2 years ago

ludwig by ludwig-ai

0.1%

12k

Low-code framework for custom AI models (LLMs, neural networks)

img2dataset by rom1504

0.0%

CLI tool for creating large image datasets from URLs

distilling-step-by-step by google-research

591

Code for research paper on knowledge distillation

Starred by

Created 3 years ago

Updated 2 years ago

Cherry_LLM by tianyi-lab

0.2%

414

Research paper for LLM instruction tuning via self-guided data selection

Created 2 years ago

Updated 10 months ago

Reflection_Tuning by tianyi-lab

366

Research paper for LLM instruction tuning via data recycling

Starred by

Created 2 years ago

Updated 1 year ago

auto-j by GAIR-NLP

250

Generative judge for evaluating LLM alignment

Created 2 years ago

Updated 2 years ago

instructor by 567-labs

0.3%

13k

SDK for structured LLM outputs using Pydantic models

YiVal by YiVal

Prompt engineering assistant for GenAI apps

Starred by

Created 2 years ago

Updated 2 years ago

LLM-Shearing by princeton-nlp

643

Code for LLM pre-training acceleration via structured pruning (ICLR 2024)

Starred by

Created 2 years ago

Updated 2 years ago

letta by letta-ai

0.8%

23k

Agent framework for stateful agents with memory, reasoning, and context management

CogVLM by zai-org

0.0%

VLM for image understanding and multi-turn dialogue

Starred by

Created 2 years ago

Updated 1 year ago

ragas by vibrantlabsai

0.8%

14k

Toolkit for LLM application evaluation

NEFTune by neelsjain

411

Technique to improve instruction finetuning of LLMs

Starred by

Created 2 years ago

Updated 2 years ago

FireAct by anchen1011

0.3%

293

Language agent fine-tuning research paper

Starred by

Created 2 years ago

Updated 2 years ago

LLaVA by haotian-liu

0.1%

25k

Multimodal assistant with GPT-4 level capabilities

alignment-handbook by huggingface

0.1%

Handbook for aligning language models with human/AI preferences

autolabel by refuel-ai

0.1%

Python library to label text datasets using LLMs

Starred by

Created 3 years ago

Updated 1 year ago

EmpatheticDialogues by facebookresearch

547

PyTorch code for empathetic dialogue research

Starred by

Created 7 years ago

Updated 4 years ago

world-models by wesg52

0.4%

261

Research paper code for extracting spatial/temporal world models from LLMs

Starred by

Created 2 years ago

Updated 2 years ago

OpenGPT by CogStack

0.5%

364

Framework for grounded instruction datasets and domain-expert LLMs

Starred by

Created 3 years ago

Updated 2 years ago

Medusa by FasterDecoding

0.2%

Framework for accelerating LLM generation using multiple decoding heads

Starred by

Created 2 years ago

Updated 1 year ago

open_flamingo by mlfoundations

0.1%

Open-source framework for training large multimodal models

Starred by

Created 3 years ago

Updated 1 year ago

textbook_quality by VikParuchuri

508

Synthetic data generator for LLM pretraining

Starred by

Created 2 years ago

Updated 2 years ago

tree-of-thought-llm by princeton-nlp

0.1%

Research paper implementation for Tree of Thoughts (ToT) prompting

Starred by

Created 3 years ago

Updated 1 year ago

LongLoRA by JIA-Lab-research

LongLoRA: Efficient fine-tuning for long-context LLMs

Starred by

Created 2 years ago

Updated 1 year ago

kani by zhudotexe

600

Microframework for chat-based language models with tool use/function calling

Starred by

Created 2 years ago

Updated 1 month ago

DoLa by voidism

554

Decoding strategy research paper for improving factuality in LLMs

Starred by

Created 2 years ago

Updated 1 year ago

varuna by microsoft

251

Tool for efficient large DNN model training on commodity hardware

Starred by

Created 4 years ago

Updated 1 year ago

BLoRA by sabetAI

351

Inference optimization for batched LoRA adapters

Starred by

Created 2 years ago

Updated 2 years ago

TinyLlama by jzhang38

0.1%

Tiny pretraining project for a 1.1B Llama model

sparsegpt by IST-DASLab

882

Code for massive language model one-shot pruning (ICML 2023 paper)

Starred by

Created 3 years ago

Updated 1 year ago

LLM-Pruner by horseee

0.1%

LLM structural pruner for model compression

Created 3 years ago

Updated 1 year ago

graph-of-thoughts by spcl

0.1%

Graph-of-Thoughts: LLM framework for complex problem-solving

Starred by

Created 2 years ago

Updated 1 month ago

tensor_parallel by BlackSamorez

0.1%

655

PyTorch module for multi-GPU model parallelism

Starred by

Created 3 years ago

Updated 2 years ago

relora by Guitaricet

473

PEFT pretraining code for ReLoRA research paper

Starred by

Created 3 years ago

Updated 2 years ago

wandbot by wandb

309

Support bot for Weights & Biases' AI tools, running in Discord, Slack, ChatGPT, and Zendesk

Starred by

Created 3 years ago

Updated 2 months ago

LightLLM by ModelTC

0.3%

Python framework for LLM inference and serving

Starred by

Created 2 years ago

Updated 21 hours ago

lmdeploy by InternLM

0.2%

Toolkit for LLM compression, deployment, and serving

Starred by

Created 2 years ago

Updated 23 hours ago

llama-chat by replicate

835

Next.js app for Llama 3 chat UI development

Created 2 years ago

Updated 4 months ago

llama2-chatbot by a16z-infra

Streamlit chatbot app for interacting with LLMs

Starred by

Created 2 years ago

Updated 2 years ago

IncognitoPilot by silvanmelchior

440

AI code interpreter for local data processing, like ChatGPT Code Interpreter

Created 2 years ago

Updated 2 years ago

ai-town by a16z-infra

0.4%

10k

AI town starter kit for building a virtual world

octopack by bigcode-project

479

Code LLM instruction tuning research paper

Starred by

Created 3 years ago

Updated 1 year ago

outlines by dottxt-ai

0.3%

14k

SDK for structured LLM text generation

bubogpt by magic-research

510

Multi-modal LLM for joint text, vision, and audio understanding

Created 2 years ago

Updated 2 years ago

MetaGPT by FoundationAgents

0.3%

68k

Multi-agent framework for collaborative AI software development

pykoi by CambioML

411

Python library for reinforcement learning with human feedback (RLHF)

Starred by

Created 2 years ago

Updated 7 months ago

ChainFury by NimbleBoxAI

451

Open-source chaining engine for production AI apps

Starred by

Created 3 years ago

Updated 2 years ago

candle by huggingface

0.3%

20k

Minimalist ML framework for Rust, emphasizing performance and ease of use

Megatron-LLM by epfLLM

589

Distributed trainer for LLMs

Starred by

Created 2 years ago

Updated 2 years ago

ToolBench by OpenBMB

0.2%

Open platform for LLM tool learning (ICLR'24 spotlight)

Starred by

Created 3 years ago

Updated 11 months ago

gpt-engineer by AntonOsika

0.0%

55k

CLI platform for code generation experimentation

RRHF by GanjinZero

806

RRHF for aligning LLMs to human preferences

Starred by

Created 3 years ago

Updated 2 years ago

LlamaFactory by hiyouga

0.3%

71k

Unified fine-tuning tool for 100+ LLMs & VLMs (ACL 2024)

exllama by turboderp

0.0%

Llama implementation for memory-efficient quantized weights

Starred by

Created 3 years ago

Updated 2 years ago

doremi by sangmichaelxie

0.3%

353

PyTorch for optimizing data mixtures in language model datasets

Starred by

Created 3 years ago

Updated 2 years ago

UltraChat by thunlp

0.2%

Multi-round dialogue dataset and models for chat language model training

Starred by

Created 3 years ago

Updated 2 years ago

RealChar by Shaunwei

0.0%

Real-time AI character/companion creation and interaction codebase

Starred by

Created 2 years ago

Updated 3 months ago

serve by jina-ai

0.0%

22k

Framework for building cloud-native multimodal AI apps

aider by Aider-AI

0.7%

45k

AI pair programming in your terminal

LMFlow by OptimalScale

0.0%

Toolkit for finetuning and inference of large foundation models

Starred by

Created 3 years ago

Updated 5 days ago

baize-chatbot by project-baize

Chat model trained via LoRA, using ChatGPT-generated dialogs

Starred by

Created 3 years ago

Updated 2 years ago

ToolQA by night-chen

286

Dataset for evaluating LLMs using external tools

Created 2 years ago

Updated 2 years ago

SuperAGI by TransformerOptimus

0.1%

18k

Open-source framework for autonomous AI agent development

Starred by

Created 3 years ago

Updated 1 year ago

audiocraft by facebookresearch

0.1%

23k

PyTorch library for audio processing and generation research

guidance by guidance-ai

0.1%

21k

Guidance is a programming paradigm for steering LLMs

open_llama by openlm-research

Open-source reproduction of LLaMA models

RL4LMs by allenai

RL library to fine-tune language models to human preferences

Starred by

Created 3 years ago

Updated 2 years ago

SwiftSage by SwiftSage

326

Agent system for reasoning with LLMs via in-context reinforcement learning

Created 3 years ago

Updated 1 year ago

ctransformers by marella

0.1%

Python bindings for fast Transformer model inference

Starred by

Created 3 years ago

Updated 2 years ago

developer by smol-ai

12k

Agent for embedding a developer in your app

MeZO by princeton-nlp

0.2%

Research paper implementation for memory-efficient LM fine-tuning

Starred by

Created 3 years ago

Updated 2 years ago

ImageBind by facebookresearch

0.1%

PyTorch implementation for multimodal embeddings research paper

Starred by

Created 3 years ago

Updated 5 months ago

xtreme1 by xtreme1-io

0.3%

Open-source platform for multimodal training data annotation

Starred by

Created 3 years ago

Updated 4 days ago

sudolang by paralleldrive

VS Code extension for LLM-based programming with SudoLang

Starred by

Created 3 years ago

Updated 3 months ago

poe-api by ading2210

0.1%

Python API for Quora's Poe (unmaintained)

Created 3 years ago

Updated 2 years ago

Local-LLM-Comparison-Colab-UI by Troyanovsky

Local LLM comparison via Colab WebUI links

Starred by

Created 3 years ago

Updated 3 months ago

airoboros by jondurbin

Self-instruct tool for LLM finetuning

Starred by

Created 3 years ago

Updated 2 years ago

PaLM by conceptofmind

820

Open-source PaLM implementation for language model research

Starred by

Created 3 years ago

Updated 1 year ago

TruthfulQA by sylinrl

0.4%

913

Benchmark dataset for evaluating truthfulness of language models

Starred by

Created 4 years ago

Updated 1 year ago

private-gpt by zylon-ai

0.0%

57k

Private AI API for local document interaction using LLMs

PMC-LLaMA by chaoyi-wu

0.1%

677

Medical LLM for instruction-following in the medical domain

Created 3 years ago

Updated 1 year ago

openlm by r2d4

369

OpenAI-compatible Python client for calling LLMs

Starred by

Created 3 years ago

Updated 3 years ago

FasterTransformer by NVIDIA

0.1%

Optimized transformer library for inference

unlimiformer by abertsch72

Research paper for long-range transformers with unlimited input

Starred by

Created 3 years ago

Updated 2 years ago

gpt-neox by EleutherAI

0.1%

Framework for training large-scale autoregressive language models

toolformer by conceptofmind

383

Open-source implementation of Toolformer research paper

Starred by

Created 3 years ago

Updated 3 years ago

bark by suno-ai

0.1%

39k

Generative audio model for realistic speech and sound effects

chat-langchain by langchain-ai

0.1%

Chatbot for question answering over LangChain documentation

Starred by

Created 3 years ago

Updated 1 day ago

LaMini-LM by mbzuai-nlp

822

Small, efficient language models distilled from ChatGPT for research

Starred by

Created 3 years ago

Updated 3 years ago

ChatRWKV by BlinkDL

0.0%

Open-source chatbot powered by the RWKV RNN language model

Starred by

Created 3 years ago

Updated 3 months ago

RWKV-LM by BlinkDL

0.1%

15k

RNN for LLM, transformer-level performance, parallelizable training

LocalAI by mudler

0.3%

46k

Open-source OpenAI alternative for local AI inference

WizardLM by nlpxucan

0.0%

LLMs built using Evol-Instruct for complex instruction following

Starred by

+15

Created 3 years ago

Updated 11 months ago

chameleon-llm by lupantech

Research paper code for plug-and-play compositional reasoning with LLMs

Starred by

Created 3 years ago

Updated 2 years ago

llama-lab by run-llama

LlamaIndex projects for LLM data augmentation

Starred by

Created 3 years ago

Updated 2 years ago

EdgeGPT by acheong08

Reverse-engineered API for Microsoft Bing Chat (archived)

Starred by

Created 3 years ago

Updated 2 years ago

gisting by jayelm

0.3%

316

Research paper implementation for prompt compression via learned "gist" tokens

Starred by

Created 3 years ago

Updated 1 year ago

gpt-llama.cpp by keldenl

595

API wrapper for local LLM inference, emulating OpenAI's GPT endpoints

Starred by

Created 3 years ago

Updated 2 years ago

memit by kmeng01

0.5%

548

Transformer memory mass-editor (ICLR 2023 research paper)

Starred by

Created 3 years ago

Updated 2 years ago

dl4math by lupantech

372

DL4MATH: Deep learning resources for mathematical reasoning

Created 3 years ago

Updated 2 years ago

MiniGPT-4 by Vision-CAIR

0.0%

26k

Vision-language model for multi-task learning

auto-cot by amazon-science

0.1%

Research paper implementation for automatic chain-of-thought prompting

Starred by

Created 3 years ago

Updated 2 years ago

OpenChatKit by togethercomputer

0.1%

Open-source toolkit for building specialized/general-purpose chat models

PythonProgrammingPuzzles by microsoft

998

Python puzzle dataset for AI programming proficiency research

Created 5 years ago

Updated 2 years ago

RedPajama-Data by togethercomputer

0.1%

Dataset pipeline for training large language models

Starred by

Created 3 years ago

Updated 1 year ago

unstructured by Unstructured-IO

0.4%

15k

ETL solution for structuring unstructured data for language models

whisper by openai

0.4%

99k

Speech recognition model for multilingual transcription/translation

LLaMA_MPS by jankais3r

584

LLM inference on Apple Silicon GPUs

Starred by

Created 3 years ago

Updated 3 years ago

dolly by databrickslabs

11k

Instruction-following LLM trained on the Databricks Machine Learning Platform

minimal-llama by zphang

456

Code for running and fine-tuning LLaMA models

Starred by

Created 3 years ago

Updated 2 years ago

zero_shot_cot by kojima-takeshi188

442

Reasoning framework for LLMs, based on a NeurIPS 2022 paper

Starred by

Created 4 years ago

Updated 2 years ago

safari by HazyResearch

912

Research paper implementations for sequence modeling with convolutions

Starred by

Created 3 years ago

Updated 1 year ago

EasyLM by young-geng

0.1%

LLM training/finetuning framework in JAX/Flax

Starred by

Created 3 years ago

Updated 1 year ago

AlpacaDataCleaned by gururise

0.1%

Cleaned dataset for Alpaca LLM training

Starred by

Created 3 years ago

Updated 2 months ago

trl by huggingface

0.3%

18k

Library for transformer RL

ThoughtSource by OpenBioLink

0.1%

Framework for chain-of-thought reasoning data and tools

Starred by

Created 4 years ago

Updated 1 year ago

GPT-4-LLM by Instruction-Tuning-with-GPT-4

GPT-4 data for instruction-tuning LLMs via supervised/RL

Starred by

Created 3 years ago

Updated 2 years ago

lit-llama by Lightning-AI

LLaMA implementation for pretraining, finetuning, and inference

Starred by

Created 3 years ago

Updated 10 months ago

AutoGPT by Significant-Gravitas

0.1%

184k

AI agent platform for building, deploying, and running autonomous workflows

LLaMA-Adapter by OpenGVLab

Efficient fine-tuning for instruction-following LLaMA models

Starred by

Created 3 years ago

Updated 2 years ago

pygpt4all by nomic-ai

Python bindings for local LLM inference (deprecated)

Starred by

Created 3 years ago

Updated 3 years ago

chatllama by henrywoo

Open-source implementation for LLaMA-based ChatGPT, runnable on a single GPU

Created 3 years ago

Updated 1 year ago

optimate by nebuly-ai

Collection of libraries to optimize AI model performances

Starred by

Created 4 years ago

Updated 1 year ago

GPTeacher by teknium1

0.2%

GPT-4 generated datasets for instruction tuning

Starred by

Created 3 years ago

Updated 2 years ago

chatgpt-universe by cedrickchee

374

Collection of ChatGPT, GPT, and LLM resources

Created 3 years ago

Updated 1 year ago

langchain by langchain-ai

0.5%

136k

Framework for building LLM-powered applications

xTuring by stochasticai

0.1%

SDK for fine-tuning and customizing open-source LLMs

Starred by

Created 3 years ago

Updated 2 months ago

ai-pdf-chatbot-langchain by mayooear

0.1%

17k

AI chatbot agent for PDF document Q&A using LangChain & LangGraph

Starred by

Created 3 years ago

Updated 1 month ago

natbot by nat

Browser automation via GPT-3

Starred by

Created 3 years ago

Updated 1 year ago

ReAct by ysymyth

0.4%

GPT-3 prompting code for ReAct research paper

Starred by

Created 3 years ago

Updated 2 years ago

ChatGLM-finetune-LoRA by lich99

716

LoRA finetuning code for ChatGLM-6b

Starred by

Created 3 years ago

Updated 2 years ago

Llama-X by AetherCortex

Open academic research project improving LLaMA to SOTA LLM

Starred by

Created 3 years ago

Updated 2 years ago

flash-attention by Dao-AILab

0.3%

24k

Fast, memory-efficient attention implementation

FastChat by lm-sys

0.0%

39k

Open platform for training, serving, and evaluating LLM-based chatbots

text-generation-inference by huggingface

0.1%

11k

Rust/Python/gRPC server for fast LLM text generation

ChatDoctor by Kent0n-Li

0.0%

Medical chat model fine-tuned on LLaMA for medical domain Q&A

Starred by

Created 3 years ago

Updated 2 years ago

gpt4all by nomic-ai

0.1%

77k

Desktop app for local LLM inference, no GPU/API needed

Starred by

+29

Created 3 years ago

Updated 11 months ago

toolformer-pytorch by lucidrains

Pytorch implementation of Toolformer for language models using external tools

Starred by

Created 3 years ago

Updated 1 year ago

textgen by oobabooga

0.1%

47k

Web UI for LLM text generation

gptq by IST-DASLab

0.1%

Code for GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers

Starred by

Created 3 years ago

Updated 2 years ago

PaLM-rlhf-pytorch by lucidrains

0.0%

RLHF implementation on PaLM

Starred by

Created 3 years ago

Updated 7 months ago

trlx by CarperAI

0.0%

Distributed RLHF for LLMs

alpaca_lora_4bit by johnsmith0031

536

Fine-tuning and inference tool for quantized LLaMA models

Starred by

Created 3 years ago

Updated 2 years ago

chatgpt-retrieval-plugin by openai

0.0%

21k

Retrieval plugin for custom GPTs, function calling, or assistants APIs

GPTQ-for-LLaMa by qwopqwop200

0.0%

4-bit quantization for LLaMA models using GPTQ

Starred by

Created 3 years ago

Updated 1 year ago

dalai by cocktailpeanut

13k

Local LLM inference via CLI tool and Node.js API

Starred by

Created 3 years ago

Updated 1 year ago

alpaca-lora by tloen

0.0%

19k

LoRA fine-tuning for LLaMA

stanford_alpaca by tatsu-lab

0.0%

30k

Instruction-following LLaMA model training and data generation

ColossalAI by hpcaitech

0.0%

41k

AI system for large-scale parallel training

agentic by transitive-bullshit

0.1%

18k

AI agent stdlib for LLM-based TypeScript tooling

Starred by

Created 3 years ago

Updated 3 months ago

dagger by dagger

0.1%

16k

Open-source runtime for composable workflows, ideal for AI agents

Starred by

Created 6 years ago

Updated 1 day ago

sdk-python by temporalio

0.4%

Python SDK for Temporal, a distributed orchestration engine

Starred by

Created 4 years ago

Updated 1 day ago

docker-lambda by lambci

Deprecated: Docker images for replicating the AWS Lambda environment locally

Starred by

Created 10 years ago

Updated 3 years ago

kong by Kong

0.1%

43k

Cloud-native API and AI gateway for microservice orchestration

awesome-machine-learning by josephmisiti

0.1%

72k

Curated list of ML frameworks, libraries, and software

hackathon-starter by sahat

0.0%

35k

Node.js boilerplate for web applications

Feedback? Help us improve.