SourcePulse logo
HomeBrowse all repos
zhyncs avatar

Yineng Zhang

Inference Lead at SGLang; Research Scientist at Together AI

GitHubX

Starred Projects (128)

kimi-code by MoonshotAI

17.9%
2k
AI coding agent for terminal-based development
Starred by
hiyouga:
Created 3 weeks ago
Updated 12 hours ago

tokenspeed by lightseekorg

2.5%
1k
Speed-of-light LLM inference engine
Starred by
parano:
hammer:
luiscape:
antiagainst:
Created 1 month ago
Updated 13 hours ago

iree by iree-org

0.1%
4k
MLIR-based compiler and runtime toolkit for machine learning models
Starred by
ogabrielluiz:
mfuntowicz:
parano:
infwinston:
+10
Created 6 years ago
Updated 1 day ago

nanobot by HKUDS

0.8%
44k
Personal AI assistant for task automation and knowledge management
Starred by
transitive-bullshit:
jmorganca:
dguido:
Created 4 months ago
Updated 13 hours ago

smg by lightseekorg

1.9%
323
High-performance LLM gateway for diverse inference backends
Starred by
ekzhang:
Created 6 months ago
Updated 13 hours ago

Kimi-K2.5 by MoonshotAI

0.8%
2k
Multimodal agentic AI for vision-grounded reasoning and task execution
Created 4 months ago
Updated 4 months ago

hpc-ops by Tencent

4.7%
928
Boosts LLM inference speed with production-grade operators
Created 4 months ago
Updated 1 day ago

SkyRL by NovaSky-AI

1.4%
2k
RL training pipeline for multi-turn tool use LLMs, optimized for real-world tasks
Starred by
didierrlopes:
gakonst:
infwinston:
lewtun:
+16
Created 1 year ago
Updated 17 hours ago

Engram by deepseek-ai

0.0%
4k
Scalable conditional memory for large language models
Starred by
pgarbacki:
Created 5 months ago
Updated 4 months ago

codex by openai

0.5%
89k
Coding agent CLI tool for terminal-based chat-driven development
Starred by
codekansas:
hsbt:
didierrlopes:
ValentaTomas:
+37
Created 1 year ago
Updated 12 hours ago

TileGym by NVIDIA

0.5%
751
CUDA Tile kernel library for efficient GPU programming
Starred by
zhuohan123:
Created 7 months ago
Updated 2 days ago

xllm by jd-opensource

0.4%
1k
LLM inference engine optimized for diverse AI accelerators
Created 10 months ago
Updated 12 hours ago

cocoon by TelegramMessenger

0.5%
821
Confidential AI inference on a decentralized network
Created 6 months ago
Updated 3 weeks ago

DeepSeek-Math-V2 by deepseek-ai

0.1%
2k
LLM for self-verifiable mathematical reasoning
Starred by
chiphuyen:
vincentweisser:
omarsar:
simonw:
Created 6 months ago
Updated 6 months ago

open-instruct by allenai

0.2%
4k
Training codebase for instruction-following language models
Starred by
hammer:
vincentweisser:
RJT1990:
pgarbacki:
+10
Created 3 years ago
Updated 22 hours ago

pplx-garden by perplexityai

2.5%
577
High-performance LLM inference engine
Starred by
luiscape:
Created 7 months ago
Updated 2 weeks ago

KernelAgent by meta-pytorch

0.9%
445
Autonomous GPU kernel generation and optimization via AI agents
Starred by
winglian:
Created 11 months ago
Updated 6 days ago

tunix by google

0.5%
2k
JAX-native library for efficient LLM post-training
Starred by
ekzhang:
hiyouga:
ebursztein:
hammer:
Created 1 year ago
Updated 14 hours ago

kimi-cli by MoonshotAI

0.6%
9k
AI agent enhancing terminal operations and software development workflows
Starred by
hammer:
joewalnes:
parano:
omarsar:
Created 8 months ago
Updated 2 days ago

DeepSeek-OCR by deepseek-ai

0.1%
23k
Context-aware OCR model for visual-text compression
Starred by
pgarbacki:
omarsar:
MagMueller:
shizhediao:
+3
Created 7 months ago
Updated 4 months ago

modular by modular

0.1%
26k
AI toolchain unifying fragmented AI deployment workflows
Starred by
lattner:
tobi:
parano:
flaque:
+10
Created 3 years ago
Updated 12 hours ago

tilelang-ascend by tile-ai

0.7%
307
High-performance AI kernel development for Huawei Ascend NPUs
Created 8 months ago
Updated 1 day ago

FastVideo by hao-ai-lab

0.6%
4k
Framework for accelerated video generation
Starred by
zhuohan123:
hiyouga:
luiscape:
Created 1 year ago
Updated 16 hours ago

ThunderKittens by HazyResearch

0.1%
3k
CUDA kernel framework for fast deep learning primitives
Starred by
karpathy:
codekansas:
vincentweisser:
gakonst:
+15
Created 2 years ago
Updated 2 weeks ago

tinker-cookbook by thinking-machines-lab

1.1%
3k
Advanced LLM fine-tuning SDK and example cookbook
Starred by
ebursztein:
pcmoritz:
Jiayi-Pan:
hammer:
+8
Created 11 months ago
Updated 12 hours ago

DeepSeek-V3.2-Exp by deepseek-ai

0.1%
2k
Experimental LLM boosting long-context efficiency
Starred by
Jiayi-Pan:
merrymercy:
Created 8 months ago
Updated 6 months ago

K2-Vendor-Verifier by MoonshotAI

0.2%
575
Verifying Kimi K2 API vendor toolcall precision and reliability
Starred by
hiyouga:
t3dotgg:
Created 9 months ago
Updated 3 months ago

sglang-jax by sgl-project

1.1%
280
High-performance LLM inference engine for JAX/TPU serving
Starred by
mattjj:
froystig:
hammer:
merrymercy:
Created 10 months ago
Updated 12 hours ago

checkpoint-engine by MoonshotAI

0.2%
963
Middleware for efficient LLM weight updates during inference
Starred by
pgarbacki:
zhuohan123:
luiscape:
didierrlopes:
+3
Created 9 months ago
Updated 4 days ago

batch_invariant_ops by thinking-machines-lab

0.3%
1k
Enhance LLM inference determinism
Starred by
Edward-Sun:
ekzhang:
willccbb:
zhuohan123:
+1
Created 9 months ago
Updated 7 months ago

xtuner by InternLM

0.0%
5k
LLM fine-tuning toolkit for research
Starred by
casper-hansen:
winglian:
lysandrejik:
JustinLin610:
+2
Created 2 years ago
Updated 17 hours ago

agents.md by agentsmd

0.7%
22k
A format for guiding coding agents
Starred by
dror-weiss:
gregpr07:
transitive-bullshit:
romainhuet:
Created 9 months ago
Updated 3 months ago

aiconfigurator by ai-dynamo

1.8%
331
LLM serving configuration optimization
Starred by
pgarbacki:
Created 10 months ago
Updated 21 hours ago

axolotl by axolotl-ai-cloud

0.2%
12k
CLI tool for streamlined post-training of AI models
Starred by
tobi:
jn2clark:
beyang:
patrickvonplaten:
+26
Created 3 years ago
Updated 13 hours ago

DiffSynth-Studio by modelscope

0.1%
13k
Open-source project for diffusion model exploration
Starred by
rodrigosnader:
doriandarko:
Created 2 years ago
Updated 13 hours ago

coze-studio by coze-dev

0.3%
21k
AI agent development platform with visual tools
Created 11 months ago
Updated 1 month ago

Step3 by stepfun-ai

0%
453
Multimodal reasoning model for efficient vision-language tasks
Created 10 months ago
Updated 10 months ago

SpecForge by sgl-project

0.8%
883
Train speculative decoding models for faster inference
Starred by
merrymercy:
xiezhq-hermann:
Ying1123:
Created 1 year ago
Updated 2 days ago

LightX2V by ModelTC

0.4%
2k
Video generation inference framework for efficient synthesis
Starred by
jiamings:
Created 1 year ago
Updated 12 hours ago

chatterbox by resemble-ai

0.2%
25k
Open-source TTS model
Starred by
transitive-bullshit:
ebursztein:
gakonst:
dguido:
+7
Created 1 year ago
Updated 2 days ago

Kimi-K2 by MoonshotAI

0.1%
11k
State-of-the-art MoE language model
Starred by
krisr:
lucidrains:
merrymercy:
shizhediao:
+4
Created 11 months ago
Updated 4 months ago

gemini-cli by google-gemini

0.2%
105k
AI agent for terminal workflows
Starred by
ValentaTomas:
MagMueller:
lucidrains:
khou22:
+28
Created 1 year ago
Updated 23 hours ago

trae-agent by bytedance

0.2%
12k
LLM-powered CLI for software engineering tasks
Starred by
hammer:
chiphuyen:
hiyouga:
yiranwu0:
+3
Created 1 year ago
Updated 4 months ago

Math-Verify by huggingface

0.3%
1k
Math evaluator for LLM outputs in mathematical tasks
Starred by
shizhediao:
thomwolf:
hiyouga:
lewtun:
Created 1 year ago
Updated 5 months ago

Skills by NVIDIA-NeMo

0.6%
973
LLM skill-improvement pipelines for synthetic data generation, training, and evaluation
Starred by
winglian:
Created 2 years ago
Updated 20 hours ago

RL-Factory by Simple-Efficient

0.2%
2k
RL post-training framework for agentic learning
Starred by
didierrlopes:
Created 1 year ago
Updated 6 months ago

genai-bench by sgl-project

0%
300
LLM serving performance benchmarking
Starred by
merrymercy:
Ying1123:
Created 11 months ago
Updated 4 weeks ago

minions by HazyResearch

0.4%
1k
Communication protocol for cost-efficient LLM collaboration
Starred by
JohannesHa:
w4nderlust:
jmorganca:
mchiang0610:
Created 1 year ago
Updated 3 months ago

slime by THUDM

1.3%
6k
LLM post-training framework for RL scaling
Starred by
luiscape:
jiamings:
hammer:
pgarbacki:
+5
Created 11 months ago
Updated 15 hours ago

Hunyuan3D-2.1 by Tencent-Hunyuan

0.9%
4k
Image to 3D asset generation with PBR materials
Starred by
zhuohan123:
Created 1 year ago
Updated 7 months ago

dots.llm1 by rednote-hilab

0.2%
491
MoE model for research
Created 1 year ago
Updated 9 months ago

ROLL by alibaba

0.6%
3k
RL library for large language models
Starred by
chiphuyen:
winglian:
yiranwu0:
pcmoritz:
Created 1 year ago
Updated 18 hours ago

cosmos-reason1 by nvidia-cosmos

0.2%
950
Multimodal LLMs for physical common sense and embodied decisions
Created 1 year ago
Updated 5 days ago

torchtune by meta-pytorch

0.1%
6k
PyTorch library for LLM post-training and experimentation
Starred by
abidlabs:
lewtun:
patrickvonplaten:
JustinLin610:
+13
Created 2 years ago
Updated 1 day ago

ome by ome-projects

0.4%
464
Kubernetes operator for LLM serving
Starred by
merrymercy:
Ying1123:
Created 1 year ago
Updated 18 hours ago

unsloth by unslothai

0.5%
66k
Finetuning tool for LLMs, targeting speed and memory efficiency
Starred by
tobi:
karpathy:
alexchen4ai:
danielhanchen:
+38
Created 2 years ago
Updated 12 hours ago

RL by NVIDIA-NeMo

1.3%
2k
Scalable toolkit for efficient model reinforcement learning
Starred by
vincentweisser:
hammer:
wangshangsam:
pcmoritz:
+1
Created 1 year ago
Updated 12 hours ago

VeOmni by ByteDance-Seed

0.8%
2k
Framework for scaling multimodal model training across accelerators
Starred by
hiyouga:
JustinLin610:
Created 1 year ago
Updated 14 hours ago

MiMo by XiaomiMiMo

0.4%
2k
LLM for reasoning, pre-trained and post-trained for math/code tasks
Starred by
alexchen4ai:
WoosukKwon:
omarsar:
Created 1 year ago
Updated 1 year ago

dia by nari-labs

0.1%
19k
TTS model for ultra-realistic dialogue generation
Starred by
shimmyshimmer:
alexchen4ai:
omarsar:
codekansas:
+9
Created 1 year ago
Updated 6 months ago

SpargeAttn by thu-ml

0%
1k
Training-free sparse attention for model inference acceleration
Created 1 year ago
Updated 3 months ago

profile-data by deepseek-ai

0%
1k
Profiling data for computation-communication overlap analysis
Created 1 year ago
Updated 1 year ago

multi-swe-bench by multi-swe-bench

0.3%
338
Multilingual benchmark for LLM-powered code issue resolution
Created 1 year ago
Updated 5 months ago

aider by Aider-AI

0.5%
46k
AI pair programming in your terminal
Starred by
bcherny:
nat:
hammer:
ekzhu:
+38
Created 3 years ago
Updated 3 weeks ago

Triton-distributed by ByteDance-Seed

0.3%
1k
Distributed compiler for computation-communication overlapping, based on Triton
Starred by
antiagainst:
Created 1 year ago
Updated 1 month ago

AReaL by areal-project

0.6%
5k
Distributed RL system for LLM reasoning
Starred by
lewtun:
yiranwu0:
casper-hansen:
merrymercy:
Created 1 year ago
Updated 16 hours ago

dynamo by ai-dynamo

0.5%
7k
Inference framework for distributed generative AI model serving
Starred by
vincentweisser:
willingc:
chiphuyen:
luiscape:
+7
Created 1 year ago
Updated 12 hours ago

QwQ by QwenLM

0.2%
518
Reasoning model for complex problem-solving, based on Qwen2.5
Starred by
shimmyshimmer:
huybery:
JustinLin610:
Created 1 year ago
Updated 1 year ago

3FS by deepseek-ai

0.1%
10k
Distributed file system for AI training/inference workloads
Starred by
chiphuyen:
joewalnes:
wesm:
alexey-milovidov:
+6
Created 1 year ago
Updated 1 month ago

EPLB by deepseek-ai

0%
1k
Load balancer for expert-parallel MoE models
Starred by
parano:
comaniac:
Created 1 year ago
Updated 1 year ago

DualPipe by deepseek-ai

0.2%
3k
Pipeline parallelism algorithm for training large models
Starred by
luiscape:
JohannesHa:
Created 1 year ago
Updated 4 months ago

DeepGEMM by deepseek-ai

0.3%
7k
CUDA library for efficient FP8 GEMM kernels with fine-grained scaling
Starred by
chiphuyen:
ekzhang:
natolambert:
patrickvonplaten:
+6
Created 1 year ago
Updated 1 week ago

DeepEP by deepseek-ai

0.2%
10k
Expert-parallel communication library for MoE, targeting high-throughput and low-latency
Starred by
hammer:
parano:
JustinLin610:
CodeCreator:
+4
Created 1 year ago
Updated 1 week ago

FlashMLA by deepseek-ai

0.1%
13k
Efficient CUDA kernels for MLA decoding
Starred by
chiphuyen:
hammer:
jmorganca:
shizhediao:
+6
Created 1 year ago
Updated 1 month ago

Moonlight by MoonshotAI

0.3%
1k
MoE model and optimizer tech report
Starred by
jph00:
lucidrains:
Created 1 year ago
Updated 10 months ago

open-infra-index by deepseek-ai

0.0%
8k
AI infrastructure tools for efficient AGI development
Starred by
lattner:
vincentweisser:
hammer:
pankajroark:
+15
Created 1 year ago
Updated 1 year ago

ktransformers by kvcache-ai

0.1%
17k
Framework for LLM inference optimization experimentation
Starred by
parano:
luiscape:
patrickvonplaten:
JustinLin610:
+2
Created 1 year ago
Updated 5 days ago

skypilot by skypilot-org

0.1%
10k
Framework for cloud AI/batch jobs, unifying execution across diverse infrastructure
Starred by
karpathy:
tobi:
amin3141:
luiscape:
+24
Created 4 years ago
Updated 15 hours ago

ZhiLight by zhihu

0%
905
LLM inference engine for Llama and variants, optimized for PCIe GPUs
Starred by
hiyouga:
Created 1 year ago
Updated 2 months ago

Janus by deepseek-ai

0.1%
18k
Unified multimodal model research paper for understanding and generation
Starred by
jiamings:
omarsar:
taranjeet:
xiaofan-luan:
+4
Created 1 year ago
Updated 1 year ago

UI-TARS by bytedance

0.2%
11k
Multimodal agent for GUI interaction in virtual worlds (research paper)
Starred by
jiamings:
hugs:
jmorganca:
omarsar:
+3
Created 1 year ago
Updated 4 months ago

rtp-llm by alibaba

2.0%
1k
LLM inference engine for diverse applications
Starred by
chiphuyen:
Created 2 years ago
Updated 12 hours ago

tilelang by tile-ai

0.7%
6k
DSL for high-performance GPU/CPU kernel development (GEMM, attention, etc.)
Starred by
parano:
hiyouga:
JustinLin610:
luiscape:
+2
Created 1 year ago
Updated 1 day ago

DeepSeek-R1 by deepseek-ai

0.1%
92k
Reasoning models research paper
Starred by
shimmyshimmer:
rasbt:
transitive-bullshit:
omarsar:
+16
Created 1 year ago
Updated 11 months ago

MInference by microsoft

0.1%
1k
Framework for long-context LLM inference speedup via sparse attention
Starred by
pgarbacki:
Created 2 years ago
Updated 2 months ago

flash-linear-attention by fla-org

0.4%
5k
Efficient Torch/Triton implementations for linear attention models
Starred by
didierrlopes:
hiyouga:
xiezhq-hermann:
yang-song:
+9
Created 2 years ago
Updated 1 day ago

MiniMax-01 by MiniMax-AI

0.1%
3k
Large language & vision-language models based on linear attention
Starred by
sxyu:
transitive-bullshit:
omarsar:
hiyouga:
+2
Created 1 year ago
Updated 11 months ago

dash-infer by modelscope

0%
273
LLM inference engine for optimized performance across diverse hardware
Created 2 years ago
Updated 10 months ago

smoothquant by mit-han-lab

0.4%
2k
Post-training quantization research paper for large language models
Starred by
zhiyuan8:
gakonst:
forresti:
Edward-Sun:
+1
Created 3 years ago
Updated 1 year ago

picotron by huggingface

0.4%
2k
Minimalist distributed training framework for educational use
Starred by
karpathy:
transitive-bullshit:
srush:
pgarbacki:
+3
Created 1 year ago
Updated 9 months ago

hqq by dropbox

0.2%
943
Model quantizer for fast, accurate post-training quantization, skipping calibration
Starred by
danielhanchen:
winglian:
hiyouga:
osanseviero:
Created 2 years ago
Updated 3 months ago

torchtitan by pytorch

0.2%
5k
PyTorch platform for generative AI model training research
Starred by
karpathy:
WoosukKwon:
pgarbacki:
lewtun:
+12
Created 2 years ago
Updated 13 hours ago

LightLLM by ModelTC

0.2%
4k
Python framework for LLM inference and serving
Starred by
chiphuyen:
pgarbacki:
JustinLin610:
winglian:
+6
Created 2 years ago
Updated 17 hours ago

cline by cline

0.5%
63k
VS Code extension for autonomous coding agent
Starred by
didierrlopes:
swyxio:
snowzurfer:
ishaan-jaff:
+26
Created 1 year ago
Updated 15 hours ago

DeepSeek-V3 by deepseek-ai

0.1%
104k
MoE language model research paper with 671B total parameters
Starred by
tobi:
shimmyshimmer:
jiamings:
syrusakbary:
+13
Created 1 year ago
Updated 9 months ago

infinity by michaelfeil

0.1%
3k
REST API for high-throughput, low-latency embedding and reranking
Starred by
luiscape:
ishaan-jaff:
ankane:
jn2clark:
+8
Created 2 years ago
Updated 2 months ago

Star-Attention by NVIDIA

0%
394
PyTorch code for efficient LLM inference on long sequences
Created 1 year ago
Updated 11 months ago

cudnn-frontend by NVIDIA

0.5%
844
C++ and Python interface for NVIDIA cuDNN and high-performance kernels
Starred by
hammer:
antiagainst:
Created 5 years ago
Updated 22 hours ago

Qwen3-Coder by QwenLM

0.2%
17k
Code LLM for code completion, generation, and assistant use cases
Starred by
hugs:
victortaelin:
luiscape:
cournape:
+8
Created 2 years ago
Updated 2 months ago

xgrammar by mlc-ai

0.6%
2k
Library for efficient structured generation
Starred by
JustinLin610:
merrymercy:
ogabrielluiz:
youkaichao:
+5
Created 1 year ago
Updated 1 day ago

prompt-lookup-decoding by apoorvumang

0%
610
Decoding method for faster LLM generation
Starred by
stas00:
jph00:
casper-hansen:
ggerganov:
Created 2 years ago
Updated 1 year ago

verl by verl-project

0.5%
22k
RL training library for LLMs
Starred by
amin3141:
WoosukKwon:
hammer:
yiranwu0:
+15
Created 1 year ago
Updated 14 hours ago

duo-attention by mit-han-lab

0%
541
Framework for efficient long-context LLM inference
Created 1 year ago
Updated 1 year ago

corenet by apple

0.0%
7k
DNN toolkit for training standard and novel models
Starred by
transitive-bullshit:
omarsar:
t3dotgg:
hammer:
+5
Created 2 years ago
Updated 8 months ago

TensorRT by NVIDIA

0.2%
13k
SDK for accelerated deep learning inference on NVIDIA GPUs
Starred by
luiscape:
transitive-bullshit:
codekansas:
casper-hansen:
+4
Created 7 years ago
Updated 1 week ago

tensorrtllm_backend by triton-inference-server

0.1%
935
Triton backend for serving TensorRT-LLM models
Starred by
NikolaBorisov:
guberti:
Ying1123:
tuhins:
Created 2 years ago
Updated 2 days ago

Pai-Megatron-Patch by alibaba

0%
2k
Training toolkit for LLMs & VLMs using Megatron
Starred by
Jiayi-Pan:
Created 2 years ago
Updated 5 months ago

whisper by openai

0.9%
102k
Speech recognition model for multilingual transcription/translation
Starred by
bcherny:
karpathy:
ekzhu:
gregpr07:
+42
Created 3 years ago
Updated 1 month ago

TensorRT-LLM by NVIDIA

0.3%
14k
LLM inference optimization SDK for NVIDIA GPUs
Starred by
beyang:
hammer:
shizhediao:
luiscape:
+18
Created 2 years ago
Updated 12 hours ago

EAGLE by SafeAILab

0.4%
2k
Speculative decoding research paper for faster LLM inference
Starred by
shizhediao:
philschmid:
pgarbacki:
JustinLin610:
+5
Created 2 years ago
Updated 3 months ago

Nanoflow by efeslab

0.2%
964
LLM serving framework for high throughput
Starred by
WoosukKwon:
Ying1123:
zhuohan123:
Created 1 year ago
Updated 2 months ago

truss by basetenlabs

0.2%
1k
Model deployment tool for productionizing AI/ML models
Starred by
apsdehal:
ogabrielluiz:
hammer:
pankajroark:
+4
Created 3 years ago
Updated 23 hours ago

mscclpp by microsoft

0.4%
532
GPU-driven communication stack for scalable AI applications
Starred by
jrk:
WoosukKwon:
Created 3 years ago
Updated 15 hours ago

ao by pytorch

0.3%
3k
PyTorch library for quantization and sparsity in training/inference
Starred by
danielhanchen:
shimmyshimmer:
parano:
willccbb:
+11
Created 2 years ago
Updated 1 day ago

simple-evals by openai

0.0%
5k
Lightweight library for evaluating language models
Starred by
winglian:
hammer:
patrickvonplaten:
simonw:
+15
Created 2 years ago
Updated 1 month ago

sglang by sgl-project

0.6%
29k
Fast serving framework for LLMs and vision language models
Starred by
amin3141:
shimmyshimmer:
beyang:
samlambert:
+35
Created 2 years ago
Updated 12 hours ago

QuaRot by spcl

0%
513
Code for a NeurIPS 2024 research paper on LLM quantization
Starred by
jph00:
Created 2 years ago
Updated 1 year ago

FlagGems by flagos-ai

0.3%
1k
Operator library for LLM training/inference, implemented in Triton
Created 2 years ago
Updated 12 hours ago

ring-attention-pytorch by lucidrains

0%
549
Pytorch impl of Ring Attention for near-infinite context
Starred by
sxyu:
vincentweisser:
Created 2 years ago
Updated 1 year ago

Mooncake by kvcache-ai

0.8%
6k
Research paper on a disaggregated architecture for LLM serving
Starred by
jiamings:
luiscape:
merrymercy:
WoosukKwon:
+2
Created 1 year ago
Updated 12 hours ago

DeepSeek-V2 by deepseek-ai

0.0%
5k
MoE language model for research/API use
Starred by
gakonst:
jiamings:
Jiayi-Pan:
Created 2 years ago
Updated 1 year ago

llama3 by meta-llama

0.0%
29k
*Deprecated* minimal example for loading and running Llama 3 models
Starred by
tobi:
mckaywrigley:
osanseviero:
simonw:
+13
Created 2 years ago
Updated 1 year ago

mlx by ml-explore

0.9%
27k
Array framework for machine learning on Apple silicon
Starred by
geohot:
karpathy:
ekzhang:
lysandrejik:
+38
Created 2 years ago
Updated 1 day ago

flashinfer by flashinfer-ai

0.4%
6k
Kernel library for LLM serving
Starred by
joker-eph:
chiphuyen:
hammer:
JustinLin610:
+12
Created 2 years ago
Updated 17 hours ago

cutlass by NVIDIA

0.2%
10k
CUDA C++ and Python DSLs for high-performance linear algebra
Starred by
luiscape:
pgarbacki:
pankajroark:
tridao:
+23
Created 8 years ago
Updated 1 day ago

flash-attention by Dao-AILab

0.2%
24k
Fast, memory-efficient attention implementation
Starred by
karpathy:
Jiayi-Pan:
zhiyuan8:
alexchen4ai:
+31
Created 4 years ago
Updated 2 days ago

Medusa by FasterDecoding

0.1%
3k
Framework for accelerating LLM generation using multiple decoding heads
Starred by
osanseviero:
parano:
luiscape:
chiphuyen:
+6
Created 2 years ago
Updated 1 year ago

lmdeploy by InternLM

0.2%
8k
Toolkit for LLM compression, deployment, and serving
Starred by
shimmyshimmer:
wsxiaoys:
luiscape:
jn2clark:
+8
Created 3 years ago
Updated 1 day ago
Feedback? Help us improve.