youkaichao avatar

youkaichao

Core Maintainer of vLLM

GitHubView on GitHub

Starred Projects (24)

Starred by Chip Huyen Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), Elvis Saravia Elvis Saravia(Founder of DAIR.AI), and
13 more.

markitdown by microsoft

1.4%
72k
Python tool for converting files to Markdown for LLM text analysis
created 9 months ago
updated 4 days ago
Starred by Chip Huyen Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), Andreas Jansson Andreas Jansson(Cofounder of Replicate), and
2 more.

lm-format-enforcer by noamgat

0.3%
2k
Format enforcer for language model outputs (JSON, regex, etc.)
created 1 year ago
updated 1 week ago
Starred by Vincent Weisser Vincent Weisser(Cofounder of Prime Intellect), Chip Huyen Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), and
9 more.

AutoGPTQ by AutoGPTQ

0.1%
5k
LLM quantization package using GPTQ algorithm
created 2 years ago
updated 4 months ago
Starred by Andrej Karpathy Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n), Clement Delangue Clement Delangue(Cofounder of Hugging Face), and
41 more.

vllm by vllm-project

1.4%
55k
LLM serving engine for high-throughput, memory-efficient inference
created 2 years ago
updated 19 hours ago
Starred by David Cournapeau David Cournapeau(Author of scikit-learn), Chip Huyen Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), and
8 more.

llm-numbers by ray-project

0.1%
4k
LLM developer's reference for key numbers
created 2 years ago
updated 1 year ago
Starred by Chip Huyen Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), Shizhe Diao Shizhe Diao(Research Scientist at NVIDIA; Author of LMFlow), and
3 more.

tianshou by thu-ml

0.3%
9k
PyTorch RL library for algorithm development and application
created 7 years ago
updated 1 week ago
Feedback? Help us improve.