xiezhq-hermann avatar

Zhiqiang Xie

@xiezhq-hermann

Author of SGLang

GitHubView on GitHub

Starred Projects (40)

Starred by Shishir Patil Shishir Patil(Author of BFCL, Gorilla) and Chip Huyen Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems).

tokasaurus by ScalingIntelligence

1.3%
386
LLM inference engine for high-throughput workloads
created 1 month ago
updated 3 days ago
Starred by Carol Willing Carol Willing(Core Contributor to CPython, Jupyter), Chip Huyen Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), and
3 more.

dynamo by ai-dynamo

1.1%
5k
Inference framework for distributed generative AI model serving
created 5 months ago
updated 13 hours ago
Starred by David Cournapeau David Cournapeau(Author of scikit-learn), Stas Bekman Stas Bekman(Author of Machine Learning Engineering Open Book; Research Engineer at Snowflake), and
3 more.

lectures by gpu-mode

0.4%
5k
Lecture series for GPU-accelerated computing
created 1 year ago
updated 1 month ago
Starred by Chip Huyen Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), Robert Stojnic Robert Stojnic(Creator of Papers with Code), and
5 more.

swarm by openai

0.3%
20k
Multi-agent orchestration framework for lightweight agent coordination
created 1 year ago
updated 4 months ago
Starred by Stas Bekman Stas Bekman(Author of Machine Learning Engineering Open Book; Research Engineer at Snowflake).

veScale by volcengine

0.1%
839
PyTorch-native framework for LLM training
created 1 year ago
updated 3 weeks ago
Starred by Tobi Lutke Tobi Lutke(Cofounder of Shopify), Stas Bekman Stas Bekman(Author of Machine Learning Engineering Open Book; Research Engineer at Snowflake), and
20 more.

guidance by guidance-ai

0.1%
21k
Guidance is a programming paradigm for steering LLMs
created 2 years ago
updated 23 hours ago
Starred by Travis Fischer Travis Fischer(Founder of Agentic), Chip Huyen Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), and
3 more.

mistral-inference by mistralai

0.1%
10k
Inference library for Mistral models
created 1 year ago
updated 4 months ago
Starred by John Resig John Resig(Author of jQuery; Chief Software Architect at Khan Academy), Georgios Konstantopoulos Georgios Konstantopoulos(CTO, General Partner at Paradigm), and
6 more.

milvus by milvus-io

0.4%
36k
Cloud-native vector database for scalable ANN search
created 5 years ago
updated 18 hours ago
Feedback? Help us improve.