SourcePulse logoX2,142
HomeBrowse all repos
pankajroark avatar

Pankaj Gupta

Cofounder of Baseten

GitHubX

Starred Projects (9)

open-infra-index by deepseek-ai

0.1%
8k
AI infrastructure tools for efficient AGI development
Starred by
lattner:
vincentweisser:
hammer:
didierrlopes:
+15
Created 6 months ago
Updated 4 months ago

sglang by sgl-project

1.2%
18k
Fast serving framework for LLMs and vision language models
Starred by
samlambert:
ebursztein:
philschmid:
flaque:
+32
Created 1 year ago
Updated 14 hours ago

DejaVu by FMInference

0.6%
336
Research paper on efficient LLM inference via contextual sparsity
Created 2 years ago
Updated 1 year ago

megablocks by databricks

0.6%
1k
Lightweight library for mixture-of-experts (MoE) training
Starred by
mateiz:
hiyouga:
jfrankle:
CodeCreator:
+15
Created 2 years ago
Updated 2 months ago

MixtralKit by open-compass

0%
769
Toolkit for inference/evaluation of Mistral AI's 'mixtral-8x7b-32kseqlen'
Starred by
awni:
Created 1 year ago
Updated 1 year ago

TensorRT-LLM by NVIDIA

0.5%
12k
LLM inference optimization SDK for NVIDIA GPUs
Starred by
hammer:
zhyncs:
shizhediao:
luiscape:
+17
Created 2 years ago
Updated 14 hours ago

mistral-inference by mistralai

0.1%
10k
Inference library for Mistral models
Starred by
vincentweisser:
parano:
transitive-bullshit:
JustinLin610:
+7
Created 2 years ago
Updated 6 months ago

vllm by vllm-project

1.1%
58k
LLM serving engine for high-throughput, memory-efficient inference
Starred by
karpathy:
clmnt:
tobi:
danielhanchen:
+55
Created 2 years ago
Updated 14 hours ago

truss by basetenlabs

0.2%
1k
Model deployment tool for productionizing AI/ML models
Starred by
apsdehal:
zhyncs:
ogabrielluiz:
hammer:
+4
Created 3 years ago
Updated 1 day ago
Feedback? Help us improve.