Pankaj Gupta

Cofounder of Baseten

Starred Projects (11)

cutlass by NVIDIA

CUDA C++ and Python DSLs for high-performance linear algebra

pgarbacki:

tridao:

chiphuyen:

joker-eph:

Created 8 years ago

Updated 3 days ago

cccl by NVIDIA

CUDA C++ building blocks for high-performance GPU computing

chiphuyen:

hammer:

Created 5 years ago

Updated 1 day ago

open-infra-index by deepseek-ai

AI infrastructure tools for efficient AGI development

lattner:

vincentweisser:

hammer:

didierrlopes:

Created 1 year ago

Updated 11 months ago

sglang by sgl-project

Fast serving framework for LLMs and vision language models

amin3141:

shimmyshimmer:

beyang:

samlambert:

Created 2 years ago

Updated 1 day ago

DejaVu by FMInference

Research paper on efficient LLM inference via contextual sparsity

Created 2 years ago

Updated 2 years ago

megablocks by databricks

Lightweight library for mixture-of-experts (MoE) training

mateiz:

hiyouga:

jfrankle:

CodeCreator:

Created 3 years ago

Updated 2 weeks ago

MixtralKit by open-compass

Toolkit for inference/evaluation of Mistral AI's 'mixtral-8x7b-32kseqlen'

awni:

Created 2 years ago

Updated 2 years ago

TensorRT-LLM by NVIDIA

LLM inference optimization SDK for NVIDIA GPUs

beyang:

hammer:

zhyncs:

shizhediao:

Created 2 years ago

Updated 1 day ago

mistral-inference by mistralai

Inference library for Mistral models

vincentweisser:

parano:

spartee:

transitive-bullshit:

Created 2 years ago

Updated 1 month ago

vllm by vllm-project

LLM serving engine for high-throughput, memory-efficient inference

karpathy:

clmnt:

tobi:

willingc:

Created 3 years ago

Updated 23 hours ago

truss by basetenlabs

Model deployment tool for productionizing AI/ML models

apsdehal:

zhyncs:

ogabrielluiz:

hammer:

Created 3 years ago

Updated 1 day ago

Feedback? Help us improve.