Pankaj Gupta

Cofounder of Baseten

Starred Projects (9)

open-infra-index by deepseek-ai

AI infrastructure tools for efficient AGI development

lattner:

vincentweisser:

hammer:

didierrlopes:

Created 10 months ago

Updated 8 months ago

sglang by sgl-project

Fast serving framework for LLMs and vision language models

shimmyshimmer:

beyang:

samlambert:

ebursztein:

Created 2 years ago

Updated 14 hours ago

DejaVu by FMInference

Research paper on efficient LLM inference via contextual sparsity

Created 2 years ago

Updated 1 year ago

megablocks by databricks

Lightweight library for mixture-of-experts (MoE) training

mateiz:

hiyouga:

jfrankle:

CodeCreator:

Created 3 years ago

Updated 6 months ago

MixtralKit by open-compass

Toolkit for inference/evaluation of Mistral AI's 'mixtral-8x7b-32kseqlen'

awni:

Created 2 years ago

Updated 2 years ago

TensorRT-LLM by NVIDIA

LLM inference optimization SDK for NVIDIA GPUs

beyang:

hammer:

zhyncs:

shizhediao:

Created 2 years ago

Updated 16 hours ago

mistral-inference by mistralai

Inference library for Mistral models

vincentweisser:

parano:

spartee:

transitive-bullshit:

Created 2 years ago

Updated 1 month ago

vllm by vllm-project

LLM serving engine for high-throughput, memory-efficient inference

karpathy:

clmnt:

tobi:

danielhanchen:

Created 2 years ago

Updated 14 hours ago

truss by basetenlabs

Model deployment tool for productionizing AI/ML models

apsdehal:

zhyncs:

ogabrielluiz:

hammer:

Created 3 years ago

Updated 2 days ago

Feedback? Help us improve.