Saining Xie

Professor at NYU

Starred Projects (35)

cambrian-s by cambrian-mllm

Multimodal LLM for advanced video spatial understanding

Created 3 months ago

Updated 1 month ago

RAE by bytetriper

High-fidelity image synthesis via Representation Autoencoders

Created 4 months ago

Updated 1 week ago

metaquery by facebookresearch

MetaQueries enable multimodal transfer learning

Created 7 months ago

Updated 3 months ago

MetaCLIP by facebookresearch

CLIP data curation and training code for MetaCLIP research paper

jn2clark:

simonw:

osanseviero:

Created 2 years ago

Updated 2 months ago

FlashMLA by deepseek-ai

Efficient CUDA kernels for MLA decoding

chiphuyen:

hammer:

jmorganca:

shizhediao:

Created 11 months ago

Updated 1 week ago

oumi by oumi-ai

Open-source platform for end-to-end foundation model lifecycle

hammer:

transitive-bullshit:

omarsar:

hiyouga:

Created 1 year ago

Updated 3 days ago

mochi by genmoai

Video generation model

transitive-bullshit:

flaque:

zhuohan123:

parano:

Created 1 year ago

Updated 2 months ago

Pyramid-Flow by jy0205

Video generation method based on flow matching

jiamings:

Created 1 year ago

Updated 1 year ago

cambrian by cambrian-mllm

Multimodal LLM research paper with vision-centric design

hammer:

infwinston:

hiyouga:

rwightman:

Created 1 year ago

Updated 2 months ago

Grendel-GS by nyu-systems

Research paper on distributed training system for 3D Gaussian Splatting

Created 2 years ago

Updated 4 months ago

vstar by penghao-wu

PyTorch implementation for a multimodal LLM research paper

Created 2 years ago

Updated 2 years ago

PixArt-alpha by PixArt-alpha

Fast text-to-image synthesis with Diffusion Transformers

patrickvonplaten:

Created 2 years ago

Updated 1 year ago

Awesome-Multimodal-Large-Language-Models by BradyFU

MLLM resource list, covering papers, datasets, and benchmarks

hugs:

AlexCheema:

vincentweisser:

jinze1994:

Created 2 years ago

Updated 1 month ago

Grounded-Segment-Anything by IDEA-Research

Framework for open-world visual tasks, combining multiple models

ishaan-jaff:

jiamings:

codekansas:

patrickvonplaten:

Created 2 years ago

Updated 1 year ago

X-Decoder by microsoft

Generalized decoding model for pixel, image, and language tasks

jwyang:

jiamings:

osanseviero:

haotian-liu:

Created 3 years ago

Updated 2 years ago

zero123 by cvlab-columbia

Research paper for zero-shot one image to 3D object generation

snowzurfer:

Created 2 years ago

Updated 2 years ago

nanoGPT by karpathy

Minimalist repo for training/finetuning GPT models

tobi:

danielgross:

chiphuyen:

ankane:

Created 3 years ago

Updated 2 months ago

ControlNet by lllyasviel

Neural network structure for adding conditional control to diffusion models

vincentweisser:

codekansas:

louisgv:

ogabrielluiz:

Created 3 years ago

Updated 1 year ago

DiT by facebookresearch

PyTorch implementation for diffusion models with transformers (DiT)

shizhediao:

Edward-Sun:

patrickvonplaten:

aangelopoulos:

Created 3 years ago

Updated 1 year ago

img2dataset by rom1504

CLI tool for creating large image datasets from URLs

winglian:

aangelopoulos:

lucidrains:

jn2clark:

Created 4 years ago

Updated 3 months ago

SLIP by facebookresearch

Research paper code for self-supervised language-image pre-training

chenlin9:

rwightman:

Created 4 years ago

Updated 3 years ago

bigbird by google-research

Sparse-attention transformer extends BERT-like models to longer sequences

shizhediao:

Created 5 years ago

Updated 3 years ago

pytorch_block_sparse by huggingface

PyTorch extension for block-sparse linear layers

clmnt:

parasj:

lucidrains:

lewtun:

Created 5 years ago

Updated 5 years ago

distiller by IntelLabs

Neural network compression research toolkit

xiezhq-hermann:

hanlint:

luiscape:

apsdehal:

Created 7 years ago

Updated 2 years ago

blocksparse by openai

TensorFlow ops/GPU kernels for block-sparse matrix multiplication and convolution

aravindsrinivas:

gakonst:

shizhediao:

jamesr66a:

Created 8 years ago

Updated 2 years ago

sngan_projection by pfnet-research

Chainer implementation for conditional image generation research

jongwook:

jiamings:

jwyang:

PiotrDabkowski:

Created 8 years ago

Updated 6 years ago

lectures by oxford-cs-deepnlp-2017

NLP course (lecture slides) for deep learning approaches to language

bcherny:

stas00:

eddyxu:

simonw:

Created 9 years ago

Updated 2 years ago

tensorpack by tensorpack

Neural net training interface on TensorFlow

parasj:

ppwwyyxx:

chuanli11:

nottombrown:

Created 10 years ago

Updated 2 years ago

Neural-Photo-Editor by ajbrock

Photo editor for generative neural network research

bcherny:

cvalenzuela:

agermanidis:

jiamings:

Created 9 years ago

Updated 8 years ago

pixel-cnn by openai

TensorFlow implementation for PixelCNN++ research paper

aravindsrinivas:

evhub:

jinze1994:

omarsar:

Created 9 years ago

Updated 6 years ago

openai-gemm by openai

GEMM kernels for single/half precision

jrk:

jiamings:

deshraj:

mattjj:

Created 9 years ago

Updated 2 years ago

universe by openai

Deprecated platform for measuring/training AI across diverse applications

Jiayi-Pan:

codekansas:

junxiaosong:

evhub:

Created 9 years ago

Updated 7 years ago

speech-to-text-wavenet by buriburisuri

Speech recognition using WaveNet in TensorFlow

parano:

cvalenzuela:

infwinston:

transitive-bullshit:

Created 9 years ago

Updated 4 years ago

tensorflow by tensorflow

Open-source ML framework

norvig:

aravindsrinivas:

karpathy:

bcherny:

Created 10 years ago

Updated 1 day ago

rcnn by rbgirshick

Object detection system using CNNs and region proposals

karpathy:

deshraj:

vnivargi:

jwyang:

Created 12 years ago

Updated 8 years ago

Feedback? Help us improve.