Jiaming Song

Chief Scientist at Luma AI

Starred Projects (213)

Helios by PKU-YuanGroup

Breakthrough in real-time long video generation

Created 1 week ago

Updated 1 day ago

vla-scratch by EGalahad

Performant stack for Vision-Language-Action model training and serving

Created 2 months ago

Updated 1 month ago

RealtimeSTT by KoljaB

Speech-to-text library for realtime applications

chiphuyen:

transitive-bullshit:

Created 2 years ago

Updated 8 months ago

ten-framework by TEN-framework

Open-source framework for multimodal AI agents

omarsar:

Created 1 year ago

Updated 17 hours ago

Qwen3-TTS by QwenLM

Powerful speech generation models for diverse applications

Created 1 month ago

Updated 1 month ago

planning-with-files by OthmanAdi

Persistent markdown planning for AI agents

dguido:

transitive-bullshit:

jlukic:

Created 2 months ago

Updated 2 days ago

happy by slopus

Mobile client for Claude Code

t3dotgg:

simonw:

Created 7 months ago

Updated 1 week ago

presenton by presenton

AI presentation generator and API

Created 10 months ago

Updated 17 hours ago

MiMo-Audio by XiaomiMiMo

Audio language models excel at few-shot learning and generalization

Created 5 months ago

Updated 1 week ago

Automodel by NVIDIA-NeMo

PyTorch-native SPMD library for LLM/VLM training

hammer:

Created 9 months ago

Updated 21 hours ago

bark by suno-ai

Generative audio model for realistic speech and sound effects

tobi:

pgarbacki:

chiphuyen:

tjbck:

Created 2 years ago

Updated 1 year ago

poetiq-arc-agi-solver by poetiq-ai

Advanced reasoning solver for abstract intelligence benchmarks

torantulino:

transitive-bullshit:

Created 4 months ago

Updated 2 months ago

slime by THUDM

LLM post-training framework for RL scaling

luiscape:

hammer:

pgarbacki:

pcmoritz:

Created 8 months ago

Updated 18 hours ago

higgs-audio by boson-ai

Expressive text-to-audio generation model

alexchen4ai:

hiyouga:

Created 7 months ago

Updated 1 month ago

fish-speech by fishaudio

Open-source TTS for multilingual speech synthesis

transitive-bullshit:

chiphuyen:

parano:

merrymercy:

Created 2 years ago

Updated 21 hours ago

FlashVSR by OpenImagingLab

Diffusion-based framework for real-time streaming video super-resolution

Created 5 months ago

Updated 2 months ago

RLinf by RLinf

Reinforcement learning infrastructure for agentic AI

Created 7 months ago

Updated 22 hours ago

gated_attention by qiuzh20

Gated attention for LLMs: Non-linearity, sparsity, and attention-sink-free

hammer:

Created 10 months ago

Updated 2 months ago

production-stack by vllm-project

Reference stack for production vLLM deployment on Kubernetes

chiphuyen:

philschmid:

Created 1 year ago

Updated 1 day ago

LongLive by NVlabs

Generate long videos interactively in real-time

Created 5 months ago

Updated 2 weeks ago

SRPO by Tencent-Hunyuan

Diffusion model fine-tuning aligned with human preference

Created 6 months ago

Updated 2 weeks ago

Mooncake by kvcache-ai

Research paper on a disaggregated architecture for LLM serving

luiscape:

merrymercy:

WoosukKwon:

hiyouga:

Created 1 year ago

Updated 16 hours ago

LightX2V by ModelTC

Video generation inference framework for efficient synthesis

zhyncs:

Created 11 months ago

Updated 1 day ago

UI-TARS by bytedance

Multimodal agent for GUI interaction in virtual worlds (research paper)

hugs:

jmorganca:

zhyncs:

omarsar:

Created 1 year ago

Updated 1 month ago

DanceGRPO by XueZeyue

Unified RL framework for visual generation

Created 10 months ago

Updated 4 months ago

ART by OpenPipe

RL library for training LLM agents via GRPO

swyxio:

rotemweiss57:

lewtun:

luiscape:

Created 1 year ago

Updated 1 day ago

flow_grpo by yifan123

RL for training flow matching models

Created 10 months ago

Updated 4 months ago

delayed-streams-modeling by kyutai-labs

Streaming multimodal sequence-to-sequence learning

patrickvonplaten:

LaurentMazare:

Created 9 months ago

Updated 1 month ago

nano-vllm by GeeeekExplorer

Lightweight vLLM implementation from scratch

jrk:

ekzhang:

WoosukKwon:

luiscape:

Created 9 months ago

Updated 4 months ago

chatterbox by resemble-ai

Open-source TTS model

transitive-bullshit:

ebursztein:

gakonst:

zhyncs:

Created 10 months ago

Updated 4 days ago

Bagel by ByteDance-Seed

Unified multimodal foundation model

Created 11 months ago

Updated 4 months ago

SkyReels-V2 by SkyworkAI

Film generation model for infinite-length videos using diffusion forcing

sxyu:

dror-weiss:

Created 11 months ago

Updated 1 month ago

MAGI-1 by SandAI-org

Video generation model using autoregressive chunk-wise denoising

Created 10 months ago

Updated 8 months ago

Orpheus-TTS by canopyai

Open-source TTS for human-sounding speech, built on Llama-3b

chiphuyen:

shimmyshimmer:

Created 1 year ago

Updated 3 months ago

pipecat by pipecat-ai

Open-source framework for building real-time voice and multimodal conversational AI agents

parano:

nirga:

hammer:

transitive-bullshit:

Created 2 years ago

Updated 1 day ago

Janus by deepseek-ai

Unified multimodal model research paper for understanding and generation

omarsar:

taranjeet:

zhyncs:

xiaofan-luan:

Created 1 year ago

Updated 1 year ago

Wan2.1 by Wan-Video

Video foundation model for text-to-video, image-to-video, and video editing

luiscape:

shizhediao:

jn2clark:

hiyouga:

Created 1 year ago

Updated 1 week ago

open-infra-index by deepseek-ai

AI infrastructure tools for efficient AGI development

lattner:

vincentweisser:

hammer:

pankajroark:

Created 1 year ago

Updated 10 months ago

Curator by NVIDIA-NeMo

Data curation toolkit for LLMs

hammer:

shizhediao:

nikiparmar:

Created 2 years ago

Updated 1 day ago

MMAudio by hkchengrex

Synthesize high-quality audio from video and text

Created 1 year ago

Updated 2 weeks ago

Megatron-LM by NVIDIA

Framework for training transformer models at scale

chiphuyen:

gravicle:

alexchen4ai:

parasj:

Created 7 years ago

Updated 17 hours ago

DeepSeek-V3 by deepseek-ai

MoE language model research paper with 671B total parameters

tobi:

shimmyshimmer:

syrusakbary:

ogabrielluiz:

Created 1 year ago

Updated 6 months ago

ai-toolkit by ostris

Training toolkit for finetuning diffusion models

chiphuyen:

hammer:

luiscape:

ogabrielluiz:

Created 2 years ago

Updated 3 days ago

HunyuanVideo by Tencent-Hunyuan

PyTorch code for video generation research

sxyu:

merrymercy:

didierrlopes:

Created 1 year ago

Updated 3 months ago

LTX-Video by Lightricks

DiT-based video generation model for high-quality, real-time video creation

ogabrielluiz:

sxyu:

jn2clark:

Created 1 year ago

Updated 2 months ago

LLM-Research-Scripts by harishsg993010

Code and dataset for LLM experimentation

philschmid:

Created 1 year ago

Updated 1 year ago

mochi by genmoai

Video generation model

transitive-bullshit:

flaque:

s9xie:

zhuohan123:

Created 1 year ago

Updated 4 months ago

Pyramid-Flow by jy0205

Video generation method based on flow matching

s9xie:

Created 1 year ago

Updated 1 year ago

Emu3 by baaivision

Multimodal model for vision-language understanding and generation

pgarbacki:

andreasjansson:

Created 1 year ago

Updated 2 months ago

OmniGen by VectorSpaceLab

Image generation model for multimodal prompts

Created 1 year ago

Updated 3 months ago

Lumina-mGPT by Alpha-VLLM

Multimodal autoregressive model for vision and language tasks

Created 1 year ago

Updated 4 months ago

LLaMA-Adapter by OpenGVLab

Efficient fine-tuning for instruction-following LLaMA models

chiphuyen:

hammer:

pgarbacki:

teknium1:

Created 3 years ago

Updated 2 years ago

flux by black-forest-labs

Inference code for FLUX image generation & editing models

karpathy:

ekzhang:

omarsar:

ogabrielluiz:

Created 1 year ago

Updated 7 months ago

ao by pytorch

PyTorch library for quantization and sparsity in training/inference

danielhanchen:

shimmyshimmer:

parano:

willccbb:

Created 2 years ago

Updated 20 hours ago

Adam-mini by zyushun

PyTorch implementation of Adam-mini optimizer from a research paper

winglian:

Created 1 year ago

Updated 10 months ago

Long-CLIP by beichenzbc

Research paper code for extending CLIP's text input length

jn2clark:

Created 2 years ago

Updated 1 year ago

segmoe by segmind

Framework for dynamic Stable Diffusion Mixture of Experts, no training needed

Created 2 years ago

Updated 1 year ago

Qwen3 by QwenLM

Large language model series by Qwen team, Alibaba Cloud

teetone:

vincentweisser:

ggerganov:

sxyu:

Created 2 years ago

Updated 2 months ago

InstantID by instantX-research

ID-Preserving generation research paper using a single image

robinjhuang:

transitive-bullshit:

Created 2 years ago

Updated 1 year ago

LISA by JIA-Lab-research

Reasoning segmentation assistant via LLM

Created 2 years ago

Updated 1 year ago

DeepSeek-V2 by deepseek-ai

MoE language model for research/API use

gakonst:

zhyncs:

Jiayi-Pan:

Created 1 year ago

Updated 1 year ago

einx by fferflo

Tensor operation library using Einstein-inspired notation

awni:

patrick-kidger:

froystig:

hammer:

Created 2 years ago

Updated 3 days ago

matmulfreellm by ridgerchu

MatMul-free language models

tobi:

karpathy:

winglian:

carlosejimenez:

Created 1 year ago

Updated 3 months ago

xlstm by NX-AI

Recurrent neural network architecture based on the original LSTM

rwightman:

luiscape:

osanseviero:

Created 1 year ago

Updated 4 months ago

Lumina-T2X by Alpha-VLLM

Framework for text-to-any modality generation

sxyu:

robinjhuang:

Created 1 year ago

Updated 1 year ago

ThunderKittens by HazyResearch

CUDA kernel framework for fast deep learning primitives

karpathy:

codekansas:

vincentweisser:

zhyncs:

Created 2 years ago

Updated 1 day ago

Omost by lllyasviel

Image composer using LLMs to generate code for image creation

omarsar:

doriandarko:

cbh123:

robinjhuang:

Created 1 year ago

Updated 1 year ago

EasyContext by jzhang38

Recipes for language model context length extrapolation to 1M tokens

hiyouga:

MishaLaskin:

pgarbacki:

mlabonne:

Created 1 year ago

Updated 1 year ago

long-context-attention by feifeibear

Unified sequence parallel attention for long context LLM training/inference

vincentweisser:

hiyouga:

winglian:

Created 1 year ago

Updated 1 month ago

autofaiss by criteo

Auto indexer for k-NN similarity search using Faiss

jph00:

simonw:

alexey-milovidov:

generall:

Created 4 years ago

Updated 4 months ago

MoneyPrinterTurbo by harry0703

AI tool for one-click short video generation from text prompts

chiphuyen:

Created 2 years ago

Updated 2 months ago

torchtune by meta-pytorch

PyTorch library for LLM post-training and experimentation

zhyncs:

lewtun:

patrickvonplaten:

JustinLin610:

Created 2 years ago

Updated 1 day ago

MiraData by mira-space

Video dataset for long video generation research

Created 1 year ago

Updated 1 year ago

VAR by FoundationVision

Image generation research paper using visual autoregressive modeling

chiphuyen:

pgarbacki:

Created 1 year ago

Updated 4 months ago

JetMoE by myshell-ai

Open-sourced LLM reaching LLaMA2 performance with limited resources

chiphuyen:

thomwolf:

jwyang:

AlexCheema:

Created 1 year ago

Updated 1 year ago

megablocks by databricks

Lightweight library for mixture-of-experts (MoE) training

mateiz:

hiyouga:

jfrankle:

CodeCreator:

Created 3 years ago

Updated 8 months ago

DeepSeek-VL by deepseek-ai

Vision-language model for real-world applications (research paper)

jn2clark:

Created 2 years ago

Updated 1 year ago

Sequoia by Infini-AI-Lab

Tree-based speculative decoding algorithm (research paper)

lantiga:

luiscape:

Created 2 years ago

Updated 1 year ago

transformer-debugger by openai

Tool for language model behavior investigation

aangelopoulos:

chiphuyen:

transitive-bullshit:

swyxio:

Created 2 years ago

Updated 1 year ago

Open-Sora by hpcaitech

Video generation initiative for efficient, high-quality video production

luiscape:

parasj:

wassemgtk:

pgarbacki:

Created 2 years ago

Updated 10 months ago

VideoSys by NUS-HPC-AI-Lab

Efficient infrastructure for advanced video generation

jinze1994:

omarsar:

Created 2 years ago

Updated 6 months ago

clearml by clearml

MLOps suite for experiment tracking, automation, and data management

Jiayi-Pan:

rodrigosnader:

hammer:

luiscape:

Created 6 years ago

Updated 17 hours ago

veScale by volcengine

PyTorch-native framework for LLM training

JustinLin610:

casper-hansen:

hiyouga:

stas00:

Created 2 years ago

Updated 1 week ago

Video-ChatGPT by mbzuai-oryx

Video conversation model for detailed video understanding (ACL 2024 paper)

Created 2 years ago

Updated 7 months ago

LWM by LargeWorldModel

Multimodal autoregressive model for long-context video/text

mateiz:

chiphuyen:

Jiayi-Pan:

pgarbacki:

Created 2 years ago

Updated 1 year ago

Magic-Me by Zhen-Dong

Video diffusion for personalized clips

Created 2 years ago

Updated 2 years ago

StableCascade by Stability-AI

Image generation model using cascaded diffusion

stellaathena:

transitive-bullshit:

hugs:

Created 2 years ago

Updated 1 year ago

jaxtyping by patrick-kidger

Typing library for array shapes/dtypes

geohot:

patrickvonplaten:

ekzhang:

lucidrains:

Created 3 years ago

Updated 3 weeks ago

MoE-LLaVA by PKU-YuanGroup

Vision-language model research paper using Mixture-of-Experts

simonw:

omarsar:

osanseviero:

Created 2 years ago

Updated 8 months ago

Video-LLaVA by PKU-YuanGroup

Video-LLaVA: Multimodal model for video/image understanding via LLM

winglian:

Created 2 years ago

Updated 1 year ago

SUPIR by Fanghua-Yu

Image restoration research paper for photo-realistic results

jlukic:

transitive-bullshit:

Created 2 years ago

Updated 10 months ago

Kandinsky-3 by ai-forever

Text-to-image diffusion model for multifunctional generative tasks

Created 2 years ago

Updated 1 year ago

ml-engineering by stas00

Open book for LLM/VLM training engineers

tobi:

ppwwyyxx:

froystig:

jrk:

Created 5 years ago

Updated 2 days ago

k-diffusion by crowsonkb

PyTorch implementation of Karras et al. (2022) diffusion models

parano:

luiscape:

wongmjane:

rromb:

Created 3 years ago

Updated 4 weeks ago

TriplaneGaussian by VAST-AI-Research

Research paper for single-view 3D reconstruction using hybrid representation

Created 2 years ago

Updated 2 years ago

InvokeAI by invoke-ai

Creative engine for visual media generation using Stable Diffusion models

ogabrielluiz:

assafelovic:

chiphuyen:

transitive-bullshit:

Created 3 years ago

Updated 2 days ago

PhotoMaker by TencentARC

Photo customization research paper using stacked ID embedding

osanseviero:

chenlin9:

wsxiaoys:

jaretburkett:

Created 2 years ago

Updated 1 year ago

Awesome-Video-Diffusion by showlab

Curated list of video diffusion models for generation, editing, and more

Created 2 years ago

Updated 3 days ago

VGen by ali-vilab

Video synthesis codebase for state-of-the-art generative models

osanseviero:

Created 2 years ago

Updated 1 year ago

UForm by unum-cloud

Multimodal AI library for content understanding and generation

simonw:

osanseviero:

jeresig:

transitive-bullshit:

Created 3 years ago

Updated 4 months ago

OpenLRM by 3DTopia

Open-source implementation of Large Reconstruction Models

Created 2 years ago

Updated 1 year ago

seamless_communication by facebookresearch

Multilingual speech and text translation models for natural communication

parano:

tjbck:

luiscape:

ggerganov:

Created 2 years ago

Updated 1 week ago

WatermarkAttacker by XuandongZhao

Generative AI for provable invisible watermark removal

Created 2 years ago

Updated 1 year ago

sd-scripts by kohya-ss

Training/generation scripts for Stable Diffusion models

tmoreau89:

Created 3 years ago

Updated 2 weeks ago

latent-consistency-model by luosiallen

LCM: Fast image synthesis via few-step inference

codekansas:

osanseviero:

patrickvonplaten:

Created 2 years ago

Updated 1 year ago

Otter by EvolvingLMMs-Lab

Multimodal model for improved instruction following and in-context learning

chiphuyen:

parasj:

apsdehal:

ogabrielluiz:

Created 2 years ago

Updated 2 years ago

Wuerstchen by dome272

Text-to-image research paper on efficient diffusion model pretraining

osanseviero:

patrickvonplaten:

Created 2 years ago

Updated 1 year ago

consistencydecoder by openai

Improved decoding for stable diffusion VAEs

shyamal-anadkat:

gakonst:

simonw:

vincentweisser:

Created 2 years ago

Updated 2 years ago

LandMark by InternLandMark

3D city scene modeling and rendering system

Created 2 years ago

Updated 2 years ago

codeshell by WisdomShell

Code LLM for code generation, completion, and question answering

hammer:

Created 2 years ago

Updated 1 year ago

stable-audio-tools by Stability-AI

Audio generation models training/inference code

luiscape:

jn2clark:

calvinfo:

vincentweisser:

Created 2 years ago

Updated 3 weeks ago

DreamLLM by RunpeiDong

Multimodal LLM framework for comprehension and creation

hiyouga:

Created 2 years ago

Updated 1 year ago

RelayDiffusion by zai-org

Research paper implementing Relay Diffusion for image synthesis

Created 2 years ago

Updated 1 year ago

taesd by madebyollin

Tiny AutoEncoder for Stable Diffusion latents

tobi:

claforte:

patrickvonplaten:

ajayjain:

Created 2 years ago

Updated 1 month ago

skypilot by skypilot-org

Framework for cloud AI/batch jobs, unifying execution across diverse infrastructure

karpathy:

tobi:

amin3141:

luiscape:

Created 4 years ago

Updated 18 hours ago

oft by zqiu24

Research paper on orthogonal finetuning for text-to-image diffusion models

sxyu:

Created 2 years ago

Updated 6 months ago

opendream by varunshenoy

Web UI for diffusion model workflows

jaredpalmer:

sorenbs:

Created 2 years ago

Updated 2 years ago

LLaVA by haotian-liu

Multimodal assistant with GPT-4 level capabilities

shizhediao:

zhiyuan8:

transitive-bullshit:

patrickvonplaten:

Created 2 years ago

Updated 1 year ago

awesome-segment-anything by Hedlen

Curated list for Segment Anything research

Created 2 years ago

Updated 1 year ago

generative-models by Stability-AI

Generative models SDK for video, image, and 3D synthesis research

hugs:

luiscape:

pgarbacki:

osanseviero:

Created 2 years ago

Updated 2 months ago

FastSAM by CASIA-LMC-Lab

CNN for fast image segmentation, comparable to SAM but faster

Created 2 years ago

Updated 1 year ago

efficientvit by mit-han-lab

Vision models for high-resolution generation/perception tasks

claforte:

Created 2 years ago

Updated 6 months ago

Grounded-Segment-Anything by IDEA-Research

Framework for open-world visual tasks, combining multiple models

ishaan-jaff:

codekansas:

patrickvonplaten:

transitive-bullshit:

Created 2 years ago

Updated 1 year ago

webdataset by webdataset

High-performance I/O system for large deep learning problems, strong PyTorch support

soldni:

chiphuyen:

hammer:

theophilegervet:

Created 6 years ago

Updated 1 month ago

threestudio by threestudio-project

Framework for 3D content generation from text/images using 2D diffusion

chiphuyen:

luiscape:

rromb:

claforte:

Created 2 years ago

Updated 1 year ago

ImageBind by facebookresearch

PyTorch implementation for multimodal embeddings research paper

xiaofan-luan:

winglian:

JustinLin610:

transitive-bullshit:

Created 3 years ago

Updated 3 months ago

safari by HazyResearch

Research paper implementations for sequence modeling with convolutions

tgaddair:

victortaelin:

winglian:

hammer:

Created 3 years ago

Updated 1 year ago

Segment-Everything-Everywhere-All-At-Once by UX-Decoder

Multi-modal segmentation research paper

JustinLin610:

jwyang:

Created 2 years ago

Updated 1 year ago

X-Decoder by microsoft

Generalized decoding model for pixel, image, and language tasks

jwyang:

s9xie:

osanseviero:

haotian-liu:

Created 3 years ago

Updated 2 years ago

consistency_models by openai

PyTorch code for consistency models research paper

codekansas:

patrickvonplaten:

JustinLin610:

ablattmann:

Created 3 years ago

Updated 2 years ago

gpt_academic by binary-husky

LLM tool for paper reading/polishing/writing, optimized UI

ekzhu:

yiranwu0:

soldni:

JustinLin610:

Created 3 years ago

Updated 1 month ago

tomesd by dbolya

Speed-up tool for Stable Diffusion

patrickvonplaten:

Created 3 years ago

Updated 2 years ago

unidiffuser by thu-ml

Unified diffusion framework for multi-modal generation

suhail:

Created 3 years ago

Updated 2 years ago

custom-diffusion by adobe-research

Text-to-image fine-tuning research paper

Created 3 years ago

Updated 3 months ago

ControlNet by lllyasviel

Neural network structure for adding conditional control to diffusion models

vincentweisser:

codekansas:

louisgv:

ogabrielluiz:

Created 3 years ago

Updated 2 years ago

GLM-130B by zai-org

Bilingual model for research and evaluation

soldni:

wassemgtk:

mckaywrigley:

bryanhelmig:

Created 3 years ago

Updated 2 years ago

DiT by facebookresearch

PyTorch implementation for diffusion models with transformers (DiT)

shizhediao:

Edward-Sun:

patrickvonplaten:

aangelopoulos:

Created 3 years ago

Updated 1 year ago

point-e by openai

Diffusion model for 3D point cloud generation from prompts

chenlin9:

Edward-Sun:

forresti:

kerollmops:

Created 3 years ago

Updated 1 year ago

sjc by pals-ttic

Research paper for 3D generation from 2D diffusion models

parasj:

sxyu:

Created 3 years ago

Updated 2 years ago

Kandinsky-2 by ai-forever

Multilingual text-to-image latent diffusion model

rromb:

patrickvonplaten:

osanseviero:

Created 3 years ago

Updated 1 year ago

stable-dreamfusion by ashawkey

Text-to-3D model using NeRF and diffusion

hiyouga:

chiphuyen:

patrickvonplaten:

forresti:

Created 3 years ago

Updated 2 years ago

stable-diffusion-webui-depthmap-script by thygate

WebUI script for depth map creation and manipulation

Created 3 years ago

Updated 1 year ago

motion-diffusion-model by GuyTevet

PyTorch code for text/action-to-human-motion generation via diffusion

osanseviero:

luiscape:

Created 3 years ago

Updated 5 months ago

Dreambooth-Stable-Diffusion by XavierXiao

Dreambooth implementation for Stable Diffusion

tjbck:

omarsar:

transitive-bullshit:

wongmjane:

Created 3 years ago

Updated 3 years ago

CrossAttentionControl by bloc97

Image editing via cross-attention control in Stable Diffusion

andreasjansson:

osanseviero:

Created 3 years ago

Updated 3 years ago

Awesome-Diffusion-Models by diff-usion

Diffusion models resource collection

omarsar:

taranjeet:

osanseviero:

eugeneyan:

Created 4 years ago

Updated 1 year ago

ddrm by bahjat-kawar

Research paper for diffusion-based image restoration

chenlin9:

Created 4 years ago

Updated 3 years ago

glide-text2im by openai

Text-conditional image synthesis model from research paper

ShengjiaZhao:

Edward-Sun:

patrickvonplaten:

Jiayi-Pan:

Created 4 years ago

Updated 2 years ago

latent-diffusion by CompVis

Image synthesis research paper using latent diffusion models

aravindsrinivas:

codekansas:

jaretburkett:

jinze1994:

Created 4 years ago

Updated 2 years ago

MockingBird by babysor

Voice cloning tool for generating arbitrary speech

huybery:

samuelcolvin:

transitive-bullshit:

luiscape:

Created 4 years ago

Updated 1 week ago

human-eval by openai

Evaluation harness for LLMs trained on code

shizhediao:

jaredpalmer:

khou22:

okhat:

Created 4 years ago

Updated 1 year ago

dgl by dmlc

Python package for deep learning on graphs

osanseviero:

xiezhq-hermann:

parasj:

infwinston:

Created 8 years ago

Updated 7 months ago

decision-transformer by kzl

RL via sequence modeling research paper

aravindsrinivas:

hammer:

chenlin9:

rwightman:

Created 4 years ago

Updated 1 year ago

GAN-Inversion by weihaox

GAN inversion resource for TPAMI 2022 survey paper

chenlin9:

Created 5 years ago

Updated 1 year ago

StyleCLIP by orpatashnik

Text-driven StyleGAN imagery manipulation via CLIP models

luiscape:

borzunov:

bfirsh:

chenlin9:

Created 5 years ago

Updated 2 years ago

TediGAN by IIGROUP

PyTorch code for text-guided face image generation/manipulation

bfirsh:

chenlin9:

Created 5 years ago

Updated 3 years ago

CLIP by openai

Image-text matching model for zero-shot prediction

aravindsrinivas:

transitive-bullshit:

Edward-Sun:

mholt:

Created 5 years ago

Updated 3 weeks ago

guided-diffusion by openai

Image synthesis codebase for diffusion models

aravindsrinivas:

JustinLin610:

rromb:

patrickvonplaten:

Created 4 years ago

Updated 1 year ago

VinVL by pzzhang

Research paper for improved visual representations in vision-language models

jinze1994:

Created 5 years ago

Updated 2 years ago

pytorch-image-models by huggingface

PyTorch image model collection with training, eval, and inference scripts

clmnt:

karpathy:

osanseviero:

Jiayi-Pan:

Created 7 years ago

Updated 3 days ago

vit-pytorch by lucidrains

PyTorch library for Vision Transformer variants and related techniques

karpathy:

lucidrains:

chiphuyen:

forresti:

Created 5 years ago

Updated 1 month ago

pytorch3d by facebookresearch

PyTorch3D is a PyTorch library for 3D deep learning research

aravindsrinivas:

chiphuyen:

hiyouga:

gkioxari:

Created 6 years ago

Updated 1 week ago

BIG-bench by google

Collaborative benchmark for probing and extrapolating LLM capabilities

ShengjiaZhao:

chiphuyen:

hiyouga:

nirga:

Created 5 years ago

Updated 1 year ago

taming-transformers by CompVis

Image synthesis research paper using transformers

karpathy:

Jiayi-Pan:

codekansas:

stellaathena:

Created 5 years ago

Updated 1 year ago

spinningup by openai

Educational resource for learning deep reinforcement learning

Jiayi-Pan:

pgarbacki:

nirga:

codekansas:

Created 7 years ago

Updated 1 year ago

tianshou by thu-ml

PyTorch RL library for algorithm development and application

chiphuyen:

pgarbacki:

shizhediao:

youkaichao:

Created 8 years ago

Updated 3 months ago

flax by google

NN library for JAX, designed for flexibility in neural network research

charliermarsh:

codekansas:

Jiayi-Pan:

jaredpalmer:

Created 6 years ago

Updated 22 hours ago

PyTorch-RL by Khrylx

RL algorithms in PyTorch

chenlin9:

millionintegrals:

Created 8 years ago

Updated 5 years ago

ncsn by ermongroup

Research paper implementation for generative modeling via score estimation

yang-song:

chenlin9:

Created 6 years ago

Updated 2 years ago

BigGAN-PyTorch by ajbrock

PyTorch code for BigGAN image synthesis research paper

aravindsrinivas:

jn2clark:

infwinston:

shizhediao:

Created 7 years ago

Updated 2 years ago

pixel-cnn-pp by pclucas14

Pytorch implementation of PixelCNN++ for generative image modeling

chenlin9:

yang-song:

Created 8 years ago

Updated 5 years ago

ebm_code_release by openai

Code release for energy-based model research paper

chenlin9:

Created 7 years ago

Updated 2 years ago

neural-mmo by openai

Massively multiagent game environment for training and evaluating intelligent agents

evhub:

millionintegrals:

apsdehal:

rwightman:

Created 7 years ago

Updated 2 years ago

surreal by SurrealAI

Open-source distributed RL framework

parano:

jcjohnson:

deshraj:

Created 7 years ago

Updated 5 years ago

DALI by NVIDIA

GPU-accelerated library for data pre-processing in deep learning

hammer:

agermanidis:

apsdehal:

cvalenzuela:

Created 7 years ago

Updated 2 days ago

rlkit by rail-berkeley

RL algorithm collection implemented in PyTorch

aravindsrinivas:

MishaLaskin:

natolambert:

millionintegrals:

Created 8 years ago

Updated 1 year ago

sac by haarnoja

Deep RL framework for maximum entropy policies in continuous domains (ICML 2018 paper)

aravindsrinivas:

Created 8 years ago

Updated 2 years ago

glow by openai

Generative flow research paper code

lilianweng:

patrick-kidger:

tgaddair:

Edward-Sun:

Created 7 years ago

Updated 1 year ago

horovod by horovod

Distributed training framework for TF, Keras, PyTorch, and MXNet

aravindsrinivas:

fchollet:

winglian:

transitive-bullshit:

Created 8 years ago

Updated 3 months ago

fairseq by facebookresearch

Sequence modeling toolkit for translation, language modeling, and text generation research

lilianweng:

aravindsrinivas:

tjbck:

pathak22:

Created 8 years ago

Updated 5 months ago

pysc2-examples by chris-chris

StarCraft II reinforcement learning examples

Created 8 years ago

Updated 5 years ago

sngan_projection by pfnet-research

Chainer implementation for conditional image generation research

jongwook:

s9xie:

jwyang:

PiotrDabkowski:

Created 8 years ago

Updated 6 years ago

gym by openai

RL toolkit for reinforcement learning algorithm development

aravindsrinivas:

fchollet:

bcherny:

ValentaTomas:

Created 10 years ago

Updated 1 year ago

robosumo by openai

Code for research paper on meta-learning in competitive environments

aravindsrinivas:

jinze1994:

mattjj:

Created 8 years ago

Updated 2 years ago

MARL-Papers by LantaoYu

Paper list for multi-agent reinforcement learning (MARL)

aravindsrinivas:

chenlin9:

merrymercy:

Created 9 years ago

Updated 1 month ago

MADRL by sisl

Multi-agent RL environments

Created 9 years ago

Updated 2 years ago

gym_torcs by ugo-nama-kun

RL environment for TORCS, an open-source car racing simulator

Created 9 years ago

Updated 8 years ago

mlsh by openai

Research paper code for meta-learning shared hierarchies

aravindsrinivas:

Created 8 years ago

Updated 2 years ago

multiagent-competition by openai

Environments for multi-agent competition research paper

aravindsrinivas:

Created 8 years ago

Updated 2 years ago

rl-teacher by nottombrown

RL from human preferences via a webapp for feedback collection

aravindsrinivas:

janleike:

evhub:

8enmann:

Created 8 years ago

Updated 3 years ago

al-folio by alshedivat

Jekyll theme for building academic portfolios and personal websites

aangelopoulos:

albertfgu:

huybery:

hammer:

Created 9 years ago

Updated 1 day ago

gym-minecraft by tambetm

Gym environment for AI experimentation/research in Minecraft

evhub:

pathak22:

Created 9 years ago

Updated 5 years ago

tensorforce by tensorforce

TensorFlow library for reinforcement learning (not maintained)

parano:

luiscape:

8enmann:

nottombrown:

Created 9 years ago

Updated 1 year ago

mujoco-py by openai

Python bindings for MuJoCo physics engine

lilianweng:

aravindsrinivas:

ogabrielluiz:

evhub:

Created 10 years ago

Updated 2 years ago

ray by ray-project

AI compute engine for scaling Python and AI applications

didierrlopes:

beyang:

hsbt:

gregpr07:

Created 9 years ago

Updated 18 hours ago

reinforcement-learning by rlcode

Reinforcement learning examples for algorithm exploration

fchollet:

junxiaosong:

evhub:

AntonOsika:

Created 9 years ago

Updated 3 years ago

muniverse by unixpickle

RL environments for HTML5 games

aravindsrinivas:

8enmann:

deshraj:

nottombrown:

Created 8 years ago

Updated 7 years ago

pytorch-tutorial by yunjey

PyTorch tutorial for deep learning researchers

tjbck:

bryanhelmig:

stas00:

haotian-liu:

Created 9 years ago

Updated 2 years ago

baselines by openai

RL algorithm implementations for research

aravindsrinivas:

lilianweng:

JohannesHa:

jspahrsummers:

Created 8 years ago

Updated 1 year ago

fairseq-lua by facebookresearch

Lua-based toolkit for sequence-to-sequence learning

bcherny:

generall:

thomwolf:

vincentweisser:

Created 9 years ago

Updated 4 years ago

examples by pytorch

PyTorch examples for diverse AI tasks

lilianweng:

hammer:

tjbck:

ari-holtzman:

Created 9 years ago

Updated 6 months ago

OpenBLAS by OpenMathLib

Optimized BLAS library for linear algebra subprograms

kerollmops:

infwinston:

jcjohnson:

hammer:

Created 15 years ago

Updated 2 days ago

openai-gemm by openai

GEMM kernels for single/half precision

jrk:

s9xie:

deshraj:

mattjj:

Created 9 years ago

Updated 2 years ago

ganhacks by soumith

GAN training tips and tricks

aravindsrinivas:

lilianweng:

ebursztein:

stefanv:

Created 9 years ago

Updated 4 years ago

universe by openai

Deprecated platform for measuring/training AI across diverse applications

Jiayi-Pan:

codekansas:

junxiaosong:

evhub:

Created 9 years ago

Updated 8 years ago

imitation by openai

Imitation learning research paper code

aravindsrinivas:

nottombrown:

Created 9 years ago

Updated 7 years ago

Neural-Photo-Editor by ajbrock

Photo editor for generative neural network research

bcherny:

cvalenzuela:

s9xie:

agermanidis:

Created 9 years ago

Updated 9 years ago

tensorflow by tensorflow

Open-source ML framework

norvig:

aravindsrinivas:

karpathy:

bcherny:

Created 10 years ago

Updated 16 hours ago

reinforcement-learning by dennybritz

RL algorithms implementation for education

lilianweng:

ogabrielluiz:

thomwolf:

jinze1994:

Created 9 years ago

Updated 2 years ago

iaf by openai

Code for reproducing research paper results

aravindsrinivas:

ibab:

joschu:

nottombrown:

Created 9 years ago

Updated 7 years ago

improved-gan by openai

GAN training code for research paper replication

aravindsrinivas:

lilianweng:

bcherny:

evhub:

Created 9 years ago

Updated 7 years ago

rllab by rll

Framework for reinforcement learning algorithm development and evaluation

aravindsrinivas:

gdb:

apsdehal:

parano:

Created 10 years ago

Updated 2 years ago

tensorpack by tensorpack

Neural net training interface on TensorFlow

parasj:

ppwwyyxx:

chuanli11:

nottombrown:

Created 10 years ago

Updated 2 years ago

Feedback? Help us improve.