Jianwei Yang

Recipes for language model context length extrapolation to 1M tokens

Starred by

Yaowei Zheng(Author of LLaMA-Factory),

Jiaming Song(Chief Scientist at Luma AI), and

1 more.

EasyContext by jzhang38

739

Unified-IO 2 code for training, inference, and demo

updated 10 months ago

Starred by

Jiayi Pan(Author of SWE-Gym; MTS at xAI),

Shizhe Diao(Research Scientist at NVIDIA; Author of LMFlow), and

2 more.

unified-io-2 by allenai

621

CLI/SDK for fine-tuning multimodal models

Starred by

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"),

Georgios Konstantopoulos(CTO, General Partner at Paradigm), and

2 more.

maestro by roboflow

0.7%

updated 4 days ago

Starred by

Travis Fischer(Founder of Agentic).

vimGPT by ishan0102

GPT-4V web browser using Vimium

updated 10 months ago

awesome-openai-vision-api-experiments by roboflow

Vision API experiments and examples

updated 7 months ago

GPT-4V-Act by ddupont808

Multimodal AI agent for web UI interaction

updated 8 months ago

Starred by

Travis Fischer(Founder of Agentic) and

Omar Sanseviero(DevRel at Google DeepMind).

SoM by microsoft

Visual prompting method for GPT-4V and LMMs

LLM serving engine for high-throughput, memory-efficient inference

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Clement Delangue(Cofounder of Hugging Face), and

41 more.

vllm by vllm-project

1.4%

55k

updated 19 hours ago

Starred by

Jiaming Song(Chief Scientist at Luma AI),

Saining Xie(Professor at NYU), and

4 more.

X-Decoder by microsoft

Generalized decoding model for pixel, image, and language tasks

Starred by

Junyang Lin(Core Maintainer of Alibaba Qwen) and

Jiaming Song(Chief Scientist at Luma AI).

Segment-Everything-Everywhere-All-At-Once by UX-Decoder

Multi-modal segmentation research paper

Starred by

Chaoyu Yang(Founder of Bento),

Ben Firshman(Cofounder of Replicate), and

6 more.

instruct-pix2pix by timothybrooks

Image editing model for instruction-based image manipulation

PyTorch/Flax library for diffusion model research and applications

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Clement Delangue(Cofounder of Hugging Face), and

29 more.

diffusers by huggingface

0.4%

30k

created 3 years ago

updated 20 hours ago

Starred by

Shizhe Diao(Research Scientist at NVIDIA; Author of LMFlow),

Taranjeet Singh(Cofounder of Mem0), and

3 more.

Awesome-Transformer-Attention by cmhungsteve

Vision Transformer/Attention paper list

created 3 years ago

Starred by

Wing Lian(Founder of Axolotl AI),

Anastasios Angelopoulos(Cofounder of LMArena), and

10 more.

img2dataset by rom1504

CLI tool for creating large image datasets from URLs

created 4 years ago

updated 4 days ago

Starred by

Aravind Srinivas(Cofounder of Perplexity),

Chenlin Meng(Cofounder of Pika), and

3 more.

DALL-E by openai

PyTorch package for DALL-E's discrete VAE

11k

created 4 years ago

Curated list of deep learning resources for video-text retrieval

awesome-video-text-retrieval by danieljf24

0.3%

628

PyTorch library for Vision Transformer variants and related techniques

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Phil Wang(Prolific Research Paper Implementer), and

10 more.

vit-pytorch by lucidrains

0.3%

24k

created 4 years ago

updated 2 days ago

Starred by

Jiayi Pan(Author of SWE-Gym; MTS at xAI).

allenact by allenai

0.5%

366

Open-source framework for embodied AI research

updated 1 day ago

Starred by

Anton Troynikov(Cofounder of Chroma),

Amanpreet Singh(Cofounder of Contextual AI), and

3 more.

yolov5 by ultralytics

YOLOv5 in PyTorch for object detection, segmentation, and classification

55k

VAE language model for latent space sentence manipulation

updated 2 days ago

Optimus by ChunyuanLI

390

Starred by

Aravind Srinivas(Cofounder of Perplexity),

Wing Lian(Founder of Axolotl AI), and

27 more.

DeepSpeed by deepspeedai

Deep learning optimization library for distributed training and inference

40k

updated 22 hours ago

DeepClustering by zhoushengisnoob

Survey of deep clustering methods and implementations

updated 11 months ago

Starred by

Lilian Weng(Cofounder of Thinking Machines Lab),

Aravind Srinivas(Cofounder of Perplexity), and

32 more.

fairseq by facebookresearch

Sequence modeling toolkit for translation, language modeling, and text generation research

32k

Optimizer for neural network training, addressing adaptive learning rate variance

updated 2 months ago

Starred by

Daniel Han(Cofounder of Unsloth),

Jerry Tworek(VP Research at OpenAI), and

2 more.

RAdam by LiyuanLucasLiu

updated 4 years ago

Starred by

Aravind Srinivas(Cofounder of Perplexity),

John Yang(Author of SWE-bench, SWE-agent), and

1 more.

awesome-multimodal-ml by pliang279

Curated reading list for multimodal ML research

Starred by

Aravind Srinivas(Cofounder of Perplexity),

Jesse Clark(Cofounder of Marqo), and

8 more.

BigGAN-PyTorch by ajbrock

PyTorch code for BigGAN image synthesis research paper

Starred by

Aravind Srinivas(Cofounder of Perplexity),

Simon Willison(Author of Django), and

19 more.

gpt-2 by openai

Code for research paper "Language Models are Unsupervised Multitask Learners"

24k

Starred by

Omar Sanseviero(DevRel at Google DeepMind),

Jiaming Song(Chief Scientist at Luma AI), and

11 more.

dgl by dmlc

Python package for deep learning on graphs

14k

updated 2 weeks ago

synthetic-computer-vision by unrealcv

Synthetic data for computer vision research

Starred by

Aravind Srinivas(Cofounder of Perplexity),

Johannes Hagemann(Cofounder of Prime Intellect), and

15 more.

apex by NVIDIA

PyTorch extension for streamlined mixed precision & distributed training

updated 1 week ago

Starred by

Tom Brown(Cofounder of Anthropic),

Jerry Tworek(VP Research at OpenAI), and

1 more.

DeepRL by ShangtongZhang

PyTorch library for deep RL algorithm research

Starred by

Aravind Srinivas(Cofounder of Perplexity),

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), and

9 more.

higgsfield by higgsfield-ai

ML framework for large model training and GPU orchestration

Starred by

Evan Hubinger(Head of Alignment Stress-Testing at Anthropic),

Jerry Tworek(VP Research at OpenAI), and

4 more.

Rainbow by Kaixhin

Deep reinforcement learning research paper implementation

Starred by

Travis Fischer(Founder of Agentic),

Anastasis Germanidis(Cofounder of Runway), and

2 more.

GibsonEnv by StanfordVL

Virtual environment for embodied agents with real-world perception

918

Deep RL research with PyTorch and Visdom

Starred by

Jerry Tworek(VP Research at OpenAI) and

Soumith Chintala(Author of PyTorch).

pytorch-rl by jingweiz

801

updated 5 years ago

Starred by

Jeff Hammerbacher(Cofounder of Cloudera),

Gavin Uberti(Cofounder of Etched), and

16 more.

netron by lutzroeder

Model visualizer for neural networks, deep learning, and ML

31k

created 14 years ago

updated 22 hours ago

Starred by

Jong Wook Kim(Research Scientist at OpenAI),

Saining Xie(Professor at NYU), and

2 more.

sngan_projection by pfnet-research

Chainer implementation for conditional image generation research

updated 5 years ago

Starred by

Aravind Srinivas(Cofounder of Perplexity),

Greg Brockman(Cofounder of OpenAI), and

10 more.

rllab by rll

Framework for reinforcement learning algorithm development and evaluation

Starred by

Aravind Srinivas(Cofounder of Perplexity),

Travis Fischer(Founder of Agentic), and

15 more.

tvm by apache

Compiler stack for deep learning systems

13k

updated 1 day ago

Starred by

Zhuohan Li(Author of vLLM),

Jesse Clark(Cofounder of Marqo), and

1 more.

rl_a3c_pytorch by dgriff777

PyTorch implementation of A3C for Atari games

571

Starred by

Boris Cherny(Creator of Claude Code; MTS at Anthropic),

Andrey Vasnetsov(Cofounder of Qdrant), and

17 more.

fairseq-lua by facebookresearch

Lua-based toolkit for sequence-to-sequence learning

Starred by

François Chollet(Cofounder of Ndea, ARC Prize; Author of Keras),

Evan Hubinger(Head of Alignment Stress-Testing at Anthropic), and

6 more.

reinforcement-learning by rlcode

Reinforcement learning examples for algorithm exploration

Starred by

John Yang(Author of SWE-bench, SWE-agent),

Michele Castata(President of Replit), and

7 more.

Practical_RL by yandexdataschool

RL course material for on-campus and online students

updated 1 month ago

Starred by

Lilian Weng(Cofounder of Thinking Machines Lab),

Aravind Srinivas(Cofounder of Perplexity), and

36 more.

faiss by facebookresearch

Starred by

Lilian Weng(Cofounder of Thinking Machines Lab),

Thomas Wolf(Cofounder of Hugging Face), and

11 more.

reinforcement-learning by dennybritz

RL algorithms implementation for education

21k

Starred by

Aravind Srinivas(Cofounder of Perplexity),

Lilian Weng(Cofounder of Thinking Machines Lab), and

17 more.

ganhacks by soumith

GAN training tips and tricks

12k

Example code for weight normalization research paper

Starred by

Aravind Srinivas(Cofounder of Perplexity) and

Tom Brown(Cofounder of Anthropic).

weightnorm by openai

364

updated 6 years ago

Starred by

François Chollet(Cofounder of Ndea, ARC Prize; Author of Keras),

George Hotz(Author of tinygrad; Founder of the tiny corp, comma.ai), and

7 more.

research by commaai

Dataset and code for driving simulator research paper

Starred by

Peter Norvig(Author of "Artificial Intelligence: A Modern Approach"; Research Director at Google),

Aravind Srinivas(Cofounder of Perplexity), and

71 more.

tensorflow by tensorflow

191k

Open-source ML framework

updated 19 hours ago

Starred by

Aravind Srinivas(Cofounder of Perplexity),

François Chollet(Cofounder of Ndea, ARC Prize; Author of Keras), and

27 more.

gym by openai

RL toolkit for reinforcement learning algorithm development

36k

GAN training code for research paper replication

updated 10 months ago

Starred by

Aravind Srinivas(Cofounder of Perplexity),

Lilian Weng(Cofounder of Thinking Machines Lab), and

9 more.

improved-gan by openai

Research paper implementation for interpretable representation learning via InfoGAN

updated 6 years ago

Starred by

Aravind Srinivas(Cofounder of Perplexity),

Evan Hubinger(Head of Alignment Stress-Testing at Anthropic), and

2 more.

InfoGAN by openai

Curated list of Torch tutorials, projects, and communities

updated 4 years ago

Starred by

Deshraj Yadav(Cofounder of Mem0),

Luca Antiga(CTO of Lightning AI), and

1 more.

awesome-torch by carpedm20

0.5%

641

created 10 years ago

updated 7 years ago

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Deshraj Yadav(Cofounder of Mem0), and

4 more.

rcnn by rbgirshick