Shizhe Diao

Author of LMFlow; Research Scientist at NVIDIA

Authored Projects (1)

ChatGPTPapers by shizhediao

0.3%

322

Curated list of resources on ChatGPT pre-training/tuning

Collection of papers (GPT-1 to GPT-4) and blogs related to ChatGPT methods.
Includes papers on RLHF, InstructGPT, Toolformer, and Constitutional AI.
Features non-official APIs in Python, JS/TS, and Dart.

Created 2 years ago

Updated 2 years ago

Starred Projects (318)

hle by centerforaisafety

1.4%

Multimodal benchmark for frontier human knowledge

Starred by

Created 8 months ago

Updated 1 week ago

LightRAG by HKUDS

0.8%

22k

RAG framework for fast, simple retrieval-augmented generation

Starred by

Created 1 year ago

Updated 17 hours ago

AgentGym-RL by WooooDyy

2.8%

432

Train LLM agents for long-horizon, multi-turn decision-making

Starred by

Created 1 month ago

Updated 1 month ago

deep-research by dzhng

0.2%

18k

AI research assistant for iterative, in-depth topic exploration

Starred by

Created 8 months ago

Updated 1 month ago

ASearcher by inclusionAI

2.0%

454

Framework for large-scale reinforcement learning of search agents

Created 2 months ago

Updated 6 days ago

frontier-evals by openai

0.5%

913

Code repo for OpenAI preparedness evals

Starred by

Created 6 months ago

Updated 2 weeks ago

paper-qa by Future-House

0.2%

RAG for scientific documents, providing accurate answers with citations

Starred by

Created 2 years ago

Updated 3 days ago

hnet by goombalab

1.1%

750

Hierarchical sequence modeling with dynamic chunking

Starred by

Created 3 months ago

Updated 2 weeks ago

Kimi-K2 by MoonshotAI

0.4%

State-of-the-art MoE language model

Starred by

Created 3 months ago

Updated 1 month ago

reasoning-gym by open-thought

1.0%

Procedural dataset generator for reasoning models

Starred by

Created 8 months ago

Updated 1 week ago

LMFlow by OptimalScale

0.0%

Toolkit for finetuning and inference of large foundation models

Starred by

Created 2 years ago

Updated 2 months ago

codex by openai

2.3%

47k

Coding agent CLI tool for terminal-based chat-driven development

Starred by

+30

Created 6 months ago

Updated 15 hours ago

dify by langgenius

0.5%

116k

Open-source LLM app development platform

EasyR1 by hiyouga

1.3%

RL training framework for multi-modality models

Starred by

Created 7 months ago

Updated 1 day ago

SWE-bench by SWE-bench

0.6%

Benchmark for evaluating LLMs on real-world GitHub issues

Starred by

+11

Created 2 years ago

Updated 3 days ago

litellm by BerriAI

0.9%

30k

SDK/proxy for calling 100+ LLM APIs using the OpenAI format

verl-tool by TIGER-AI-Lab

3.6%

591

Framework for training tool-using LLM agents

Created 6 months ago

Updated 3 days ago

SWE-Gym by SWE-Gym

0.2%

548

Environment for training software engineering agents

Starred by

Created 11 months ago

Updated 2 months ago

Fast-dLLM by NVlabs

13.4%

563

Diffusion LLM inference acceleration framework

Created 4 months ago

Updated 3 days ago

terminal-bench by laude-institute

4.1%

898

Benchmark for LLM agents in real terminal environments

Starred by

Created 9 months ago

Updated 1 day ago

magentic-ui by microsoft

0.9%

Web app prototype for human-in-the-loop agent collaboration

Starred by

Created 5 months ago

Updated 1 day ago

swe-rl by facebookresearch

0.7%

607

RL for software evolution

Starred by

Created 7 months ago

Updated 7 months ago

vllm by vllm-project

0.8%

60k

LLM serving engine for high-throughput, memory-efficient inference

Starred by

+57

Created 2 years ago

Updated 17 hours ago

Seed-Thinking-v1.5 by ByteDance-Seed

816

Reasoning model for STEM, coding, and general tasks

Starred by

Created 6 months ago

Updated 4 months ago

RAGEN by mll-lab-nu

0.6%

Train LLM agents with reinforcement learning in interactive environments

Starred by

Created 8 months ago

Updated 1 day ago

Agent-R1 by 0russwest0

1.3%

829

RL framework for training LLM agents via end-to-end reinforcement learning

Created 7 months ago

Updated 2 months ago

nano-llama31 by karpathy

0.3%

Minimal Llama 3.1 implementation for training, finetuning, and inference

Starred by

Created 1 year ago

Updated 1 year ago

nanotron by huggingface

0.3%

Minimalistic library for large language model pretraining

Curator by NVIDIA-NeMo

0.5%

Data curation toolkit for LLMs

Starred by

Created 1 year ago

Updated 1 day ago

MLGym by facebookresearch

0.5%

559

Gym environment for ML research agents

Starred by

Created 7 months ago

Updated 2 months ago

open-r1 by huggingface

0.1%

26k

SDK for reproducing DeepSeek-R1

Search-R1 by PeterGriffinJin

1.6%

RL framework for training LLMs to use search engines

Starred by

Created 7 months ago

Updated 1 week ago

Wan2.1 by Wan-Video

0.6%

14k

Video foundation model for text-to-video, image-to-video, and video editing

Starred by

Created 7 months ago

Updated 2 months ago

FlashMLA by deepseek-ai

0.2%

12k

Efficient CUDA kernels for MLA decoding

Starred by

Created 7 months ago

Updated 2 weeks ago

Math-Verify by huggingface

1.1%

966

Math evaluator for LLM outputs in mathematical tasks

Starred by

Created 9 months ago

Updated 3 months ago

open-thoughts by open-thoughts

0.2%

Open dataset for training reasoning models

Starred by

Created 8 months ago

Updated 1 month ago

Awesome-ML-SYS-Tutorial by zhaochenyang20

1.4%

ML SYS learning notes and code

Starred by

Created 11 months ago

Updated 1 week ago

verl by volcengine

1.5%

14k

RL training library for LLMs

Starred by

+13

Created 11 months ago

Updated 21 hours ago

s1 by simplescaling

0.1%

Test-time scaling recipe for strong reasoning performance

Starred by

Created 8 months ago

Updated 3 months ago

rllm by rllm-org

1.1%

Framework for post-training language agents via reinforcement learning

Starred by

Created 8 months ago

Updated 18 hours ago

TinyZero by Jiayi-Pan

0.2%

12k

Minimal reproduction of DeepSeek R1 Zero for countdown/multiplication tasks

Starred by

Created 8 months ago

Updated 5 months ago

marc by ekinakyurek

328

Research paper implementation for abstract reasoning via test-time training

Created 11 months ago

Updated 10 months ago

Kimi-k1.5 by MoonshotAI

0.0%

Research paper on scaling reinforcement learning with LLMs

Starred by

Created 8 months ago

Updated 7 months ago

simpleRL-reason by hkust-nlp

0.4%

RL recipe for reasoning ability in models

Starred by

Created 8 months ago

Updated 2 months ago

DeepSeek-R1 by deepseek-ai

0.1%

91k

Reasoning models research paper

DeepSeek-V3 by deepseek-ai

0.1%

100k

MoE language model research paper with 671B total parameters

MobileLLM by facebookresearch

0.1%

Sub-billion parameter LLM training code for on-device use

Starred by

Created 1 year ago

Updated 5 months ago

BrowserGym by ServiceNow

1.0%

923

Gym environment for web task automation research

Starred by

Created 1 year ago

Updated 1 week ago

VILA by NVlabs

0.4%

Open-source VLMs for efficient video/multi-image understanding

Starred by

Created 1 year ago

Updated 2 months ago

smollm by huggingface

0.3%

Lightweight AI models for text and vision tasks

Starred by

Created 11 months ago

Updated 4 weeks ago

VideoTuna by VideoVerses

0.6%

510

Codebase for text-to-video applications

Created 11 months ago

Updated 4 weeks ago

Thinking-Claude by richards199999

0.3%

16k

Chrome extension for Claude's "deep mindset" exploration

Created 11 months ago

Updated 7 months ago

awesome-o1 by srush

0.1%

Bibliography for OpenAI's o1 project

Starred by

Created 1 year ago

Updated 11 months ago

lingua by facebookresearch

0.0%

LLM research codebase for training and inference

Starred by

Created 1 year ago

Updated 2 months ago

BitNet by microsoft

1.1%

24k

Inference framework for 1-bit LLMs

Starred by

Created 1 year ago

Updated 4 months ago

openr by openreasoner

0.1%

Open-source framework for advanced LLM reasoning

Starred by

Created 1 year ago

Updated 9 months ago

faiss_tips by matsui528

624

Faiss tips and tricks

Starred by

Created 7 years ago

Updated 1 month ago

O1-Journey by GAIR-NLP

0.1%

Research paper on replicating O1 via "journey learning"

Starred by

Created 1 year ago

Updated 9 months ago

Qwen by QwenLM

0.3%

19k

Chat & pretrained LLM by Alibaba Cloud

mle-bench by openai

2.4%

Benchmark for evaluating AI agents on machine learning engineering tasks

Starred by

Created 1 year ago

Updated 5 days ago

datacomp by mlfoundations

0.1%

743

Competition tooling for multimodal dataset curation to pre-train CLIP models

Starred by

Created 2 years ago

Updated 5 months ago

EAGLE by SafeAILab

1.3%

Speculative decoding research paper for faster LLM inference

Starred by

Created 1 year ago

Updated 1 day ago

Awesome-LLM-Strawberry by hijkzzz

0.1%

Collection of LLM papers, blogs, and projects focused on reasoning techniques

Starred by

Created 1 year ago

Updated 5 days ago

sglang by sgl-project

0.9%

19k

Fast serving framework for LLMs and vision language models

BERTopic by MaartenGr

0.3%

Topic modeling with transformers and c-TF-IDF

Starred by

Created 5 years ago

Updated 2 weeks ago

RADIO by NVlabs

0.3%

Vision foundation model for distilling large models

Starred by

Created 1 year ago

Updated 3 weeks ago

RoleLLM-public by InteractiveNLP-Team

0.2%

506

Framework for benchmarking and enhancing LLM role-playing

Created 2 years ago

Updated 1 year ago

alpaca_eval by tatsu-lab

0.3%

Automatic evaluator for instruction-following language models

Starred by

Created 2 years ago

Updated 2 months ago

TensorRT-LLM by NVIDIA

0.4%

12k

LLM inference optimization SDK for NVIDIA GPUs

open_lm by mlfoundations

0.6%

514

Language model research repo for medium-sized models (up to 7B params)

Starred by

Created 2 years ago

Updated 4 months ago

LLaVA by haotian-liu

0.2%

24k

Multimodal assistant with GPT-4 level capabilities

flash-linear-attention by fla-org

1.5%

Efficient Torch/Triton implementations for linear attention models

Starred by

Created 1 year ago

Updated 1 day ago

human-eval by openai

0.5%

Evaluation harness for LLMs trained on code

Starred by

Created 4 years ago

Updated 9 months ago

datatrove by huggingface

0.3%

Data processing library for large-scale text data

Starred by

Created 2 years ago

Updated 6 days ago

Awesome-LLM by Hannibal046

0.3%

25k

Curated list of Large Language Model resources

Starred by

Created 2 years ago

Updated 2 months ago

Minitron by NVlabs

352

Compressed language models via pruning/distillation

Starred by

Created 1 year ago

Updated 11 months ago

lighteval by huggingface

0.9%

LLM evaluation toolkit for multiple backends

Starred by

Created 1 year ago

Updated 16 hours ago

llm.c by karpathy

0.2%

28k

LLM training in pure C/CUDA, no PyTorch needed

cosmopedia by huggingface

0.2%

543

Synthetic dataset for LLM training

Starred by

Created 1 year ago

Updated 10 months ago

llama-cookbook by meta-llama

0.1%

18k

Guide for building with Llama models

PurpleLlama by meta-llama

0.2%

LLM security toolkit for assessing/improving generative AI models

Starred by

Created 1 year ago

Updated 1 week ago

MiniCPM-V by OpenBMB

0.2%

22k

MLLM for vision, speech, and multimodal live streaming on your phone

Starred by

Created 1 year ago

Updated 2 weeks ago

chat_templates by chujiezheng

0.3%

704

Chat templates for HuggingFace LLMs

Starred by

Created 1 year ago

Updated 10 months ago

lm-evaluation-harness by EleutherAI

0.5%

10k

Framework for few-shot language model evaluation

mergekit by arcee-ai

0.3%

CLI tool for merging pretrained language models, combining strengths without retraining

dclm by mlfoundations

0.1%

Framework for LLM dataset creation, training, and evaluation

Starred by

Created 1 year ago

Updated 1 month ago

mamba by state-spaces

0.5%

16k

Mamba SSM architecture for sequence modeling

unsloth by unslothai

0.5%

47k

Finetuning tool for LLMs, targeting speed and memory efficiency

Awesome-Transformer-Attention by cmhungsteve

0.1%

Vision Transformer/Attention paper list

Starred by

Created 4 years ago

Updated 1 year ago

RouteLLM by lm-sys

0.3%

Framework for LLM routing and cost reduction (research paper)

Starred by

Created 1 year ago

Updated 1 year ago

NeMo by NVIDIA-NeMo

0.3%

16k

Scalable generative AI framework for LLMs, multimodal, and speech AI research

NeMo-Aligner by NVIDIA

842

Toolkit for efficient model alignment

Starred by

Created 2 years ago

Updated 1 week ago

LLaMA-Factory by hiyouga

0.6%

60k

Unified fine-tuning tool for 100+ LLMs & VLMs (ACL 2024)

Starred by

+23

Created 2 years ago

Updated 1 day ago

OpenRLHF by OpenRLHF

1.0%

RLHF framework for scalable training of large language models

Starred by

Created 2 years ago

Updated 5 days ago

Qwen3 by QwenLM

0.3%

25k

Large language model series by Qwen team, Alibaba Cloud

Online-RLHF by RLHFlow

0.4%

533

Recipe for online iterative RLHF to align LLMs

Starred by

Created 1 year ago

Updated 9 months ago

SimPO by princeton-nlp

923

Preference optimization algorithm for LLMs (NeurIPS 2024 paper)

Starred by

Created 1 year ago

Updated 8 months ago

HPT by HyperGAI

315

Open multimodal LLM framework for vision-language tasks

Created 1 year ago

Updated 1 year ago

torchtune by meta-pytorch

0.2%

PyTorch library for LLM post-training and experimentation

llama3 by meta-llama

0.1%

29k

*Deprecated* minimal example for loading and running Llama 3 models

reward-bench by allenai

639

Reward model evaluation tool

Starred by

Created 1 year ago

Updated 4 months ago

OpenHands by All-Hands-AI

0.3%

64k

AI platform for software development agents

Open-Sora-Plan by PKU-YuanGroup

0.1%

12k

Open-source project aiming to reproduce Sora-like T2V model

Starred by

Created 1 year ago

Updated 2 weeks ago

minbpe by karpathy

0.1%

10k

Minimal BPE encoder/decoder for LLM tokenization

DiT by facebookresearch

0.3%

PyTorch implementation for diffusion models with transformers (DiT)

Starred by

Created 2 years ago

Updated 1 year ago

Multi-LoRA-Composition by maszhongming

484

Training-free methods for multi-LoRA composition in image generation

Created 1 year ago

Updated 1 year ago

Awesome-Scientific-Language-Models by yuzhimanhua

611

Curated list of scientific LLMs for scientific discovery (EMNLP'24 survey)

Starred by

Created 1 year ago

Updated 3 months ago

tianshou by thu-ml

0.2%

PyTorch RL library for algorithm development and application

Starred by

Created 7 years ago

Updated 1 day ago

magicoder by ise-uiuc

0.1%

Code generation model family for instruction following

Starred by

Created 1 year ago

Updated 11 months ago

doremi by sangmichaelxie

341

PyTorch for optimizing data mixtures in language model datasets

Starred by

Created 2 years ago

Updated 1 year ago

promptbench by microsoft

0.3%

LLM evaluation framework

Starred by

Created 2 years ago

Updated 1 day ago

unified-io-2 by allenai

0.2%

628

Unified-IO 2 code for training, inference, and demo

Starred by

Created 1 year ago

Updated 1 year ago

opro by google-deepmind

0.8%

637

Research paper code for LLMs as optimizers

Created 2 years ago

Updated 10 months ago

deita by hkust-nlp

571

Data-efficient instruction tuning for LLM alignment (ICLR 2024)

Starred by

Created 1 year ago

Updated 10 months ago

MathPile by GAIR-NLP

417

Math corpus for pretraining language models

Starred by

Created 1 year ago

Updated 6 months ago

FateZero by ChenyangQiQi

Zero-shot video editor (ICCV 2023 Oral) using attention fusion

Created 2 years ago

Updated 2 years ago

weak-to-strong by openai

0.1%

Weak-to-strong generalization research paper implementation

Starred by

Created 1 year ago

Updated 1 year ago

Multimodal-AND-Large-Language-Models by Yangyi-Chen

0.1%

738

Paper list for multimodal & LLMs

Created 3 years ago

Updated 5 days ago

GPTs by linexjlin

0.1%

30k

GPT prompt collection

Starred by

Created 1 year ago

Updated 1 year ago

inbox_cleaner by isafulf

448

Python script for Gmail inbox management

Starred by

Created 1 year ago

Updated 1 year ago

Yi by 01-ai

0.0%

Open-source bilingual LLMs trained from scratch

Starred by

Created 1 year ago

Updated 10 months ago

DeepSeek-Coder by deepseek-ai

0.1%

22k

Code LLM for code completion and generation

Starred by

Created 2 years ago

Updated 1 year ago

autogen by microsoft

0.4%

51k

Agentic framework for multi-agent AI applications

Awesome-Language-Model-on-Graphs by PeterGriffinJin

0.1%

966

Curated list of papers/resources for LLMs on graphs (survey)

Created 2 years ago

Updated 7 months ago

agents by aiwaves-cn

0.0%

Open-source framework for self-evolving, data-centric autonomous language agents

Starred by

Created 2 years ago

Updated 1 year ago

LongLoRA by dvlab-research

0.0%

LongLoRA: Efficient fine-tuning for long-context LLMs

Starred by

Created 2 years ago

Updated 1 year ago

TinyLlama by jzhang38

0.1%

Tiny pretraining project for a 1.1B Llama model

codellama by meta-llama

16k

Inference code for CodeLlama models

EasyLM by young-geng

0.0%

LLM training/finetuning framework in JAX/Flax

Starred by

Created 2 years ago

Updated 1 year ago

selfcheckgpt by potsawee

0.5%

569

Hallucination detection research paper for generative LLMs using black-box methods

Starred by

Created 2 years ago

Updated 1 year ago

dolma by allenai

0.3%

Toolkit for curating datasets for language model pre-training

Starred by

Created 2 years ago

Updated 2 weeks ago

ToolLearningPapers by thunlp

908

Curated list of tool learning papers using foundation models

Starred by

Created 2 years ago

Updated 1 year ago

OpenAgents by xlang-ai

1.5%

Open platform for language agents, enabling real-world applications

Starred by

Created 2 years ago

Updated 11 months ago

llm-hallucination-survey by HillZhang1999

0.5%

Survey of hallucination in LLMs

Starred by

Created 2 years ago

Updated 2 weeks ago

FastEdit by hiyouga

Tool for fast edits to large language models

Starred by

Created 2 years ago

Updated 2 years ago

automated-interpretability by openai

0.2%

Code and datasets for automated interpretability research

Starred by

Created 2 years ago

Updated 1 year ago

LLM-Blender by yuchenlin

0.1%

965

LLM ensembling framework using pairwise ranking and generative fusion

Starred by

Created 2 years ago

Updated 11 months ago

LLMSurvey by RUCAIBox

0.2%

12k

Survey paper for large language models

Starred by

Created 2 years ago

Updated 7 months ago

gorilla by ShishirPatil

0.2%

12k

LLM tool-use framework for API invocation and function calling

xgen by salesforce

721

LLM research release with 8k sequence length

Starred by

Created 2 years ago

Updated 8 months ago

AI-Software-Startups by WarrenWen666

401

AI startup landscape survey

Starred by

Created 4 years ago

Updated 2 years ago

open_llama by openlm-research

0.0%

Open-source reproduction of LLaMA models

qlora by artidoro

0.1%

11k

Finetuning tool for quantized LLMs

DetGPT by OptimalScale

786

Vision-language model for object detection via reasoning

Created 2 years ago

Updated 1 year ago

SuperCLUE by CLUEbenchmark

0.0%

Benchmark for Chinese foundation models

Created 2 years ago

Updated 1 month ago

Multimodal-GPT by open-mmlab

Multimodal chatbot for visual/language instructions (research paper)

Starred by

Created 2 years ago

Updated 2 years ago

MiniGPT-4 by Vision-CAIR

0.0%

26k

Vision-language model for multi-task learning

starcoder by bigcode-project

0.0%

Code LM for code generation and instruction fine-tuning

LLaMA-Cult-and-More by shm007g

444

LLM resource list for models, datasets, training, and evaluation

Starred by

Created 2 years ago

Updated 2 years ago

ray by ray-project

0.2%

39k

AI compute engine for scaling Python and AI applications

Yuan-1.0 by Shawn-IEITSystems

591

Large language model for NLP tasks

Created 4 years ago

Updated 10 months ago

StableLM by Stability-AI

0.0%

16k

Language models by Stability AI

web-llm by mlc-ai

0.2%

17k

In-browser LLM inference engine using WebGPU for hardware acceleration

AutoGPT by Significant-Gravitas

0.1%

179k

AI agent platform for building, deploying, and running autonomous workflows

LLMZoo by FreedomIntelligence

LLM project provides data, models, and evaluation benchmark

Starred by

Created 2 years ago

Updated 1 year ago

FindTheChatGPTer by chenking2020

Collection of ChatGPT open-source alternatives

Starred by

Created 2 years ago

Updated 2 years ago

FastChat by lm-sys

0.1%

39k

Open platform for training, serving, and evaluating LLM-based chatbots

simpletransformers by ThilinaRajapakse

Rapid NLP task implementation

clean-dialog by lemon234071

273

Chinese dialog cleaning framework

Created 4 years ago

Updated 4 years ago

NextChat by ChatGPTNextWeb

0.1%

86k

AI assistant for web, iOS, MacOS, Android, Linux, and Windows

Starred by

Created 2 years ago

Updated 2 weeks ago

gpt4all by nomic-ai

0.1%

77k

Desktop app for local LLM inference, no GPU/API needed

chatgpt-retrieval-plugin by openai

0.0%

21k

Retrieval plugin for custom GPTs, function calling, or assistants APIs

z-bench by zhenbench

500

Chinese LLM prompt dataset for non-technical users

Starred by

Created 2 years ago

Updated 2 years ago

awesome-pretrained-chinese-nlp-models by lonePatient

0.3%

Resource list: Chinese NLP pretrained models, LLMs, multimodal models

Starred by

Created 6 years ago

Updated 2 days ago

langchain by langchain-ai

0.4%

117k

Framework for building LLM-powered applications

evals by openai

0.4%

17k

Framework for evaluating LLMs and LLM systems, plus benchmark registry

Starred by

+32

Created 2 years ago

Updated 10 months ago

ChatGLM-6B by zai-org

0.1%

41k

Bilingual dialogue language model for research

Starred by

Created 2 years ago

Updated 1 year ago

robustlearn by microsoft

501

Unified library for robust ML research

Created 3 years ago

Updated 1 year ago

stanford_alpaca by tatsu-lab

0.1%

30k

Instruction-following LLaMA model training and data generation

OpenGpt by futantan

AI platform for user-created ChatGPT applications

Starred by

Created 2 years ago

Updated 4 months ago

galai by paperswithcode

Scientific language model API

Starred by

Created 2 years ago

Updated 2 years ago

OpenChatKit by togethercomputer

0.0%

Open-source toolkit for building specialized/general-purpose chat models

document.ai by GanymedeNil

0.0%

Local knowledge base solution using vector DB and GPT-3.5

Starred by

Created 2 years ago

Updated 2 years ago

chain-of-thought-hub by FranxYao

LLM benchmark for complex reasoning via chain-of-thought prompting

Starred by

Created 2 years ago

Updated 1 year ago

pyllama by henrywoo

Hacked LLaMA version for single consumer-grade GPU inference

Starred by

Created 2 years ago

Updated 1 year ago

RL4LMs by allenai

0.3%

RL library to fine-tune language models to human preferences

Starred by

Created 3 years ago

Updated 1 year ago

llama_index by run-llama

0.2%

45k

Data framework for building LLM-powered agents

openai-python by openai

0.3%

29k

Python SDK for the OpenAI API

Starred by

+16

Created 5 years ago

Updated 19 hours ago

Prompt-Engineering-Guide by dair-ai

1.4%

63k

Prompt engineering resource for language model (LLM) applications

chatgpt-failures by giuven95

597

LLM failure archive for ChatGPT and similar models

Starred by

Created 2 years ago

Updated 2 years ago

chatgpt-demo by anse-app

Minimal web UI for ChatGPT

Created 2 years ago

Updated 1 year ago

researchgpt by mukulpatnaik

LLM-based research assistant for conversing with PDFs

Starred by

Created 2 years ago

Updated 1 year ago

dspy by stanfordnlp

0.8%

29k

Framework for programming language models, not prompting

optimate by nebuly-ai

0.0%

Collection of libraries to optimize AI model performances

Starred by

Created 3 years ago

Updated 1 year ago

BMTrain by OpenBMB

611

Training toolkit for large AI models

Created 3 years ago

Updated 1 month ago

chatgpt-pro by EyuCoder

0.2%

488

App combining ChatGPT and DALL-E functionalities

Created 2 years ago

Updated 1 year ago

react-native-chatgpt by rgommezz

0.2%

580

React Native SDK for ChatGPT integration

Created 2 years ago

Updated 2 years ago

llama by meta-llama

0.1%

59k

Inference code for Llama 2 models (deprecated)

Starred by

+38

Created 2 years ago

Updated 8 months ago

LoRA by microsoft

0.2%

13k

PyTorch library for low-rank adaptation (LoRA) of LLMs

Starred by

+12

Created 4 years ago

Updated 10 months ago

FlexLLMGen by FMInference

0.0%

High-throughput generation engine for LLMs with limited GPU memory

Starred by

+20

Created 2 years ago

Updated 11 months ago

trl by huggingface

0.7%

16k

Library for transformer RL

test by hendrycks

0.1%

Research paper for measuring multitask language understanding

Starred by

Created 5 years ago

Updated 2 years ago

ColossalAI by hpcaitech

0.0%

41k

AI system for large-scale parallel training

DS-1000 by xlang-ai

256

Benchmark for data science code generation

Starred by

Created 2 years ago

Updated 11 months ago

ChatGPTPapers by shizhediao

0.3%

322

Curated list of resources on ChatGPT pre-training/tuning

Created 2 years ago

Updated 2 years ago

hh-rlhf by anthropics

0.2%

RLHF dataset for training safe AI assistants

Starred by

Created 3 years ago

Updated 3 months ago

awesome-huge-models by zhengzangw

299

Curated list of resources for large AI models

Created 3 years ago

Updated 2 years ago

lm-human-preferences by openai

0.1%

Code for fine-tuning language models using human preferences

Starred by

Created 6 years ago

Updated 2 years ago

peft by huggingface

0.3%

20k

Parameter-efficient fine-tuning (PEFT) library

chatgpt-mac by vincelwt

Desktop app for quick-access ChatGPT

Starred by

Created 2 years ago

Updated 2 years ago

Awesome_Prompting_Papers_in_Computer_Vision by ttengwang

925

Curated list of papers on prompting in computer vision and vision-language learning

Created 3 years ago

Updated 1 year ago

helm by stanford-crfm

0.4%

Open-source Python framework for holistic evaluation of foundation models

nanoGPT by karpathy

0.8%

45k

Minimalist repo for training/finetuning GPT models

Starred by

+43

Created 2 years ago

Updated 10 months ago

Program-of-Thoughts by TIGER-AI-Lab

287

Research paper code for numerical reasoning via Program of Thoughts

Starred by

Created 2 years ago

Updated 1 year ago

self-instruct by yizhongw

0.2%

Self-Instruct: Research paper for aligning language models with self-generated instructions

Starred by

Created 2 years ago

Updated 2 years ago

pyChatGPT by terry3041

Python wrapper for OpenAI's ChatGPT API

Created 2 years ago

Updated 1 year ago

auto-cot by amazon-science

0.2%

Research paper implementation for automatic chain-of-thought prompting

Starred by

Created 3 years ago

Updated 1 year ago

manifest by HazyResearch

443

SDK for prompt programming with foundation models

Starred by

Created 3 years ago

Updated 1 year ago

awesome-chatgpt-prompts by f

0.2%

135k

Prompt collection for LLM tools

UnifiedSKG by xlang-ai

564

Unified framework for structured knowledge grounding research

Starred by

Created 3 years ago

Updated 2 years ago

ChatGPT by acheong08

0.0%

28k

Reverse-engineered API for ChatGPT, plus official OpenAI API support

Starred by

Created 2 years ago

Updated 2 years ago

awesome-ai-residency by dangkhoasdc

0.1%

Curated list of AI residency programs

Starred by

Created 7 years ago

Updated 6 months ago

ai-cli by abhagsain

0.1%

CLI tool for getting answers to terminal commands using GPT-3

Starred by

Created 2 years ago

Updated 1 year ago

zero_shot_cot by kojima-takeshi188

0.2%

431

Reasoning framework for LLMs, based on a NeurIPS 2022 paper

Starred by

Created 3 years ago

Updated 2 years ago

ama_prompting by HazyResearch

546

Language model prompting strategy research paper

Starred by

Created 3 years ago

Updated 2 years ago

whisper by openai

0.4%

89k

Speech recognition model for multilingual transcription/translation

stable-diffusion by CompVis

0.1%

72k

Latent text-to-image diffusion model

alpa by alpa-projects

0.0%

Auto-parallelization framework for large-scale neural network training and serving

LaMDA-rlhf-pytorch by conceptofmind

472

PyTorch pre-training for LaMDA research paper

Starred by

Created 3 years ago

Updated 1 year ago

rome by kmeng01

0.3%

673

Model editing research paper for GPT-2 and GPT-J

Starred by

Created 3 years ago

Updated 1 year ago

libai by Oneflow-Inc

407

Large-scale distributed parallel training toolbox

Starred by

Created 4 years ago

Updated 2 months ago

LMaaS-Papers by txsun1997

548

Curated list of LMaaS research papers

Starred by

Created 3 years ago

Updated 1 year ago

YaLM-100B by yandex

GPT-like neural network for text generation/processing

Starred by

Created 3 years ago

Updated 2 years ago

Black-Box-Tuning by txsun1997

0.4%

272

Gradient-free tuning method for Language-Model-as-a-Service

Starred by

Created 3 years ago

Updated 2 years ago

open_clip by mlfoundations

0.4%

13k

OpenCLIP: open-source CLIP implementation for vision-language representation learning

LAMA by facebookresearch

Language model probe for factual/commonsense knowledge analysis (research paper)

Starred by

Created 6 years ago

Updated 1 year ago

DALLE2-pytorch by lucidrains

0.0%

11k

PyTorch implementation of DALL-E 2, a text-to-image synthesis neural network

adapters by adapter-hub

0.1%

Unified library for parameter-efficient transfer learning in NLP

Starred by

Created 5 years ago

Updated 2 days ago

dalle-2-preview by openai

Starred by

Created 3 years ago

Updated 3 years ago

training by mlcommons

0.1%

Reference implementations for MLPerf training benchmarks

Starred by

Created 7 years ago

Updated 3 weeks ago

ru-dalle by ai-forever

Text-to-image generation in Russian

Starred by

Created 4 years ago

Updated 2 years ago

guided-diffusion by openai

0.1%

Image synthesis codebase for diffusion models

Starred by

Created 4 years ago

Updated 1 year ago

OFA by OFA-Sys

Unified sequence-to-sequence model for cross-modality, vision, and language tasks

Starred by

Created 3 years ago

Updated 1 year ago

unilm by microsoft

0.1%

22k

Foundation models for language, vision, speech, and multimodal tasks

ibot by bytedance

747

Image BERT pre-training via self-distillation research paper

Created 3 years ago

Updated 3 years ago

X-VLM by zengyan-97

484

Vision-language model for multi-grained alignment (ICML 2022 paper)

Starred by

Created 3 years ago

Updated 2 years ago

Awesome-Text-to-Image by Yutong-Zhou-cv

0.3%

Survey on text-to-image generation/synthesis

Starred by

Created 5 years ago

Updated 3 weeks ago

METER by zdou0830

373

Multimodal framework for vision-and-language transformer research

Starred by

Created 4 years ago

Updated 2 years ago

vit-pytorch by lucidrains

0.2%

24k

PyTorch library for Vision Transformer variants and related techniques

Fengshenbang-LM by IDEA-CCNL

0.1%

Chinese foundation model ecosystem for AI infrastructure

Starred by

Created 4 years ago

Updated 1 year ago

paper-reading by mli

0.3%

32k

Deep learning paper readings

Starred by

Created 4 years ago

Updated 6 months ago

External-Attention-pytorch by xmu-xiaoma666

0.1%

12k

Pytorch implementations of attention, backbones, MLPs, etc. for research

Created 4 years ago

Updated 10 months ago

mrc-for-flat-nested-ner by ShannonAI

676

Research paper code for named entity recognition via unified MRC framework

Created 5 years ago

Updated 2 years ago

LM-BFF by princeton-nlp

729

Research paper on few-shot fine-tuning of language models

Starred by

Created 4 years ago

Updated 3 years ago

few-shot-learning by tonyzhaozh

356

Few-shot learning codebase for language models, similar to GPT-3

Created 4 years ago

Updated 2 years ago

Expert-Advisor-Studio by fintechees

0.6%

320

Browser-based platform for creating trading robots (Expert Advisors)

Created 6 years ago

Updated 3 months ago

GPT2-Chinese by Morizeyao

0.0%

GPT2 training code for Chinese language models

Starred by

Created 6 years ago

Updated 1 year ago

nlp-phd-global-equality by zhijing-jin

946

Resource list for global equality in NLP/AI PhD admissions and careers

Created 4 years ago

Updated 1 year ago

CBLUE by CBLUEbenchmark

0.4%

809

Benchmark for Chinese biomedical language understanding

Created 4 years ago

Updated 2 years ago

PromptPapers by thunlp

0.0%

Paper list for prompt-based tuning of pre-trained language models

Starred by

Created 4 years ago

Updated 2 years ago

CodeXGLUE by microsoft

0.3%

Benchmark for code intelligence tasks

Starred by

Created 5 years ago

Updated 1 year ago

AutoSub by abhirooptalasila

0.9%

639

CLI tool for generating video subtitles

Created 5 years ago

Updated 1 year ago

Awesome-Visual-Transformer by dk-liang

0.1%

Vision transformer paper collection

Starred by

Created 4 years ago

Updated 9 months ago

taming-transformers by CompVis

0.1%

Image synthesis research paper using transformers

P-tuning by THUDM

935

Parameter-efficient tuning method for language models

Created 4 years ago

Updated 3 years ago

big-sleep by lucidrains

0.0%

CLI tool for text-to-image generation

Starred by

Created 4 years ago

Updated 3 years ago

minGPT by karpathy

0.2%

23k

Minimal PyTorch re-implementation for GPT training and inference

gpt-neo by EleutherAI

GPT-2/3-style model implementation using mesh-tensorflow

TradingGym by Yvictor

0.1%

Trading environment for reinforcement learning agent training and backtesting

Starred by

Created 8 years ago

Updated 1 year ago

deep-trading-agent by samre12

0.2%

788

Bitcoin trading agent using deep reinforcement learning

Created 8 years ago

Updated 7 years ago

btgym by Kismuz

0.1%

RL-friendly backtesting library for algorithmic trading research

Created 8 years ago

Updated 4 years ago

machine-learning-for-trading by stefan-jansen

0.2%

16k

ML code for algorithmic trading strategies

Starred by

Created 7 years ago

Updated 1 year ago

awesome-deep-trading by cbailes

0.3%

List of resources for machine learning-based algorithmic trading

Starred by

Created 6 years ago

Updated 2 years ago

DALLE-pytorch by lucidrains

PyTorch implementation of DALL-E, OpenAI's text-to-image transformer

Starred by

Created 4 years ago

Updated 1 year ago

CLIP by openai

0.3%

31k

Image-text matching model for zero-shot prediction

lit by PAIR-code

0.1%

Interactive ML model analysis tool for understanding model behavior

Starred by

Created 5 years ago

Updated 1 month ago

image-gpt by teddykoker

0.8%

260

PyTorch implementation of Image GPT research paper

Starred by

Created 5 years ago

Updated 2 years ago

bigbird by google-research

0.3%

620

Sparse-attention transformer extends BERT-like models to longer sequences

Starred by

Created 4 years ago

Updated 3 years ago

gpt-2-simple by minimaxir

0.0%

Python package for GPT-2 text generation model fine-tuning

Starred by

Created 6 years ago

Updated 2 years ago

qlib by microsoft

0.8%

32k

AI platform for quantitative investment research and production

Starred by

Created 5 years ago

Updated 2 weeks ago

zvt by zvtvz

0.4%

Modular quant framework for backtesting and research

Created 6 years ago

Updated 3 weeks ago

fastformers by microsoft

707

NLU optimization recipes for transformer models

Starred by

Created 5 years ago

Updated 6 months ago

BERT-flow by bohanli

534

TensorFlow code for sentence embeddings research paper

Created 5 years ago

Updated 4 years ago

TUPE by guolinke

252

Transformer research paper exploring positional encoding

Created 5 years ago

Updated 3 years ago

prophet by facebook

0.1%

20k

Forecasting tool for time series data

acl2020-openqa-tutorial by danqi

832

Tutorial for open-domain question answering research

Starred by

Created 5 years ago

Updated 4 years ago

faiss by facebookresearch

bort by alexa

471

Companion code for research paper on BERT subarchitecture extraction

Starred by

Created 5 years ago

Updated 3 years ago

Megatron-LM by NVIDIA

0.5%

14k

Framework for training transformer models at scale

gpt-3 by openai

16k

Research paper on large language model few-shot learning

pet by timoschick

Code for pattern-exploiting training (PET) research paper

Starred by

Created 5 years ago

Updated 2 years ago

datasets by huggingface

0.1%

21k

Access and process large AI datasets efficiently

pytorch_block_sparse by huggingface

547

PyTorch extension for block-sparse linear layers

Starred by

Created 5 years ago

Updated 4 years ago

fairseq by facebookresearch

0.0%

32k

Sequence modeling toolkit for translation, language modeling, and text generation research

s2orc by allenai

0.4%

976

Corpus for NLP/text mining research on scientific papers

Starred by

Created 6 years ago

Updated 1 year ago

RL-Stock by wangshub

0.2%

RL agent for stock trading

Created 5 years ago

Updated 2 years ago

jukebox by openai

0.1%

Generative model for music research paper

Starred by

Created 5 years ago

Updated 1 year ago

wandb by wandb

0.3%

10k

AI developer platform for model training, fine-tuning, and management

image-gpt by openai

0.1%

Image generation research paper, code, and models

Starred by

Created 5 years ago

Updated 3 years ago

pycorrector by shibing624

0.1%

Toolkit for text error correction, supports multiple models for Chinese

Starred by

Created 7 years ago

Updated 1 month ago

reformer-pytorch by lucidrains

PyTorch implementation of the Reformer, an efficient Transformer research paper

Starred by

Created 5 years ago

Updated 2 years ago

xla by pytorch

0.1%

PyTorch on XLA devices

BigGAN-PyTorch by ajbrock

0.1%

PyTorch code for BigGAN image synthesis research paper

Starred by

Created 6 years ago

Updated 2 years ago

WeChatExtension-ForMac by MustangYM

0.0%

23k

Plugin for Mac WeChat

Created 6 years ago

Updated 8 months ago

awesome-deeplearning-resources by endymecy

0.0%

Deep learning research paper and code repository

Starred by

Created 9 years ago

Updated 2 weeks ago

blocksparse by openai

0.1%

TensorFlow ops/GPU kernels for block-sparse matrix multiplication and convolution

Starred by

Created 7 years ago

Updated 2 years ago

sparse_attention by openai

Sparse attention primitives for research

Starred by

Created 6 years ago

Updated 5 years ago

RLSeq2Seq by yaserkl

768

Research paper code for sequence-to-sequence models using deep reinforcement learning

Starred by

Created 7 years ago

Updated 2 years ago

awesome-bert by Jiakui

0.1%

BERT resources aggregation: papers, applications, and GitHub repos

Created 6 years ago

Updated 4 years ago

sentence-transformers by UKPLab

0.2%

18k

Framework for text embeddings, retrieval, and reranking

PPLM by uber-research

PPLM: Steerable text generation research paper

Starred by

Created 6 years ago

Updated 1 year ago

OpenNMT-py by OpenNMT

0.1%

PyTorch framework for neural machine translation and LLM experimentation

Deep-reinforcement-learning-with-pytorch by sweetice

0.2%

PyTorch library for deep reinforcement learning algorithms

Starred by

Created 7 years ago

Updated 2 years ago

rlpyt by astooke

PyTorch library for deep reinforcement learning research

Starred by

Created 6 years ago

Updated 4 years ago

apex by NVIDIA

0.1%

PyTorch extension for streamlined mixed precision & distributed training

awesome-sentence-embedding by Separius

0.0%

Curated list of pretrained sentence/word embedding models

Starred by

Created 6 years ago

Updated 4 years ago

UER-py by dbiir

0.2%

PyTorch toolkit for pre-training and fine-tuning NLP models

Starred by

Created 6 years ago

Updated 1 year ago

bert-chinese-ner by ProHiryu

0.1%

967

Fine-tunes BERT for Chinese NER

Created 6 years ago

Updated 5 years ago

finetune-transformer-lm by openai

Code for generative pre-training research paper

Starred by

Created 7 years ago

Updated 6 years ago

nlp_chinese_corpus by brightmart

0.1%

10k

Chinese NLP corpus for pre-training and language model tasks

Starred by

Created 6 years ago

Updated 1 month ago

transformers by huggingface

0.2%

151k

ML library for pretrained model inference and training

bert by google-research

0.1%

40k

TensorFlow code and pre-trained models for BERT

xlnet by zihangdai

Language model research paper using generalized autoregressive pretraining

Starred by

Created 6 years ago

Updated 2 years ago

deeplearning-guide by sannykim

0.1%

717

Guide to learning Deep Learning effectively

Created 7 years ago

Updated 5 years ago

gpt-2 by openai

0.1%

24k

Code for research paper "Language Models are Unsupervised Multitask Learners"

chatbot by zhaoyingjun

Chatbot for intelligent customer service, online Q&A, and general chat

Created 7 years ago

Updated 5 days ago

ChatBotCourse by lcdevelop

0.0%

Tutorial for building a chatbot

Created 9 years ago

Updated 3 years ago

tensorflow by tensorflow

0.1%

192k

Open-source ML framework

Feedback? Help us improve.