Teknium

updated 11 months ago

Starred by

Jeremy Howard(Cofounder of fast.ai) and

Omar Sanseviero(DevRel at Google DeepMind).

GPTeacher by teknium1

GPT-4 generated datasets for instruction tuning

RL environment framework for LLM trajectory collection/evaluation

Starred Projects (74)

Starred by

Georgios Konstantopoulos(CTO, General Partner at Paradigm) and

Thomas Wolf(Cofounder of Hugging Face).

atropos by NousResearch

1.2%

570

created 3 months ago

Starred by

Jeff Hammerbacher(Cofounder of Cloudera),

Didier Lopes(Founder of OpenBB), and

5 more.

open-infra-index by deepseek-ai

AI infrastructure tools for efficient AGI development

created 5 months ago

Procedural dataset generator for reasoning models

reasoning-gym by open-thought

1.7%

created 6 months ago

updated 12 hours ago

coconut by facebookresearch

1.4%

Research paper implementation for LLM reasoning in latent space

created 6 months ago

updated 6 months ago

antislop-sampler by sam-paech

310

Sampler for reducing undesirable LLM outputs via backtracking

created 10 months ago

updated 5 days ago

Starred by

Jeremy Howard(Cofounder of fast.ai).

Reflection_Tuning by tianyi-lab

359

Research paper for LLM instruction tuning via data recycling

Reasoning tasks collection for LLMs

updated 11 months ago

Starred by

Philipp Schmid(DevRel at Google DeepMind) and

Jeremy Howard(Cofounder of fast.ai).

Open-Reasoning-Tasks by NousResearch

448

LLM inference engine for serving HuggingFace models at scale

updated 10 months ago

Starred by

Michael Han(Cofounder of Unsloth),

Jeremy Howard(Cofounder of fast.ai), and

1 more.

aphrodite-engine by aphrodite-engine

0.7%

Web app for LLM prompt experimentation and optimization

updated 2 days ago

Starred by

Jeremy Howard(Cofounder of fast.ai).

Prompt-Engineering-Toolkit by teknium1

0.5%

411

updated 11 months ago

Starred by

Alexander Wettig(Author of SWE-bench, SWE-agent).

dclm by mlfoundations

Framework for LLM dataset creation, training, and evaluation

updated 4 months ago

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems),

Ying Sheng(Author of SGLang), and

2 more.

storm by stanford-oval

LLM system for automated knowledge curation and article generation

27k

updated 1 month ago

Starred by

Tobi Lutke(Cofounder of Shopify),

Boris Cherny(Creator of Claude Code; MTS at Anthropic), and

8 more.

ai-town by a16z-infra

AI town starter kit for building a virtual world

Function-calling code for LLMs, demoing financial queries

updated 5 months ago

Starred by

Elie Bursztein(Cybersecurity Lead at Google DeepMind) and

Pietro Schirano(Founder of MagicPath).

Hermes-Function-Calling by NousResearch

2.9%

Framework for autonomous AI agent orchestration via role-playing and collaboration

updated 10 months ago

Starred by

Tobi Lutke(Cofounder of Shopify),

Jeff Hammerbacher(Cofounder of Cloudera), and

6 more.

crewAI by crewAIInc

0.9%

35k

CLI tool for merging pretrained language models, combining strengths without retraining

Starred by

Ying Sheng(Author of SGLang),

Travis Fischer(Founder of Agentic), and

10 more.

mergekit by arcee-ai

0.5%

Unified-IO 2 code for training, inference, and demo

updated 3 days ago

Starred by

Jiayi Pan(Author of SWE-Gym; AI Researcher at UC Berkeley) and

Nathan Lambert(AI Researcher at AI2).

unified-io-2 by allenai

0.3%

619

Starred by

Tobi Lutke(Cofounder of Shopify),

Matei Zaharia(Cofounder of Databricks), and

27 more.

dspy by stanfordnlp

Framework for programming language models, not prompting

27k

Starred by

Jeremy Howard(Cofounder of fast.ai),

Philipp Schmid(DevRel at Google DeepMind), and

5 more.

distilabel by argilla-io

Framework for synthetic data and AI feedback pipelines

Open-source interface for interactive 3D character communication

updated 4 days ago

amica by semperai

0.8%

Data cleaning/curation tool for unstructured text datasets

updated 1 week ago

galactic by taylorai

328

Data-Juicer: Data processing system for foundation models

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems),

Alexander Wettig(Author of SWE-bench, SWE-agent), and

1 more.

data-juicer by modelscope

0.7%

Tiny pretraining project for a 1.1B Llama model

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

George Hotz(Author of tinygrad; Founder of the tiny corp, comma.ai), and

9 more.

TinyLlama by jzhang38

0.3%

gpt-llm-trainer by mshumer

LLM fine-tuning pipeline

updated 3 months ago

Starred by

Tobi Lutke(Cofounder of Shopify),

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), and

4 more.

generative_agents by joonspk-research

Research paper code for interactive human behavior simulation using generative agents

19k

Starred by

Tobi Lutke(Cofounder of Shopify),

Stas Bekman(Author of Machine Learning Engineering Open Book; Research Engineer at Snowflake), and

20 more.

guidance by guidance-ai

Guidance is a programming paradigm for steering LLMs

21k

updated 23 hours ago

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems) and

Philipp Schmid(DevRel at Google DeepMind).

LLM-Blender by yuchenlin

LLM ensembling framework using pairwise ranking and generative fusion

956

Browser extension for enhanced ChatGPT experience

updated 9 months ago

superpower-chatgpt by saeedezzati

Local conversational engine demo with audio

Starred by

Georgi Gerganov(Author of llama.cpp, whisper.cpp).

talk by yacineMTB

591

Starred by

Jeremy Howard(Cofounder of fast.ai),

Eugene Yan(AI Scientist at AWS), and

1 more.

airoboros by jondurbin

Self-instruct tool for LLM finetuning

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems),

Jeremy Howard(Cofounder of fast.ai), and

3 more.

llm-awq by mit-han-lab

Weight quantization research paper for LLM compression/acceleration

updated 2 weeks ago

Starred by

Jiayi Pan(Author of SWE-Gym; AI Researcher at UC Berkeley),

Jeremy Howard(Cofounder of fast.ai), and

2 more.

prm800k by openai

Dataset of LLM solutions to math problems with step-level correctness labels

Starred by

Calvin French-Owen(Coounder of Segment),

Travis Fischer(Founder of Agentic), and

2 more.

tree-of-thoughts by kyegomez

Plug-and-play implementation of Tree of Thoughts for LLM reasoning

updated 4 days ago

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems),

Jeremy Howard(Cofounder of fast.ai), and

1 more.

alpaca_farm by tatsu-lab

RLHF simulation framework for accessible instruction-following/alignment research

819

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems),

Jeremy Howard(Cofounder of fast.ai), and

3 more.

promptsource by bigscience-workshop

Toolkit for creating, sharing, and using natural language prompts

created 4 years ago

Inference code and configs for ReplitLM model family

Starred by

Tobi Lutke(Cofounder of Shopify),

Travis Fischer(Founder of Agentic), and

1 more.

ReplitLM by replit

985

Starred by

Didier Lopes(Founder of OpenBB),

Fabian Hedin(Cofounder of Lovable), and

2 more.

bittensor by opentensor

Bittensor SDK for building internet-scale neural networks

created 5 years ago

updated 2 days ago

Starred by

Tobi Lutke(Cofounder of Shopify),

Patrick von Platen(Core Contributor to Hugging Face Transformers and Diffusers), and

12 more.

axolotl by axolotl-ai-cloud

CLI tool for streamlined post-training of AI models

10k

updated 22 hours ago

Starred by

Jeremy Howard(Cofounder of fast.ai).

UltraChat by thunlp

Multi-round dialogue dataset and models for chat language model training

Framework for grounded instruction datasets and domain-expert LLMs

Starred by

Omar Sanseviero(DevRel at Google DeepMind).

OpenGPT by CogStack

0.3%

358

API wrapper for local LLM inference, emulating OpenAI's GPT endpoints

gpt-llama.cpp by keldenl

598

Quickstart for a ChatGPT TODO list plugin

Starred by

Charlie Holtz(Founder of Melty) and

Logan Kilpatrick(Product Lead on Google AI Studio).

plugins-quickstart by openai

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems) and

Omar Sanseviero(DevRel at Google DeepMind).

threestudio by threestudio-project

Framework for 3D content generation from text/images using 2D diffusion

updated 7 months ago

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems),

Woosuk Kwon(Author of vLLM), and

10 more.

WizardLM by nlpxucan

LLMs built using Evol-Instruct for complex instruction following

updated 1 month ago

AIwaifu by HRNPH

Open-source project for creating a customizable AI waifu

480

Web interface for chatting with customizable characters

updated 8 months ago

OpenCharacters by josephrocca

396

RAG app for Paul Graham's essays

updated 4 months ago

Starred by

Georgios Konstantopoulos(CTO, General Partner at Paradigm) and

Mckay Wrigley(Founder of Takeoff AI).

paul-graham-gpt by mckaywrigley

LLM frontend for power users

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems) and

Pietro Schirano(Founder of MagicPath).

SillyTavern by SillyTavern

3.2%

17k

updated 2 days ago

Starred by

Lilian Weng(Cofounder of Thinking Machines Lab),

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n), and

41 more.

transformers by huggingface

ML library for pretrained model inference and training

148k

created 6 years ago

updated 10 hours ago

Starred by

Walden Yan(Cofounder of Cognition).

Teenage-AGI by seanpixel

914

Python project for AI agent experimentation

Starred by

Matei Zaharia(Cofounder of Databricks),

Carol Willing(Core Contributor to CPython, Jupyter), and

6 more.

dolly by databrickslabs

Instruction-following LLM trained on the Databricks Machine Learning Platform

11k

Starred by

Tobi Lutke(Cofounder of Shopify),

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), and

1 more.

xTuring by stochasticai

SDK for fine-tuning and customizing open-source LLMs

Voice assistant using dual wake words

updated 10 months ago

Bing-GPT-Voice-Assistant by Ai-Austin

274

Starred by

Aravind Srinivas(Cofounder of Perplexity),

Stas Bekman(Author of Machine Learning Engineering Open Book; Research Engineer at Snowflake), and

11 more.

DeepSpeed by deepspeedai

Deep learning optimization library for distributed training and inference

40k

created 5 years ago

updated 21 hours ago

Starred by

Mckay Wrigley(Founder of Takeoff AI) and

Travis Fischer(Founder of Agentic).

ai-legion by eumemic

LLM-powered autonomous agent platform

Starred by

Jeremy Howard(Cofounder of fast.ai),

Georgios Konstantopoulos(CTO, General Partner at Paradigm), and

2 more.

GPT-4-LLM by Instruction-Tuning-with-GPT-4

GPT-4 data for instruction-tuning LLMs via supervised/RL

Starred by

Tobi Lutke(Cofounder of Shopify),

Tim J. Baek(Founder of Open WebUI), and

19 more.

text-generation-inference by huggingface

Rust/Python/gRPC server for fast LLM text generation

10k

updated 1 week ago

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems),

Jeff Hammerbacher(Cofounder of Cloudera), and

2 more.

LLaMA-Adapter by OpenGVLab

Efficient fine-tuning for instruction-following LLaMA models

Chat model trained via LoRA, using ChatGPT-generated dialogs

Starred by

Ying Sheng(Author of SGLang),

Bojan Tunguz(AI Scientist; Formerly at NVIDIA), and

1 more.

baize-chatbot by project-baize

Starred by

Anastasios Angelopoulos(Cofounder of LMArena),

Omar Sanseviero(DevRel at Google DeepMind), and

20 more.

FastChat by lm-sys

Open platform for training, serving, and evaluating LLM-based chatbots

39k

Starred by

Jeremy Howard(Cofounder of fast.ai) and

Omar Sanseviero(DevRel at Google DeepMind).

GPTeacher by teknium1

GPT-4 generated datasets for instruction tuning

Starred by

Carol Willing(Core Contributor to CPython, Jupyter),

Omar Sanseviero(DevRel at Google DeepMind), and

16 more.

gpt4all by nomic-ai

Desktop app for local LLM inference, no GPU/API needed

74k

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems),

Georgios Konstantopoulos(CTO, General Partner at Paradigm), and

1 more.

gptq by IST-DASLab

Code for GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers

Starred by

Tobi Lutke(Cofounder of Shopify),

Omar Sanseviero(DevRel at Google DeepMind), and

2 more.

AlpacaDataCleaned by gururise

Cleaned dataset for Alpaca LLM training

Fine-tuned LLaMA weights, recreated from Stanford Alpaca

point-alpaca by pointnetwork

405

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems),

Georgios Konstantopoulos(CTO, General Partner at Paradigm), and

1 more.

GPTQ-for-LLaMa by qwopqwop200

4-bit quantization for LLaMA models using GPTQ

Tool for regenerative healing of Python scripts using GPT

Starred by

Daniel Gross(Cofounder of Safe Superintelligence),

Mckay Wrigley(Founder of Takeoff AI), and

1 more.

wolverine by biobootloader

Starred by

Nat Friedman(Former CEO of GitHub),

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), and

5 more.

FasterTransformer by NVIDIA

Optimized transformer library for inference

created 4 years ago

AI Twitch chat bot using GPT-3 and Google Cloud TTS

Kuebiko by adi-panda

380

updated 8 months ago

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

John Yang(Author of SWE-bench, SWE-agent), and

12 more.

stanford_alpaca by tatsu-lab

Instruction-following LLaMA model training and data generation

30k

Rust ecosystem for LLM Rust inference (unmaintained)

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems),

Shawn Wang(Editor of Latent Space), and

7 more.

llm by rustformers

ChatWaifu by cjyaddone

Chatbot for simulating conversations with waifu-style characters

832

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems),

Ying Sheng(Author of SGLang), and

8 more.

alpaca-lora by tloen

LoRA fine-tuning for LLaMA

19k

Starred by

Anton Osika(Cofounder of Lovable),

Eugene Yan(AI Scientist at AWS), and

5 more.

OpenChatKit by togethercomputer

Open-source toolkit for building specialized/general-purpose chat models

Code for running and fine-tuning LLaMA models

minimal-llama by zphang

458