Georgi Gerganov

Author of llama.cpp, whisper.cpp

Starred Projects (122)

LlamaBarn by ggml-org

Easy local LLM deployment on Mac

julien-c:

Created 6 months ago

Updated 2 days ago

cactus by cactus-compute

Framework for on-device AI, targeting mobile and wearables

shimmyshimmer:

timsuchanek:

danielhanchen:

thomwolf:

Created 8 months ago

Updated 11 hours ago

lemonade by lemonade-sdk

Local LLM serving with hardware acceleration

transitive-bullshit:

tjbck:

Created 8 months ago

Updated 17 hours ago

PlayDiffusion by playht

Diffusion model for speech editing

luiscape:

Created 7 months ago

Updated 3 months ago

SmolChat-Android by shubham0204

Android app for local SLM/LLM inference

osanseviero:

Created 1 year ago

Updated 1 week ago

Qwen3 by QwenLM

Large language model series by Qwen team, Alibaba Cloud

teetone:

vincentweisser:

sxyu:

transitive-bullshit:

Created 1 year ago

Updated 2 days ago

smolvlm-realtime-webcam by ngxson

Webcam demo using SmolVLM for real-time object detection

lysandrejik:

thomwolf:

Created 8 months ago

Updated 8 months ago

ChatterUI by Vali-98

Mobile app frontend for LLMs

Created 2 years ago

Updated 1 month ago

transformers by huggingface

ML library for pretrained model inference and training

clmnt:

lilianweng:

karpathy:

tjbck:

Created 7 years ago

Updated 1 day ago

easy-whisper-ui by mehtabmahir

Desktop app for fast, GPU-accelerated audio/video transcription

Created 9 months ago

Updated 1 day ago

orpheus-tts-local by isaiahbjork

Local client for text-to-speech using LM Studio API

Created 9 months ago

Updated 9 months ago

VoiceInk by Beingpax

macOS app for local, private voice-to-text transcription

binarybana:

jrk:

wsxiaoys:

Created 1 year ago

Updated 3 hours ago

Sidekick by johnbean393

macOS app for local LLM chat using files, folders, and websites

domoritz:

Created 1 year ago

Updated 1 month ago

llama-swap by mostlygeek

Proxy server for local model swapping with llama.cpp

Created 1 year ago

Updated 3 hours ago

OLMoE.swift by allenai

Swift app for local, offline AI experience

natolambert:

Created 1 year ago

Updated 9 months ago

llama.vscode by ggml-org

VS Code extension for local LLM-assisted code completion

ogabrielluiz:

Created 1 year ago

Updated 3 days ago

WavTokenizer by jishengpeng

Research paper for discrete acoustic codec models

amin3141:

Created 1 year ago

Updated 10 months ago

meshgen by huggingface

AI agents for Blender control via natural language

osanseviero:

lysandrejik:

Created 1 year ago

Updated 9 months ago

shell_sage by AnswerDotAI

CLI tool for terminal context analysis using LLMs

claforte:

binarybana:

Created 1 year ago

Updated 1 week ago

OuteTTS by edwko

TTS interface for unified text-to-speech, treating audio as language

abidlabs:

tjbck:

luiscape:

Created 1 year ago

Updated 6 months ago

search by kelindar

Go library for embedded vector search and semantic embeddings

luiscape:

Created 1 year ago

Updated 6 months ago

llama.vim by ggml-org

Vim plugin for LLM-assisted code/text completion

antirez:

mcollina:

swyxio:

dguido:

Created 1 year ago

Updated 1 week ago

pocketpal-ai by a-ghorbani

Mobile app for on-device language model inference

Created 1 year ago

Updated 1 hour ago

llama-assistant by nrl-ai

Local AI assistant for daily tasks, powered by Llama 3

Created 1 year ago

Updated 1 month ago

gpustack by gpustack

GPU cluster manager for AI model deployment

hammer:

stas00:

transitive-bullshit:

Created 1 year ago

Updated 1 day ago

LARS by abgulati

Desktop app for local LLM RAG with detailed citations

tobi:

Created 1 year ago

Updated 1 year ago

llama-zip by AlexBuz

LLM-powered lossless compression tool

Created 1 year ago

Updated 1 week ago

paddler by intentee

Load balancer for llama.cpp servers

Created 1 year ago

Updated 4 days ago

huggingface.js by huggingface

JS utils for Hugging Face Hub API interaction

clmnt:

abidlabs:

thomwolf:

osanseviero:

Created 2 years ago

Updated 1 day ago

pi-card by nkasmanoff

Voice assistant for Raspberry Pi

Created 1 year ago

Updated 1 year ago

llm.c by karpathy

LLM training in pure C/CUDA, no PyTorch needed

norvig:

alexey-milovidov:

didierrlopes:

hiyouga:

Created 1 year ago

Updated 6 months ago

Dot by alexpinel

Local RAG app for document interaction using local LLMs

AlexCheema:

omarsar:

joewalnes:

Created 1 year ago

Updated 1 year ago

LLocalSearch by nilsherzig

Local search aggregator using LLM agents

tobi:

chiphuyen:

omarsar:

jmorganca:

Created 1 year ago

Updated 1 month ago

wllama by ngxson

WebAssembly binding for on-browser LLM inference

simonw:

Created 1 year ago

Updated 3 weeks ago

tlm by yusufcanb

Local CLI copilot using Ollama for command-line assistance

Created 1 year ago

Updated 2 months ago

openvino-plugins-ai-audacity by intel

AI plugins for Audacity audio editor, running locally

v4dkou:

Created 2 years ago

Updated 3 months ago

nucleo-ai by AndrewVeee

AI assistant app mixing AI features with personal productivity

Created 1 year ago

Updated 1 year ago

gemma.cpp by google

C++ inference engine for Google's Gemma models

karpathy:

tjbck:

osanseviero:

chiphuyen:

Created 1 year ago

Updated 1 day ago

minbpe by karpathy

Minimal BPE encoder/decoder for LLM tokenization

hammer:

willingc:

chiphuyen:

shizhediao:

Created 1 year ago

Updated 1 year ago

reor by reorproject

Local AI personal knowledge management app

tobi:

chiphuyen:

jmorganca:

osanseviero:

Created 2 years ago

Updated 8 months ago

llama-cpp-wasm by tangledgroup

Wasm build for llama.cpp

Created 1 year ago

Updated 1 year ago

tenere by pythops

Rust TUI for LLM interaction

jmorganca:

vanpelt:

Created 2 years ago

Updated 4 months ago

distributed-llama by b4rtaz

CLI tool for distributed LLM inference across networked devices

ogabrielluiz:

Created 2 years ago

Updated 1 month ago

chatllm.cpp by foldl

C++ inference for real-time chatting with RAG

Created 2 years ago

Updated 21 hours ago

llama-cpp-agent by Maximilian-Winter

Framework for LLM interaction, function calls, and structured output

transitive-bullshit:

Created 2 years ago

Updated 10 months ago

LLMUnity by undreamai

Unity package for LLM integration, enabling AI characters

Created 2 years ago

Updated 21 hours ago

gguf-tools by antirez

CLI tool for GGUF file manipulation and analysis

sqs:

simonw:

Created 2 years ago

Updated 4 months ago

PowerInfer by SJTU-IPADS

LLM inference engine for local deployment on consumer GPUs

lysandrejik:

osanseviero:

vincentweisser:

ogabrielluiz:

Created 2 years ago

Updated 5 months ago

SpeziLLM by StanfordSpezi

LLM integration for Swift applications

soldni:

Created 2 years ago

Updated 1 month ago

LLMFarm by guinmoon

iOS/MacOS app for local LLM inference

JustinLin610:

vincentweisser:

Created 2 years ago

Updated 1 month ago

mlx by ml-explore

Array framework for machine learning on Apple silicon

geohot:

karpathy:

ekzhang:

lysandrejik:

Created 2 years ago

Updated 10 hours ago

LLM.swift by eastriverlee

Swift SDK for local LLM interaction on Apple platforms

soldni:

Created 2 years ago

Updated 1 month ago

seamless_communication by facebookresearch

Multilingual speech and text translation models for natural communication

parano:

tjbck:

jiamings:

luiscape:

Created 2 years ago

Updated 1 year ago

gpt-fast by meta-pytorch

PyTorch text generation for efficient transformer inference

karpathy:

antiagainst:

jamesr66a:

merrymercy:

Created 2 years ago

Updated 4 months ago

llamafile by mozilla-ai

Single-file LLM distribution and runtime via `llama.cpp` and Cosmopolitan Libc

karpathy:

anildash:

mholt:

hahnbeelee:

Created 2 years ago

Updated 1 day ago

swiss_army_llama by Dicklesworthstone

FastAPI service for semantic text search using precomputed embeddings

simonw:

pgarbacki:

Created 2 years ago

Updated 10 months ago

prompt-lookup-decoding by apoorvumang

Decoding method for faster LLM generation

zhyncs:

stas00:

jph00:

casper-hansen:

Created 2 years ago

Updated 1 year ago

vit.cpp by staghado

C/C++ inference engine for Vision Transformer (ViT) models

Created 2 years ago

Updated 1 year ago

llavavision by lxe

Web app for describing scenes using a local LLM

hugs:

Created 2 years ago

Updated 2 years ago

LLaVA by haotian-liu

Multimodal assistant with GPT-4 level capabilities

shizhediao:

zhiyuan8:

transitive-bullshit:

patrickvonplaten:

Created 2 years ago

Updated 1 year ago

qwen.cpp by QwenLM

C++ project for Qwen-LM inference (now integrated into llama.cpp)

alexchen4ai:

bratseth:

JustinLin610:

osanseviero:

Created 2 years ago

Updated 1 year ago

magentic by jackmpcollins

SDK for integrating LLMs as Python functions using decorators

osanseviero:

didierrlopes:

jph00:

vanpelt:

Created 2 years ago

Updated 1 month ago

localpilot by danielgross

Local Copilot alternative for offline use

mikeyk:

vincentweisser:

ashtom:

codekansas:

Created 2 years ago

Updated 1 year ago

octogen by dbpunk-labs

Open-source framework for code interpreter agents

wsxiaoys:

Created 2 years ago

Updated 1 year ago

open-interpreter by openinterpreter

Natural language interface for computers

norvig:

luiscape:

shimmyshimmer:

peakji:

Created 2 years ago

Updated 1 month ago

gptme by gptme

CLI tool for terminal agent workflows

ezyang:

AntonOsika:

fabhed:

victortaelin:

Created 2 years ago

Updated 3 hours ago

sam.cpp by YavorGIvanov

C/C++ inference for Meta's Segment Anything Model (SAM)

jrk:

Created 2 years ago

Updated 2 years ago

TinyLlama by jzhang38

Tiny pretraining project for a 1.1B Llama model

karpathy:

geohot:

tobi:

chiphuyen:

Created 2 years ago

Updated 1 year ago

java-llama.cpp by kherud

Java SDK for local LLaMA model inference

Created 2 years ago

Updated 6 months ago

llama.rn by mybigday

React Native binding for llama.cpp

Created 2 years ago

Updated 1 day ago

llama-gpt by getumbrel

Self-hosted chatbot app for local, private LLM inference

peerrich:

omarsar:

transitive-bullshit:

dguido:

Created 2 years ago

Updated 1 year ago

Jlama by tjake

LLM inference engine for Java applications

Created 2 years ago

Updated 3 months ago

stable-diffusion.cpp by leejet

C/C++ inference for Stable Diffusion models

tobi:

alexchen4ai:

andreasjansson:

antirez:

Created 2 years ago

Updated 1 hour ago

LLM-Reading-List by evanmiller

LLM paper list focused on efficient inference and compression

codekansas:

transitive-bullshit:

simonw:

simon-mo:

Created 2 years ago

Updated 2 years ago

minigpt4.cpp by Maknee

C++ port for MiniGPT4 inference

jmorganca:

Created 2 years ago

Updated 2 years ago

tabby by TabbyML

Self-hosted AI coding assistant for on-prem code completion

tobi:

joewalnes:

wsxiaoys:

pgarbacki:

Created 2 years ago

Updated 5 days ago

bark.cpp by PABannier

C/C++ library for fast, local text-to-speech generation using Suno AI's Bark model

tjbck:

gkucsko:

kmfreyberg:

codekansas:

Created 2 years ago

Updated 1 year ago

inference by xorbitsai

Model serving library for language, speech, and multimodal models

hiyouga:

JustinLin610:

transitive-bullshit:

Created 2 years ago

Updated 21 hours ago

chatglm.cpp by li-plus

C++ project for ChatGLM & GLM model inference

alexchen4ai:

Created 2 years ago

Updated 1 year ago

clip.cpp by monatis

Plain C/C++ CLIP inference, dependency-free

generall:

Created 2 years ago

Updated 6 months ago

talk by yacineMTB

Local conversational engine demo with audio

codekansas:

mschrage:

teknium1:

Created 2 years ago

Updated 2 years ago

tinydiarize by akashmjn

Finetuned speech model for speaker diarization

tobi:

jrk:

codekansas:

Created 2 years ago

Updated 2 years ago

ctransformers by marella

Python bindings for fast Transformer model inference

tobi:

chiphuyen:

lukas:

JustinLin610:

Created 2 years ago

Updated 1 year ago

starcoder.cpp by bigcode-project

C++ example for StarCoder inference

jaredpalmer:

eugeneyan:

simonw:

Created 2 years ago

Updated 2 years ago

LLamaSharp by SciSharp

C#/.NET library for local LLM inference (LLaMA/LLaVA, etc.)

Created 2 years ago

Updated 1 week ago

bert.cpp by skeskinen

C++ library for local BERT inference

mudler:

Created 2 years ago

Updated 1 year ago

WizardLM by nlpxucan

LLMs built using Evol-Instruct for complex instruction following

vincentweisser:

chiphuyen:

WoosukKwon:

ishaan-jaff:

Created 2 years ago

Updated 7 months ago

alpaca-electron by ItsPi3141

Desktop app for local LLM inference

Created 2 years ago

Updated 1 year ago

bark by suno-ai

Generative audio model for realistic speech and sound effects

tobi:

jiamings:

pgarbacki:

chiphuyen:

Created 2 years ago

Updated 1 year ago

whisper.unity by Macoron

Unity3d bindings for local speech-to-text inference

Created 2 years ago

Updated 8 months ago

llama-node by Atome-FE

Node.js library for local LLM inference

yagil:

gakonst:

transitive-bullshit:

Created 2 years ago

Updated 2 years ago

llama.go by gotzmann

Go library for local LLM inference, like llama.cpp

Created 2 years ago

Updated 1 year ago

LlamaChat by alexrozanski

macOS app for local LLM chats

Created 2 years ago

Updated 2 years ago

turbopilot by ravenscroftj

Self-hosted code completion engine (deprecated)

hammer:

cournape:

omarsar:

gakonst:

Created 2 years ago

Updated 2 years ago

rwkv.cpp by RWKV

CPU inference lib for RWKV language model

simonw:

casper-hansen:

victortaelin:

codekansas:

Created 2 years ago

Updated 9 months ago

cheetah by leetcode-mafia

Mac app for crushing tech interviews with AI

dguido:

mckaywrigley:

Created 2 years ago

Updated 1 year ago

rllama by Noeda

Rust CLI tool for LLaMA model inference

gakonst:

Created 2 years ago

Updated 1 year ago

transformers.js by huggingface

Run Transformers models directly in your browser

clmnt:

tjbck:

ankane:

doriandarko:

Created 2 years ago

Updated 1 day ago

llama-cpp-python by abetlen

Python bindings for llama.cpp, enabling local LLM inference

atroyn:

lysandrejik:

JustinLin610:

osanseviero:

Created 2 years ago

Updated 4 months ago

LocalAI by mudler

Open-source OpenAI alternative for local AI inference

tobi:

hammer:

tjbck:

JustinLin610:

Created 2 years ago

Updated 1 hour ago

openplayground by nat

LLM playground for local laptop use

tobi:

codekansas:

ericciarla:

AntonOsika:

Created 2 years ago

Updated 2 days ago

vigogne by bofenghuang

French LLMs for instruction-following and chat

mlabonne:

Created 2 years ago

Updated 1 year ago

Chinese-LLaMA-Alpaca by ymcui

Chinese LLaMA & Alpaca: LLMs for Chinese NLP research

hiyouga:

Created 2 years ago

Updated 6 months ago

whisper.rn by mybigday

React Native binding for high-performance local speech recognition

Created 2 years ago

Updated 1 month ago

pywhispercpp by absadiki

Python bindings for whisper.cpp, enabling local speech transcription

Created 2 years ago

Updated 1 week ago

cformers by NolanoOrg

CPU inference for transformer models via a C++ backend

wsxiaoys:

Created 2 years ago

Updated 2 years ago

llm by rustformers

Rust ecosystem for LLM Rust inference (unmaintained)

chiphuyen:

luiscape:

swyxio:

flaque:

Created 2 years ago

Updated 1 year ago

bloomz.cpp by NouamaneTazi

C++ project for BLOOM model inference

clmnt:

lewtun:

antirez:

transitive-bullshit:

Created 2 years ago

Updated 2 years ago

faster-whisper by SYSTRAN

Faster Whisper reimplementation using CTranslate2

dguido:

luiscape:

jph00:

tjbck:

Created 2 years ago

Updated 1 month ago

whispercpp by aarnphm

Pybind11 bindings for whisper.cpp

Created 2 years ago

Updated 1 year ago

llama by meta-llama

Inference code for Llama 2 models (deprecated)

froystig:

xiezhq-hermann:

fabhed:

borzunov:

Created 2 years ago

Updated 11 months ago

whisper.net by sandrohanea

.NET library for speech-to-text using Whisper models

Created 2 years ago

Updated 1 week ago

Whisper by Const-me

GPGPU inference for OpenAI's Whisper ASR model

Created 3 years ago

Updated 1 year ago

eepp by SpartanJ

Cross-platform framework for game/application development focused on rich GUIs

Created 7 years ago

Updated 1 day ago

cbp-translate by elanmart

Cyberpunk-style video translation with modern DL stack

nat:

hammer:

aksh-at:

luiscape:

Created 3 years ago

Updated 3 years ago

ChatARKit by trzy

AR app for natural language AR experience creation via ChatGPT

Created 3 years ago

Updated 2 years ago

flash-attention by Dao-AILab

Fast, memory-efficient attention implementation

karpathy:

Jiayi-Pan:

zhiyuan8:

alexchen4ai:

Created 3 years ago

Updated 14 hours ago

teleprompter by danielgross

On-device teleprompter for charismatic speech using quotes

luiscape:

vnivargi:

omarsar:

Created 3 years ago

Updated 3 years ago

transcriber_app by davabase

Real-time speech-to-text transcription app

Created 3 years ago

Updated 3 years ago

galai by paperswithcode

Scientific language model API

shizhediao:

vincentweisser:

amix:

RJT1990:

Created 3 years ago

Updated 2 years ago

buzz by chidiwilliams

Desktop app for offline audio transcription and translation

transitive-bullshit:

mxstbr:

Created 3 years ago

Updated 17 hours ago

whisper by openai

Speech recognition model for multilingual transcription/translation

bcherny:

karpathy:

ogabrielluiz:

zhyncs:

Created 3 years ago

Updated 3 weeks ago

Feedback? Help us improve.