SourcePulse logo
HomeBrowse all repos
ggerganov avatar

Georgi Gerganov

Author of llama.cpp, whisper.cpp

GitHubX

Starred Projects (121)

LlamaBarn by ggml-org

3.7%
311
Easy local LLM deployment on Mac
Created 4 months ago
Updated 6 days ago

cactus by cactus-compute

2.2%
4k
Framework for on-device AI, targeting mobile and wearables
Starred by
timsuchanek:
danielhanchen:
thomwolf:
jmorganca:
+3
Created 6 months ago
Updated 23 hours ago

lemonade by lemonade-sdk

1.8%
2k
Local LLM serving with hardware acceleration
Starred by
transitive-bullshit:
tjbck:
Created 5 months ago
Updated 15 hours ago

PlayDiffusion by playht

0.6%
526
Diffusion model for speech editing
Starred by
luiscape:
Created 5 months ago
Updated 1 month ago

SmolChat-Android by shubham0204

1.4%
554
Android app for local SLM/LLM inference
Starred by
osanseviero:
Created 11 months ago
Updated 3 days ago

Qwen3 by QwenLM

0.3%
25k
Large language model series by Qwen team, Alibaba Cloud
Starred by
sxyu:
transitive-bullshit:
omarsar:
developit:
+11
Created 1 year ago
Updated 3 weeks ago

smolvlm-realtime-webcam by ngxson

0.2%
5k
Webcam demo using SmolVLM for real-time object detection
Starred by
lysandrejik:
thomwolf:
Created 5 months ago
Updated 5 months ago

ChatterUI by Vali-98

0.4%
2k
Mobile app frontend for LLMs
Created 2 years ago
Updated 1 week ago

transformers by huggingface

0.2%
152k
ML library for pretrained model inference and training
Starred by
clmnt:
lilianweng:
karpathy:
tjbck:
+96
Created 7 years ago
Updated 9 hours ago

orpheus-tts-local by isaiahbjork

0.6%
482
Local client for text-to-speech using LM Studio API
Created 7 months ago
Updated 7 months ago

VoiceInk by Beingpax

14.4%
2k
macOS app for local, private voice-to-text transcription
Starred by
binarybana:
jrk:
wsxiaoys:
Created 1 year ago
Updated 3 days ago

Sidekick by johnbean393

0.2%
3k
macOS app for local LLM chat using files, folders, and websites
Starred by
domoritz:
Created 1 year ago
Updated 3 months ago

llama-swap by mostlygeek

2.7%
2k
Proxy server for local model swapping with llama.cpp
Created 1 year ago
Updated 14 hours ago

OLMoE.swift by allenai

0%
299
Swift app for local, offline AI experience
Starred by
natolambert:
Created 1 year ago
Updated 6 months ago

llama.vscode by ggml-org

1.2%
1k
VS Code extension for local LLM-assisted code completion
Starred by
ogabrielluiz:
Created 10 months ago
Updated 1 day ago

WavTokenizer by jishengpeng

0.3%
1k
Research paper for discrete acoustic codec models
Starred by
amin3141:
Created 1 year ago
Updated 8 months ago

meshgen by huggingface

0%
666
AI agents for Blender control via natural language
Starred by
osanseviero:
lysandrejik:
Created 1 year ago
Updated 6 months ago

shell_sage by AnswerDotAI

1.6%
375
CLI tool for terminal context analysis using LLMs
Starred by
claforte:
binarybana:
Created 11 months ago
Updated 1 day ago

OuteTTS by edwko

0.3%
1k
TTS interface for unified text-to-speech, treating audio as language
Starred by
abidlabs:
tjbck:
luiscape:
Created 1 year ago
Updated 4 months ago

search by kelindar

0.6%
507
Go library for embedded vector search and semantic embeddings
Starred by
luiscape:
Created 1 year ago
Updated 4 months ago

llama.vim by ggml-org

0.3%
2k
Vim plugin for LLM-assisted code/text completion
Starred by
antirez:
mcollina:
swyxio:
dguido:
Created 1 year ago
Updated 1 week ago

pocketpal-ai by a-ghorbani

0.7%
5k
Mobile app for on-device language model inference
Created 1 year ago
Updated 1 day ago

llama-assistant by nrl-ai

0.2%
522
Local AI assistant for daily tasks, powered by Llama 3
Created 1 year ago
Updated 8 months ago

gpustack by gpustack

0.7%
4k
GPU cluster manager for AI model deployment
Starred by
hammer:
stas00:
transitive-bullshit:
Created 1 year ago
Updated 9 hours ago

LARS by abgulati

0.3%
620
Desktop app for local LLM RAG with detailed citations
Starred by
tobi:
Created 1 year ago
Updated 1 year ago

llama-zip by AlexBuz

0%
289
LLM-powered lossless compression tool
Created 1 year ago
Updated 1 year ago

paddler by intentee

0.3%
1k
Load balancer for llama.cpp servers
Created 1 year ago
Updated 1 week ago

huggingface.js by huggingface

0.3%
2k
JS utils for Hugging Face Hub API interaction
Starred by
clmnt:
abidlabs:
thomwolf:
osanseviero:
+3
Created 2 years ago
Updated 14 hours ago

pi-card by nkasmanoff

0.1%
803
Voice assistant for Raspberry Pi
Created 1 year ago
Updated 10 months ago

llm.c by karpathy

0.2%
28k
LLM training in pure C/CUDA, no PyTorch needed
Starred by
norvig:
alexey-milovidov:
didierrlopes:
hiyouga:
+26
Created 1 year ago
Updated 4 months ago

Dot by alexpinel

0%
2k
Local RAG app for document interaction using local LLMs
Starred by
AlexCheema:
omarsar:
joewalnes:
Created 1 year ago
Updated 11 months ago

LLocalSearch by nilsherzig

0%
6k
Local search aggregator using LLM agents
Starred by
tobi:
omarsar:
jmorganca:
Created 1 year ago
Updated 6 months ago

wllama by ngxson

0.4%
924
WebAssembly binding for on-browser LLM inference
Starred by
simonw:
Created 1 year ago
Updated 4 weeks ago

tlm by yusufcanb

0.2%
1k
Local CLI copilot using Ollama for command-line assistance
Created 1 year ago
Updated 1 week ago

openvino-plugins-ai-audacity by intel

0.6%
2k
AI plugins for Audacity audio editor, running locally
Starred by
v4dkou:
Created 2 years ago
Updated 1 month ago

nucleo-ai by AndrewVeee

0%
327
AI assistant app mixing AI features with personal productivity
Created 1 year ago
Updated 1 year ago

gemma.cpp by google

0.1%
7k
C++ inference engine for Google's Gemma models
Starred by
karpathy:
tjbck:
osanseviero:
chiphuyen:
+4
Created 1 year ago
Updated 1 day ago

minbpe by karpathy

0.2%
10k
Minimal BPE encoder/decoder for LLM tokenization
Starred by
hammer:
willingc:
chiphuyen:
shizhediao:
+11
Created 1 year ago
Updated 1 year ago

reor by reorproject

0.1%
8k
Local AI personal knowledge management app
Starred by
tobi:
chiphuyen:
jmorganca:
osanseviero:
+1
Created 1 year ago
Updated 5 months ago

llama-cpp-wasm by tangledgroup

0%
281
Wasm build for llama.cpp
Created 1 year ago
Updated 1 year ago

tenere by pythops

0.5%
607
Rust TUI for LLM interaction
Starred by
jmorganca:
vanpelt:
Created 2 years ago
Updated 2 months ago

distributed-llama by b4rtaz

0.3%
3k
CLI tool for distributed LLM inference across networked devices
Starred by
ogabrielluiz:
Created 1 year ago
Updated 1 day ago

chatllm.cpp by foldl

0.8%
733
C++ inference for real-time chatting with RAG
Created 1 year ago
Updated 16 hours ago

llama-cpp-agent by Maximilian-Winter

0%
602
Framework for LLM interaction, function calls, and structured output
Starred by
transitive-bullshit:
Created 1 year ago
Updated 8 months ago

LLMUnity by undreamai

0.5%
1k
Unity package for LLM integration, enabling AI characters
Created 1 year ago
Updated 2 months ago

gguf-tools by antirez

0.3%
293
CLI tool for GGUF file manipulation and analysis
Starred by
sqs:
simonw:
Created 1 year ago
Updated 2 months ago

PowerInfer by SJTU-IPADS

0.1%
8k
LLM inference engine for local deployment on consumer GPUs
Starred by
lysandrejik:
osanseviero:
vincentweisser:
ogabrielluiz:
+5
Created 1 year ago
Updated 3 months ago

SpeziLLM by StanfordSpezi

0%
273
LLM integration for Swift applications
Starred by
soldni:
Created 2 years ago
Updated 1 week ago

LLMFarm by guinmoon

0.2%
2k
iOS/MacOS app for local LLM inference
Starred by
JustinLin610:
vincentweisser:
Created 2 years ago
Updated 1 month ago

mlx by ml-explore

0.3%
23k
Array framework for machine learning on Apple silicon
Starred by
geohot:
karpathy:
jmorganca:
chiphuyen:
+36
Created 1 year ago
Updated 17 hours ago

LLM.swift by eastriverlee

0.6%
770
Swift SDK for local LLM interaction on Apple platforms
Starred by
soldni:
Created 1 year ago
Updated 1 month ago

seamless_communication by facebookresearch

0.1%
12k
Multilingual speech and text translation models for natural communication
Starred by
parano:
tjbck:
jiamings:
luiscape:
+4
Created 2 years ago
Updated 11 months ago

gpt-fast by meta-pytorch

0.1%
6k
PyTorch text generation for efficient transformer inference
Starred by
karpathy:
antiagainst:
jamesr66a:
merrymercy:
+20
Created 2 years ago
Updated 2 months ago

llamafile by mozilla-ai

0.3%
23k
Single-file LLM distribution and runtime via `llama.cpp` and Cosmopolitan Libc
Starred by
karpathy:
anildash:
mholt:
hahnbeelee:
+20
Created 2 years ago
Updated 22 hours ago

swiss_army_llama by Dicklesworthstone

0.1%
1k
FastAPI service for semantic text search using precomputed embeddings
Starred by
simonw:
pgarbacki:
Created 2 years ago
Updated 8 months ago

prompt-lookup-decoding by apoorvumang

0.2%
573
Decoding method for faster LLM generation
Starred by
zhyncs:
stas00:
jph00:
casper-hansen:
Created 1 year ago
Updated 1 year ago

vit.cpp by staghado

0.3%
295
C/C++ inference engine for Vision Transformer (ViT) models
Created 2 years ago
Updated 1 year ago

llavavision by lxe

0%
492
Web app for describing scenes using a local LLM
Starred by
hugs:
Created 2 years ago
Updated 1 year ago

LLaVA by haotian-liu

0.2%
24k
Multimodal assistant with GPT-4 level capabilities
Starred by
shizhediao:
zhiyuan8:
transitive-bullshit:
patrickvonplaten:
+16
Created 2 years ago
Updated 1 year ago

qwen.cpp by QwenLM

0%
605
C++ project for Qwen-LM inference (now integrated into llama.cpp)
Starred by
alexchen4ai:
bratseth:
JustinLin610:
osanseviero:
Created 2 years ago
Updated 11 months ago

magentic by jackmpcollins

0.0%
2k
SDK for integrating LLMs as Python functions using decorators
Starred by
osanseviero:
didierrlopes:
jph00:
vanpelt:
+1
Created 2 years ago
Updated 2 weeks ago

localpilot by danielgross

0.0%
3k
Local Copilot alternative for offline use
Starred by
mikeyk:
vincentweisser:
ashtom:
codekansas:
+3
Created 2 years ago
Updated 1 year ago

octogen by dbpunk-labs

0%
257
Open-source framework for code interpreter agents
Starred by
wsxiaoys:
Created 2 years ago
Updated 1 year ago

open-interpreter by openinterpreter

0.1%
61k
Natural language interface for computers
Starred by
norvig:
luiscape:
shimmyshimmer:
peakji:
+33
Created 2 years ago
Updated 1 day ago

gptme by gptme

0.2%
4k
CLI tool for terminal agent workflows
Starred by
ezyang:
AntonOsika:
fabhed:
victortaelin:
Created 2 years ago
Updated 9 hours ago

sam.cpp by YavorGIvanov

0%
1k
C/C++ inference for Meta's Segment Anything Model (SAM)
Starred by
jrk:
Created 2 years ago
Updated 2 years ago

TinyLlama by jzhang38

0.1%
9k
Tiny pretraining project for a 1.1B Llama model
Starred by
karpathy:
geohot:
tobi:
chiphuyen:
+18
Created 2 years ago
Updated 1 year ago

java-llama.cpp by kherud

0.3%
386
Java SDK for local LLaMA model inference
Created 2 years ago
Updated 4 months ago

llama.rn by mybigday

0.7%
708
React Native binding for llama.cpp
Created 2 years ago
Updated 1 day ago

llama-gpt by getumbrel

0.0%
11k
Self-hosted chatbot app for local, private LLM inference
Starred by
peerrich:
omarsar:
transitive-bullshit:
dguido:
+1
Created 2 years ago
Updated 1 year ago

Jlama by tjake

0.3%
1k
LLM inference engine for Java applications
Created 2 years ago
Updated 3 weeks ago

stable-diffusion.cpp by leejet

0.5%
5k
C/C++ inference for Stable Diffusion models
Starred by
tobi:
alexchen4ai:
andreasjansson:
antirez:
+4
Created 2 years ago
Updated 1 day ago

LLM-Reading-List by evanmiller

0%
743
LLM paper list focused on efficient inference and compression
Starred by
codekansas:
transitive-bullshit:
simonw:
simon-mo:
Created 2 years ago
Updated 1 year ago

minigpt4.cpp by Maknee

0%
568
C++ port for MiniGPT4 inference
Starred by
jmorganca:
Created 2 years ago
Updated 2 years ago

tabby by TabbyML

0.2%
32k
Self-hosted AI coding assistant for on-prem code completion
Starred by
tobi:
joewalnes:
wsxiaoys:
pgarbacki:
+17
Created 2 years ago
Updated 21 hours ago

bark.cpp by PABannier

0%
843
C/C++ library for fast, local text-to-speech generation using Suno AI's Bark model
Starred by
tjbck:
gkucsko:
kmfreyberg:
codekansas:
Created 2 years ago
Updated 11 months ago

inference by xorbitsai

0.3%
9k
Model serving library for language, speech, and multimodal models
Starred by
hiyouga:
JustinLin610:
transitive-bullshit:
Created 2 years ago
Updated 1 day ago

chatglm.cpp by li-plus

0.0%
3k
C++ project for ChatGLM & GLM model inference
Starred by
alexchen4ai:
Created 2 years ago
Updated 1 year ago

clip.cpp by monatis

0.6%
530
Plain C/C++ CLIP inference, dependency-free
Starred by
generall:
Created 2 years ago
Updated 4 months ago

talk by yacineMTB

0%
592
Local conversational engine demo with audio
Starred by
codekansas:
mschrage:
teknium1:
Created 2 years ago
Updated 2 years ago

tinydiarize by akashmjn

0%
524
Finetuned speech model for speaker diarization
Starred by
tobi:
jrk:
codekansas:
Created 2 years ago
Updated 2 years ago

ctransformers by marella

0%
2k
Python bindings for fast Transformer model inference
Starred by
tobi:
chiphuyen:
lukas:
JustinLin610:
+8
Created 2 years ago
Updated 1 year ago

starcoder.cpp by bigcode-project

0%
455
C++ example for StarCoder inference
Starred by
jaredpalmer:
eugeneyan:
simonw:
Created 2 years ago
Updated 2 years ago

LLamaSharp by SciSharp

0.3%
3k
C#/.NET library for local LLM inference (LLaMA/LLaVA, etc.)
Created 2 years ago
Updated 3 days ago

bert.cpp by skeskinen

0.2%
495
C++ library for local BERT inference
Starred by
mudler:
Created 2 years ago
Updated 1 year ago

WizardLM by nlpxucan

0.0%
9k
LLMs built using Evol-Instruct for complex instruction following
Starred by
vincentweisser:
chiphuyen:
WoosukKwon:
ishaan-jaff:
+15
Created 2 years ago
Updated 5 months ago

alpaca-electron by ItsPi3141

0%
1k
Desktop app for local LLM inference
Created 2 years ago
Updated 1 year ago

bark by suno-ai

0.1%
39k
Generative audio model for realistic speech and sound effects
Starred by
tobi:
pgarbacki:
chiphuyen:
tjbck:
+18
Created 2 years ago
Updated 1 year ago

whisper.unity by Macoron

0.3%
643
Unity3d bindings for local speech-to-text inference
Created 2 years ago
Updated 6 months ago

llama-node by Atome-FE

0%
870
Node.js library for local LLM inference
Starred by
yagil:
gakonst:
transitive-bullshit:
Created 2 years ago
Updated 2 years ago

llama.go by gotzmann

0.1%
1k
Go library for local LLM inference, like llama.cpp
Created 2 years ago
Updated 1 year ago

LlamaChat by alexrozanski

0%
2k
macOS app for local LLM chats
Created 2 years ago
Updated 2 years ago

turbopilot by ravenscroftj

0%
4k
Self-hosted code completion engine (deprecated)
Starred by
hammer:
cournape:
omarsar:
gakonst:
+4
Created 2 years ago
Updated 2 years ago

rwkv.cpp by RWKV

0.1%
2k
CPU inference lib for RWKV language model
Starred by
simonw:
casper-hansen:
victortaelin:
codekansas:
Created 2 years ago
Updated 7 months ago

cheetah by leetcode-mafia

0.3%
4k
Mac app for crushing tech interviews with AI
Starred by
dguido:
mckaywrigley:
Created 2 years ago
Updated 9 months ago

rllama by Noeda

0.2%
550
Rust CLI tool for LLaMA model inference
Starred by
gakonst:
Created 2 years ago
Updated 1 year ago

transformers.js by huggingface

0.2%
15k
Run Transformers models directly in your browser
Starred by
clmnt:
tjbck:
ankane:
doriandarko:
+12
Created 2 years ago
Updated 6 days ago

llama-cpp-python by abetlen

0.1%
10k
Python bindings for llama.cpp, enabling local LLM inference
Starred by
atroyn:
lysandrejik:
JustinLin610:
osanseviero:
+11
Created 2 years ago
Updated 2 months ago

LocalAI by mudler

1.7%
37k
Open-source OpenAI alternative for local AI inference
Starred by
tobi:
tjbck:
JustinLin610:
mudler:
+13
Created 2 years ago
Updated 9 hours ago

openplayground by nat

0%
6k
LLM playground for local laptop use
Starred by
tobi:
codekansas:
ericciarla:
AntonOsika:
+17
Created 2 years ago
Updated 1 month ago

vigogne by bofenghuang

0%
506
French LLMs for instruction-following and chat
Starred by
mlabonne:
Created 2 years ago
Updated 11 months ago

Chinese-LLaMA-Alpaca by ymcui

0.1%
19k
Chinese LLaMA & Alpaca: LLMs for Chinese NLP research
Starred by
hiyouga:
Created 2 years ago
Updated 3 months ago

whisper.rn by mybigday

0.8%
656
React Native binding for high-performance local speech recognition
Created 2 years ago
Updated 6 days ago

pywhispercpp by absadiki

0.3%
296
Python bindings for whisper.cpp, enabling local speech transcription
Created 2 years ago
Updated 3 days ago

cformers by NolanoOrg

0%
308
CPU inference for transformer models via a C++ backend
Starred by
wsxiaoys:
Created 2 years ago
Updated 1 year ago

llm by rustformers

0.0%
6k
Rust ecosystem for LLM Rust inference (unmaintained)
Starred by
chiphuyen:
luiscape:
swyxio:
flaque:
+9
Created 2 years ago
Updated 1 year ago

bloomz.cpp by NouamaneTazi

0%
806
C++ project for BLOOM model inference
Starred by
clmnt:
lewtun:
antirez:
transitive-bullshit:
+3
Created 2 years ago
Updated 2 years ago

faster-whisper by SYSTRAN

0.5%
19k
Faster Whisper reimplementation using CTranslate2
Starred by
dguido:
luiscape:
jph00:
tjbck:
+1
Created 2 years ago
Updated 4 days ago

whispercpp by aarnphm

0.3%
341
Pybind11 bindings for whisper.cpp
Created 2 years ago
Updated 11 months ago

llama by meta-llama

0.1%
59k
Inference code for Llama 2 models (deprecated)
Starred by
froystig:
xiezhq-hermann:
fabhed:
borzunov:
+38
Created 2 years ago
Updated 9 months ago

whisper.net by sandrohanea

0%
819
.NET library for speech-to-text using Whisper models
Created 2 years ago
Updated 4 days ago

Whisper by Const-me

0.2%
10k
GPGPU inference for OpenAI's Whisper ASR model
Created 2 years ago
Updated 1 year ago

eepp by SpartanJ

0%
505
Cross-platform framework for game/application development focused on rich GUIs
Created 7 years ago
Updated 1 day ago

cbp-translate by elanmart

0%
1k
Cyberpunk-style video translation with modern DL stack
Starred by
nat:
hammer:
aksh-at:
luiscape:
Created 2 years ago
Updated 2 years ago

ChatARKit by trzy

0%
439
AR app for natural language AR experience creation via ChatGPT
Created 2 years ago
Updated 2 years ago

flash-attention by Dao-AILab

0.6%
20k
Fast, memory-efficient attention implementation
Starred by
karpathy:
Jiayi-Pan:
zhiyuan8:
alexchen4ai:
+31
Created 3 years ago
Updated 23 hours ago

teleprompter by danielgross

0%
331
On-device teleprompter for charismatic speech using quotes
Starred by
luiscape:
vnivargi:
omarsar:
Created 2 years ago
Updated 2 years ago

transcriber_app by davabase

0.5%
427
Real-time speech-to-text transcription app
Created 2 years ago
Updated 2 years ago

galai by paperswithcode

0%
3k
Scientific language model API
Starred by
shizhediao:
vincentweisser:
amix:
RJT1990:
+5
Created 3 years ago
Updated 2 years ago

buzz by chidiwilliams

0.3%
16k
Desktop app for offline audio transcription and translation
Starred by
transitive-bullshit:
mxstbr:
Created 3 years ago
Updated 22 hours ago

whisper by openai

0.3%
90k
Speech recognition model for multilingual transcription/translation
Starred by
bcherny:
karpathy:
ogabrielluiz:
zhyncs:
+40
Created 3 years ago
Updated 1 month ago
Feedback? Help us improve.