Ettore Di Giacinto

Author of LocalAI

Authored Projects (6)

Starred by

Jeremy Howard

Jeremy Howard(Cofounder of fast.ai).

parakeet.cpp by mudler

High-performance C++ ASR inference

Efficient offline and streaming speech recognition using NVIDIA Parakeet models, eliminating Python dependencies.
Runs on CPU and GPU (CUDA, Metal) via ggml, supporting CTC, RNNT, and TDT model types.
Delivers byte-identical transcripts to NeMo, significantly faster than NeMo and whisper.cpp.
Features cache-aware streaming with EOU detection and supports GGUF quantization for optimized performance.

Created 2 months ago

Updated 15 hours ago

Starred by

Tobi Lutke

Tobi Lutke(Cofounder of Shopify),

Salvatore Sanfilippo

Salvatore Sanfilippo(Author of Redis),

Jeff Hammerbacher

Jeff Hammerbacher(Cofounder of Cloudera),

Tim J. Baek

Tim J. Baek(Founder of Open WebUI), and

15 more.

LocalAI by mudler

Open-source OpenAI alternative for local AI inference

Runs LLMs, generates images/audio on consumer hardware, no GPU needed.
Compatible with OpenAI API, Elevenlabs, Anthropic.
Supports gguf, transformers, diffusers, and more model architectures.
Includes text generation, voice cloning, distributed/P2P inference.

Created 3 years ago

Updated 1 day ago

Starred by

Georgi Gerganov

Georgi Gerganov(Author of llama.cpp, whisper.cpp).

locate-anything.cpp by mudler

Fast C++ object detection for any text prompt

Enables open-vocabulary detection on images via text prompts, outputting precise bounding boxes.
Leverages C++17 and ggml for efficient, Python-free inference, running on CPU or GPU.
Ports NVIDIA's LocateAnything-3B model, offering identical detections with significant speedups.
Provides a CLI tool and C++ library for integration into applications.

Created 1 month ago

Updated 5 days ago

LocalRecall by mudler

Local knowledge base for AI agents

Provides a 100% local, offline RESTful API for managing knowledge bases and files.
Supports RAG with local vector stores (ChromaDB) and integrates with agent frameworks.
Handles text, Markdown, and PDF files, with plans for more formats.
Includes a web UI for file management and external source monitoring.

Created 1 year ago

Updated 1 week ago

depth-anything.cpp by mudler

C++ inference engine for monocular depth and camera pose

Generates dense metric depth, confidence, and camera pose from single images.
Dependency-free C++17/ggml port of Depth Anything 3, using self-contained GGUF models.
Optimized CPU inference, faster than PyTorch, with CUDA/Metal/Vulkan GPU backend options.
Exports 3D point clouds and glb/COLMAP formats; embeddable via a flat C API.

Created 1 month ago

Updated 1 month ago

LocalAGI by mudler

Self-hostable AI agent platform for local, private AI automation

No-code agent creation via web UI; OpenAI Responses API drop-in.
Agent teaming, planning/reasoning, short/long-term memory via LocalRecall.
Connectors for Discord, Slack, Telegram, GitHub, IRC; REST API.
Supports CPU, NVIDIA/Intel GPUs; text, multimodal, image models.

Created 3 years ago

Updated 1 month ago

Starred Projects (30)

depth-anything.cpp by mudler

C++ inference engine for monocular depth and camera pose

Created 1 month ago

Updated 1 month ago

privacy-filter.cpp by localai-org

Minimal C++/GGML runtime for PII/NER entity detection

Created 1 month ago

Updated 3 weeks ago

locate-anything.cpp by mudler

Fast C++ object detection for any text prompt

ggerganov:

Created 1 month ago

Updated 5 days ago

parakeet.cpp by mudler

High-performance C++ ASR inference

jph00:

Created 2 months ago

Updated 15 hours ago

apex-quant by localai-org

MoE-aware mixed-precision quantization for LLMs

winglian:

Created 3 months ago

Updated 1 month ago

dimos by dimensionalOS

Agent-native OS and SDK for physical robotics

Created 1 year ago

Updated 15 hours ago

LocalRecall by mudler

Local knowledge base for AI agents

Created 1 year ago

Updated 1 week ago

upscayl by upscayl

AI image upscaler app for Linux, macOS, and Windows

luiscape:

chiphuyen:

taranjeet:

transitive-bullshit:

Created 4 years ago

Updated 6 days ago

gguf-parser-go by gpustack

Analyze GGUF models and estimate inference resources

Created 2 years ago

Updated 2 weeks ago

ha-llmvision by valentinfrlch

Home Assistant integration for multimodal LLM vision

chiphuyen:

Created 2 years ago

Updated 2 days ago

llama3 by meta-llama

*Deprecated* minimal example for loading and running Llama 3 models

tobi:

mckaywrigley:

osanseviero:

simonw:

Created 2 years ago

Updated 1 year ago

llm.c by karpathy

LLM training in pure C/CUDA, no PyTorch needed

norvig:

alexey-milovidov:

didierrlopes:

hiyouga:

Created 2 years ago

Updated 1 year ago

grok-1 by xai-org

JAX example code for loading and running Grok-1 open-weights model

geohot:

yiranwu0:

omarsar:

handotdev:

Created 2 years ago

Updated 1 year ago

LWM by LargeWorldModel

Multimodal autoregressive model for long-context video/text

mateiz:

chiphuyen:

Jiayi-Pan:

pgarbacki:

Created 2 years ago

Updated 1 year ago

intel-extension-for-transformers by intel

Transformer toolkit for GenAI/LLM acceleration on Intel platforms

winglian:

osanseviero:

Created 3 years ago

Updated 1 year ago

GenossGPT by theodo-group

One-line replacement API for OpenAI, using OSS models

ishaan-jaff:

marcklingen:

osanseviero:

Created 3 years ago

Updated 2 years ago

ml-mgie by apple

Image editing via multimodal LLMs (research paper)

simonw:

Created 2 years ago

Updated 2 years ago

big-AGI by enricoros

AI suite for advanced AI/AGI functions, deployable on-prem or cloud

chitalian:

hiyouga:

swyxio:

Created 3 years ago

Updated 23 hours ago

kubectl-ai by sozercan

Kubectl plugin for generating Kubernetes manifests using LLMs

gakonst:

Created 3 years ago

Updated 1 year ago

aikit by kaito-project

AIKit: platform for LLM hosting, fine-tuning, and deployment

Created 2 years ago

Updated 1 week ago

awesome-mlops by kelvins

Curated list of MLOps tools

gregpr07:

vnivargi:

Created 6 years ago

Updated 2 months ago

LocalAI by mudler

Open-source OpenAI alternative for local AI inference

tobi:

antirez:

hammer:

tjbck:

Created 3 years ago

Updated 1 day ago

LocalAGI by mudler

Self-hostable AI agent platform for local, private AI automation

Created 3 years ago

Updated 1 month ago

Stable-Diffusion-NCNN by EdVince

Stable Diffusion inference via NCNN framework

Created 3 years ago

Updated 3 years ago

bert.cpp by skeskinen

C++ library for local BERT inference

ggerganov:

Created 3 years ago

Updated 2 years ago

go-llama.cpp by go-skynet

Go bindings for llama.cpp

davidzhao:

Created 3 years ago

Updated 1 week ago

llama.cpp by ggml-org

C/C++ library for local LLM inference

karpathy:

nat:

tobi:

hiyouga:

Created 3 years ago

Updated 14 hours ago

nanoGPT by karpathy

Minimalist repo for training/finetuning GPT models

tobi:

danielgross:

chiphuyen:

ankane:

Created 3 years ago

Updated 8 months ago

awesome-malware-analysis by rshipp

Curated list of malware analysis tools and resources

ebursztein:

Created 11 years ago

Updated 2 years ago

tensorflow by tensorflow

Open-source ML framework

norvig:

aravindsrinivas:

karpathy:

bcherny:

Created 10 years ago

Updated 15 hours ago

Feedback? Help us improve.