chipper  by TilmanGriesel

AI interface for local RAG and LLMs

created 7 months ago
464 stars

Top 66.3% on sourcepulse

GitHubView on GitHub
Project Summary

Chipper offers a modular, containerized web interface and CLI for building and deploying RAG (Retrieval-Augmented Generation) pipelines, document processing, and web scraping. It targets tinkerers, educators, and developers seeking to enhance local or cloud-based LLMs with custom knowledge bases, providing an extensible platform for AI exploration and integration with tools like Ollama and Haystack.

How It Works

Chipper leverages Haystack for RAG pipeline orchestration, Ollama for local LLM inference, and Elasticsearch for vector storage. It functions as a proxy for the Ollama API, enabling third-party clients to access RAG capabilities. The architecture supports document chunking, web scraping, and audio transcription, with a focus on offline functionality via a vanilla JavaScript/TailwindCSS web UI and Edge TTS for client-side speech synthesis.

Quick Start & Requirements

  • Install/Run: docker compose up
  • Prerequisites: Docker, Docker Compose. Ollama instance recommended for local LLM use.
  • Links: Project Site, Live Demo

Highlighted Details

  • Ollama API proxy with Bearer token authentication.
  • Offline-capable, framework-agnostic web UI.
  • Supports local (Ollama) and remote (Hugging Face) model integration.
  • Distributed processing via chained Chipper instances.

Maintenance & Community

  • Active development by a single primary contributor.
  • Integrates with several community projects: page-assist, open-webui, Enchanted, Ollamac.
  • Roadmap includes expanded client settings, tutorials, and automated testing.

Licensing & Compatibility

  • MIT License. Permissive for commercial use and closed-source linking.

Limitations & Caveats

The project is explicitly noted as a personal project not designed for commercial or production use, recommending users conduct their own due diligence for such scenarios. A React-based web application is listed as an upcoming feature, suggesting the current UI may be less polished or feature-rich than a modern SPA.

Health Check
Last commit

1 month ago

Responsiveness

1 day

Pull Requests (30d)
0
Issues (30d)
0
Star History
20 stars in the last 90 days

Explore Similar Projects

Starred by Andrej Karpathy Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n), Alex Cheema Alex Cheema(Cofounder of EXO Labs), and
3 more.

Perplexica by ItzCrazyKns

0.3%
23k
AI-powered search engine alternative
created 1 year ago
updated 1 day ago
Starred by Peter Norvig Peter Norvig(Author of Artificial Intelligence: A Modern Approach; Research Director at Google), Michael Han Michael Han(Cofounder of Unsloth), and
15 more.

open-interpreter by openinterpreter

0.1%
60k
Natural language interface for computers
created 2 years ago
updated 4 days ago
Feedback? Help us improve.