nextjs-ollama-llm-ui  by jakobhoeg

Web UI for local LLM interaction using Ollama

Created 1 year ago
1,390 stars

Top 28.9% on SourcePulse

GitHubView on GitHub
Project Summary

This project provides a fully-featured, responsive web interface for interacting with Ollama Large Language Models, targeting users who want a quick and easy way to get started with LLMs locally or offline. It offers a ChatGPT-like user experience with features like code highlighting, chat history, and model management directly from the UI.

How It Works

The interface is built with Next.js and leverages shadcn-ui for a clean, modern UI. It communicates with a running Ollama instance via its API, allowing users to download, delete, and switch between models. Chats are stored locally in localStorage, eliminating the need for a separate database and enhancing privacy and ease of use.

Quick Start & Requirements

  • Docker: docker run -d -p 8080:3000 --add-host=host.docker.internal:host-gateway -e OLLAMA_URL=http://host.docker.internal:11434 --name nextjs-ollama-ui --restart always jakobhoeg/nextjs-ollama-ui:latest
  • Local Install: Requires Node.js (18+) and npm. Clone repo, npm install, npm run dev.
  • Prerequisites: Ollama must be downloaded and running.
  • Docs: https://github.com/jakobhoeg/nextjs-ollama-llm-ui

Highlighted Details

  • ChatGPT-inspired UI for familiar user experience.
  • Local storage for chat history, no database required.
  • Direct model management (download, delete, switch) within the UI.
  • Code syntax highlighting and one-click code copying.
  • Light/Dark mode support.

Maintenance & Community

This is a hobby project. Links to community resources are not provided in the README.

Licensing & Compatibility

The project does not explicitly state a license in the README.

Limitations & Caveats

The project is a hobby project, and a more complete experience may be found elsewhere. Upcoming features are listed but not yet implemented.

Health Check
Last Commit

7 months ago

Responsiveness

1 day

Pull Requests (30d)
0
Issues (30d)
1
Star History
23 stars in the last 30 days

Explore Similar Projects

Starred by Chip Huyen Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems") and Yaowei Zheng Yaowei Zheng(Author of LLaMA-Factory).

AstrBot by AstrBotDevs

1.1%
15k
LLM chatbot/framework for multiple platforms
Created 3 years ago
Updated 15 hours ago
Feedback? Help us improve.