Mikupad is a browser-based frontend for interacting with various language models, designed for ease of use and flexibility. It targets users who want a single, self-contained HTML file for LLM interaction, offering features like session persistence, multiple backend support, and advanced generation controls, all without complex setup.

How It Works

Mikupad is a single HTML file built with ReactJS, allowing it to run directly in a web browser. It supports multiple LLM backends, including llama.cpp, koboldcpp, AI Horde, and any OpenAI-compatible API. Its architecture emphasizes local execution and session management, with features like persistent context, world info, and prediction undo/redo enhancing the user's workflow.

Quick Start & Requirements

• Open mikupad.html directly in a web browser.
• For offline use, download mikupad_compiled.html from Releases or use the provided compile script.
• Can be hosted on a local Node.js server for remote access.
• GitHub Pages

Highlighted Details

• Supports multiple backends: llama.cpp, koboldcpp, AI Horde, OpenAI-compatible APIs.
• Features session persistence, import/export, and persistent context (Memory, Author's Note, World Info).
• Includes advanced generation controls: prediction undo/redo, token probability display, and logit bias.
• Offers completion and chat modes with automatic delimiter handling for instruct models.

Maintenance & Community

• Community contributions are welcome via pull requests.

Licensing & Compatibility

• Released under the CC0 License (Public Domain).
• Compatible with commercial use and closed-source linking.

Limitations & Caveats

Token probability features require specific sampler settings with oobabooga or token streaming disabled with koboldcpp.