nobodywho  by nobodywho-ooo

Godot/Unity plugin for local LLM integration

Created 1 year ago
510 stars

Top 61.3% on SourcePulse

GitHubView on GitHub
Project Summary

NobodyWho is a Godot Engine plugin enabling developers to integrate local Large Language Models (LLMs) into their games, facilitating AI-driven characters and interactive narratives without internet dependency. It targets game developers seeking to embed sophisticated NPC interactions and dynamic storytelling directly within their projects.

How It Works

The plugin leverages llama.cpp for efficient, local LLM inference, supporting GPU acceleration via Vulkan or Metal. It provides two core nodes: NobodyWhoModel to load and manage GGUF-formatted LLM weights, and NobodyWhoChat for conversational interaction, allowing developers to send prompts and receive streamed or complete responses. This approach ensures fast, on-device processing and simplifies LLM integration into game logic.

Quick Start & Requirements

  • Install: Via Godot's AssetLib (search "NobodyWho") or by importing a zip from the releases page.
  • Prerequisites: Godot 4.3+, a GGUF-formatted LLM file (e.g., Gemma 2 2B), and sufficient RAM for the LLM.
  • Setup: Two nodes (NobodyWhoModel, NobodyWhoChat) added to a Godot scene.
  • Docs: https://github.com/nobodywho-ooo/nobodywho

Highlighted Details

  • Enables LLM-driven characters locally without internet.
  • Fast inference on GPU via Vulkan or Metal.
  • Cross-platform support (Windows, Linux, macOS).
  • Includes example scripts for chat and embeddings.

Maintenance & Community

  • Active development with community contributions welcomed.
  • Discord and Matrix communities available for support and discussion.
  • Issue tracker for bug reporting and feature requests.

Licensing & Compatibility

  • Permissive license allowing use in proprietary and commercial projects.
  • Modified versions of the plugin's code must be open-sourced.

Limitations & Caveats

Exported projects require manual copying of the GGUF model file to the export directory due to current packaging limitations. HTML5, Android, and iOS exports are not yet supported, though progress is being made on mobile platforms.

Health Check
Last Commit

1 day ago

Responsiveness

1 week

Pull Requests (30d)
8
Issues (30d)
11
Star History
34 stars in the last 30 days

Explore Similar Projects

Starred by Andrej Karpathy Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n), Gabriel Almeida Gabriel Almeida(Cofounder of Langflow), and
2 more.

torchchat by pytorch

0.1%
4k
PyTorch-native SDK for local LLM inference across diverse platforms
Created 1 year ago
Updated 1 week ago
Starred by Chip Huyen Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), Pietro Schirano Pietro Schirano(Founder of MagicPath), and
1 more.

SillyTavern by SillyTavern

1.1%
18k
LLM frontend for power users
Created 2 years ago
Updated 1 day ago
Feedback? Help us improve.