SkyrimNet-GamePlugin  by MinLL

AI-powered NPCs for immersive Skyrim gameplay

Created 1 year ago
256 stars

Top 98.5% on SourcePulse

GitHubView on GitHub
Project Summary

This project provides a deeply integrated AI system for Skyrim, transforming NPCs into dynamic conversationalists with memory, opinions, and reactions. Targeting Skyrim players and modders, it offers a unique, low-overhead, and highly responsive AI experience directly within the game, eliminating the need for complex external setups.

How It Works

SkyrimNet operates as a single, native Windows DLL SKSE plugin, running entirely within the game process. This architecture bypasses the latency, system load, and setup complexity associated with external AI mod frameworks that rely on separate servers or virtual machines. By directly accessing game state from memory and performing heavy computations (like LLM processing and TTS) asynchronously on worker threads, it achieves near-immediate NPC responses and enhanced game stability.

Quick Start & Requirements

  • Installation: Download from GitHub Releases, install via mod manager (MO2, Vortex), enable SkyrimNet.esp, launch via SKSE, and access localhost:8080 for a guided setup wizard.
  • Essential Dependencies: Skyrim Script Extender (SKSE), Address Library for SKSE Plugins, PowerOfThree's Papyrus Extender, PapyrusUtil SE, Microsoft Visual C++ Redistributable, Native EditorID Fix, Prisma UI, Media Keys Fix.
  • Optional Dependencies: CUDA Toolkit 12.x (for Whisper STT performance), Dragonborn Voice Over (for player voicing).
  • External API: Requires an OpenRouter API key (or OpenAI compatible) and optionally a VastAI account for cloud GPU access.

Highlighted Details

  • Conversational AI: NPCs engage in context-aware conversations powered by user-selected LLMs, remembering past events and reacting to the environment.
  • Advanced Memory: Each NPC maintains a private memory store with vector recall (semantic search), importance weighting, and decay, allowing for nuanced recall of past interactions and events.
  • Streaming TTS & STT: Text-to-speech begins during LLM generation, and speech-to-text uses local Whisper (with CUDA support) or cloud options for responsiveness.
  • Vision Integration (OmniSight): NPCs can perceive and comment on in-game visuals described by a vision model.
  • Triggers & World Knowledge: YAML-defined triggers react to game events, enabling dynamic NPC behavior, diary entries, and context-scoped world facts.
  • AI-Composed Songs: Bards perform LLM-generated songs with AI-composed lyrics and Suno-generated music, featuring spatial audio.
  • Web Dashboard: A comprehensive React-based UI (localhost:8080) for managing NPCs, memories, knowledge packs, triggers, voice effects, prompts, and cloud GPU instances.
  • Modder API: Exposes Papyrus and C++ APIs for third-party mods to register custom actions, decorators, and event hooks, extending SkyrimNet's capabilities.
  • MCP Server: A local server (port 8889) exposes game state and tools for external AI assistants and custom tools.

Maintenance & Community

The project is supported by a small community of developers contributing code, design, and testing. Community-generated character bios are included. Specific links to community channels or a roadmap are not detailed in the provided text.

Licensing & Compatibility

The license type and any associated restrictions for commercial use or closed-source linking are not explicitly stated in the provided documentation.

Limitations & Caveats

SkyrimNet currently handles freeform conversation but does not integrate with vanilla quest dialogue trees, which remain Skyrim's native system. Full integration is a planned future development. While designed for ease of setup, users still need to configure API keys and select models.

Health Check
Last Commit

1 week ago

Responsiveness

Inactive

Pull Requests (30d)
6
Issues (30d)
11
Star History
39 stars in the last 30 days

Explore Similar Projects

Feedback? Help us improve.