Summary

VerifyWise is an open-source AI governance and LLM evaluation platform designed for businesses to manage AI safely and compliantly. It supports major frameworks like the EU AI Act and NIST AI RMF, offering on-premises hosting for complete data control. The platform aims to democratize AI best practices, enabling robust AI management without compromising security.

How It Works

The platform features a React.js frontend and a Node.js backend, deployable via Docker or Kubernetes for on-premises or private cloud environments. Its core approach integrates comprehensive AI governance features, including risk management, policy enforcement, and an AI Trust Center, with advanced LLM evaluation capabilities. Novelty lies in its broad regulatory support and AI detection modules for identifying shadow AI and AI-generated code.

Quick Start & Requirements

• Development: Requires npm, Docker, Python 3.12+, PostgreSQL, and Redis. Installation involves cloning the repo, installing Node.js dependencies, setting up environment variables, and running PostgreSQL/Redis containers. The EvalServer requires a separate Python virtual environment setup.
• Production (Docker): Uses Docker Compose with a provided install.sh script and .env.prod configuration.
• Prerequisites: Node.js (npm), Docker, Docker Compose, Python 3.12+ (for EvalServer), PostgreSQL, Redis.
• Ports: 80 and 443 must be open for internet access.
• Links: Discord: https://discord.com/invite/d3k3E4uEpR.

Highlighted Details

• Supports EU AI Act, ISO 42001, NIST AI RMF, ISO 27001, and 20+ other AI frameworks.
• Offers on-premises or private cloud hosting with full source code access.
• Includes LLM Evals, LLM Arena, AI Detection Module (shadow AI, AI-generated code), and an AI Advisor for governance recommendations.
• Features extensive integrations, automations, and 15+ plugins.

Maintenance & Community

Community support is available via their Discord channel: https://discord.com/invite/d3k3E4uEpR.

Licensing & Compatibility

• License: Source Available License (BSL 1.1). Dual licensing is offered for enterprise needs.
• Compatibility: BSL 1.1 may impose specific usage restrictions; commercial use requires careful review of license terms.

Limitations & Caveats

The README does not detail specific limitations, alpha/beta status, or known bugs. The BSL 1.1 license terms should be thoroughly reviewed for any potential commercial adoption blockers.