opik-openclaw  by comet-ml

Monitor AI agent behavior and costs

Created 1 month ago
448 stars

Top 67.0% on SourcePulse

GitHubView on GitHub
Project Summary

<2-3 sentences summarising what the project addresses and solves, the target audience, and the benefit.> The opik-openclaw plugin bridges OpenClaw, an agent framework, with Opik, an open-source platform for LLM and agent observability. It automatically exports detailed traces of agent execution, including LLM interactions, sub-agent calls, and tool usage, directly to Opik. This enables developers to gain deep visibility into agent behavior, performance, costs, and potential errors, facilitating debugging and optimization.

How It Works

This plugin operates within the OpenClaw Gateway process, leveraging native hooks to capture critical execution events. It instruments LLM requests and responses, sub-agent spawning and termination, and tool calls, recording inputs, outputs, and errors for each. Furthermore, it aggregates run-level metadata, usage statistics, and cost information, exporting this comprehensive data to Opik for analysis and monitoring. The approach provides a seamless, integrated observability solution without requiring modifications to the core OpenClaw framework.

Quick Start & Requirements

  • Install: Execute openclaw plugins install @opik/opik-openclaw within your OpenClaw environment.
  • Configure: Run the interactive setup wizard with openclaw opik configure, which guides through endpoint and credential validation, and optionally links to Opik Cloud signup.
  • Prerequisites: OpenClaw version 2026.3.2 or higher, Node.js version 22.12.0 or higher, and npm version 10 or higher are required.
  • Restart: The OpenClaw Gateway must be restarted after plugin installation.
  • NPM Package: https://www.npmjs.com/package/@opik/opik-openclaw

Highlighted Details

  • Captures detailed spans for LLM I/O, sub-agent lifecycles, and tool invocations, including arguments and results.
  • Records essential metadata such as usage, cost, and run finalization status.
  • Supports environment variable fallbacks for configuration (e.g., OPIK_API_KEY, OPIK_URL_OVERRIDE).
  • Provides a clear mapping between OpenClaw events and Opik trace entities for easy understanding.

Maintenance & Community

No specific details regarding maintainers, community channels (e.g., Discord, Slack), or roadmap are provided in the README.

Licensing & Compatibility

  • License: Apache-2.0.
  • Compatibility: The Apache-2.0 license is permissive, generally allowing for commercial use and integration into closed-source projects without significant restrictions.

Limitations & Caveats

The plugin's functionality is entirely dependent on the existing native hooks within the OpenClaw ecosystem; it does not introduce any core changes to OpenClaw itself. This reliance means its stability and feature set are tied to OpenClaw's internal architecture and event system.

Health Check
Last Commit

1 day ago

Responsiveness

Inactive

Pull Requests (30d)
18
Issues (30d)
8
Star History
396 stars in the last 30 days

Explore Similar Projects

Starred by Chip Huyen Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), Simon Willison Simon Willison(Coauthor of Django), and
2 more.

tau-bench by sierra-research

1.1%
1k
Benchmark for tool-agent-user interaction research
Created 1 year ago
Updated 2 weeks ago
Starred by Lilian Weng Lilian Weng(Cofounder of Thinking Machines Lab), Chip Huyen Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), and
59 more.

AutoGPT by Significant-Gravitas

0.2%
183k
AI agent platform for building, deploying, and running autonomous workflows
Created 3 years ago
Updated 14 hours ago
Feedback? Help us improve.