ai-sdk-tools  by midday-ai

Debug and monitor AI SDKs in real-time

Created 1 week ago

New!

542 stars

Top 58.8% on SourcePulse

GitHubView on GitHub
1 Expert Loves This Project
Project Summary

The ai-sdk-devtools repository provides a powerful debugging and monitoring solution specifically for AI SDKs within React applications. It offers real-time insights into AI streaming events, tool calls, and performance metrics, enabling developers to efficiently debug and understand the behavior of their AI-powered applications. The tool is designed for developers building AI applications who need enhanced visibility into the complex interactions managed by AI SDKs.

How It Works

The devtools integrate seamlessly into React applications, either as a component (<AIDevtools />) or via a custom hook (useAIDevtools). It captures and visualizes AI streaming events, tool call details (parameters, results, errors), and performance metrics like streaming speed and token usage. Its core advantage lies in providing a dedicated, in-app interface for deep introspection into AI SDK operations, simplifying complex debugging workflows.

Quick Start & Requirements

  • Installation: npm install ai-sdk-devtools
  • Prerequisites: React 16.8+, AI SDK React package, Modern browser with fetch API support.
  • Setup: Integration involves adding the <AIDevtools /> component within development environments or using the useAIDevtools hook for manual event management and filtering.

Highlighted Details

  • Event Monitoring: Comprehensive tracking of tool calls (start, result, error), message streaming (chunks, deltas, completions), step tracking, and error capture.
  • Advanced Filtering: Robust filtering capabilities by event type, tool name, or custom search queries.
  • Performance Metrics: Real-time monitoring of streaming speed (tokens/second, characters/second), context window utilization, and event timing.
  • Visual Interface: Features a resizable panel, live event indicators, color-coded event types, and a context circle visualization for token usage.

Maintenance & Community

Contributions are welcomed via pull requests. No specific community channels, maintainer information, or sponsorship details were provided in the README.

Licensing & Compatibility

The project is released under the MIT License, permitting commercial use and integration without significant restrictions. It requires React 16.8+ and compatibility with modern browsers.

Limitations & Caveats

This tool is intended for development environments, as indicated by conditional rendering logic. Full context insights require specifying a modelId. Debug logging can be enabled for more detailed internal information.

Health Check
Last Commit

2 days ago

Responsiveness

Inactive

Pull Requests (30d)
14
Issues (30d)
6
Star History
549 stars in the last 8 days

Explore Similar Projects

Feedback? Help us improve.