EFAK  by smartloli

AI-powered Kafka monitoring and management platform

Created 8 years ago
3,148 stars

Top 15.2% on SourcePulse

GitHubView on GitHub
Project Summary

Summary EFAK-AI (Eagle For Apache Kafka - AI Enhanced) is an open-source platform for intelligent Kafka cluster monitoring and management. It targets Kafka operators and engineers, integrating AI-driven insights, real-time visualization, and automated operations to enhance efficiency and simplify complex tasks.

How It Works Built on Spring Boot 3.x and JDK 17 with reactive programming, EFAK-AI integrates Large Language Models (LLMs) like OpenAI, Claude, and DeepSeek for conversational operations. This AI assistant fetches real-time metrics via function calls and auto-generates visualizations. A Redis-backed distributed task scheduler ensures fault tolerance and load balancing for its monitoring functions.

Quick Start & Requirements Deployment options include Docker (recommended) or tar.gz packages.

  • Docker: Requires Docker Desktop 4.43.2+ and Docker Compose 2.0+. Clone repo, run docker-compose up -d. Access http://localhost:8080 (admin/admin123).
  • tar.gz: Requires JDK 17+, MySQL 8.0+, Redis 6.0+. Build (./build-package.sh), configure config/application.yml, initialize DB (SQL scripts provided), start (./bin/start.sh). Detailed deployment guides are linked within the GitHub repository.

Highlighted Details

  • AI Assistant: Multi-LLM support, function calling, auto-chart generation, Kafka expert advice, streaming dialogue.
  • Monitoring: Real-time Broker, Topic, Consumer Group status, performance metrics, historical analysis, multi-cluster support.
  • Distributed Scheduling: Redis-based sharding, fault tolerance, load balancing.
  • Alerting: Multi-channel notifications, dynamic thresholds, aggregation.

Maintenance & Community Actively maintained, with recent updates focusing on AI and distributed features. Community support and issue reporting are primarily via GitHub Issues. No dedicated community channels like Discord/Slack are listed.

Licensing & Compatibility Licensed under the Apache License 2.0, permitting commercial use and integration into closed-source projects.

Limitations & Caveats The README does not specify known limitations or bugs. AI features rely on external LLM providers, potentially incurring costs and requiring API key management. The efficacy of AI-driven analysis requires independent verification.

Health Check
Last Commit

3 weeks ago

Responsiveness

Inactive

Pull Requests (30d)
2
Issues (30d)
5
Star History
13 stars in the last 30 days

Explore Similar Projects

Feedback? Help us improve.