deepflow  by deepflowio

Observability tool for cloud and AI applications using eBPF

Created 3 years ago
3,486 stars

Top 13.9% on SourcePulse

GitHubView on GitHub
1 Expert Loves This Project
Project Summary

DeepFlow provides zero-code, full-stack observability for cloud-native and AI applications using eBPF and Wasm. It targets DevOps/SRE teams and developers, offering automated data collection for metrics, distributed tracing, and profiling, correlating data from code to infrastructure without manual instrumentation.

How It Works

DeepFlow leverages eBPF for kernel-level data collection, enabling zero-code instrumentation of applications and infrastructure. Its SmartEncoding technology pre-encodes metadata, reducing storage by 10x compared to traditional methods like ClickHouse, while supporting high-cardinality tags for deep analysis. Wasm plugins extend protocol support for custom or private protocols.

Quick Start & Requirements

  • Installation: Deployment documentation available for Community and Enterprise editions. A demo environment is provided.
  • Prerequisites: eBPF technology, Kubernetes (for Server component).
  • Resources: Agent runs on each node; Server runs in a Kubernetes cluster.

Highlighted Details

  • Zero-code distributed tracing and continuous profiling (OnCPU/OffCPU/GPU/Memory/Network) with <1% overhead.
  • Universal service mapping for any language and infrastructure, including AI services.
  • 10x storage reduction via SmartEncoding, offering BigTable-like query performance.
  • Seamless integration with Prometheus, OpenTelemetry, SkyWalking, and Pyroscope.

Maintenance & Community

  • Active development with a public roadmap.
  • Community support via Discord and WeChat.
  • Paper accepted by ACM SIGCOMM 2023.

Licensing & Compatibility

  • License: Apache 2.0.
  • Compatibility: Compatible with commercial and closed-source applications.

Limitations & Caveats

The Enterprise demo is currently available in Chinese only.

Health Check
Last Commit

14 hours ago

Responsiveness

1 week

Pull Requests (30d)
154
Issues (30d)
6
Star History
32 stars in the last 30 days

Explore Similar Projects

Starred by Gregor Zunic Gregor Zunic(Cofounder of Browser Use), Eric Zhu Eric Zhu(Coauthor of AutoGen; Research Scientist at Microsoft Research), and
14 more.

openllmetry by traceloop

0.4%
6k
Open-source observability SDK for LLM applications
Created 2 years ago
Updated 14 hours ago
Feedback? Help us improve.