tis  by datavane

AI-powered platform for agile enterprise data integration

Created 7 years ago
1,264 stars

Top 31.3% on SourcePulse

GitHubView on GitHub
Project Summary

Enterprise-grade data integration is addressed by TIS, a platform designed for agile DataOps. It unifies batch (DataX) and stream (Flink-CDC, Chunjun) processing through an intuitive Web UI, significantly lowering the barrier for end-to-end data synchronization tasks. TIS targets users overwhelmed by the complexity and potential errors of scripting data pipelines with tools like DataX or Flink-CDC, offering a simpler, more engaging, and user-friendly experience.

How It Works

TIS provides a unified platform for both batch and stream data integration, leveraging established technologies like DataX, Flink-CDC, and Chunjun. Its core innovation lies in its user-friendly Web UI and, notably, the v5.0.0 release's "Pipeline AI Agent." This agent allows users to define data pipelines using natural language, automatically detects and installs necessary plugins, and utilizes LLMs for parameter generation, supporting cost-effective domestic models. The architecture is inspired by Jenkins and employs a micro-frontend approach for UI extensibility, complemented by an SPI mechanism for easy plugin development.

Quick Start & Requirements

Installation is designed to be straightforward, typically involving downloading a tar package, extracting it, and starting the service. TIS supports multiple deployment modes, including single-node, Docker, Docker Compose, and Kubernetes. The latest release is v5.0.0, dated 2025/12/29. Detailed documentation for development and compilation is available at https://tis.pub/docs/develop/compile-running/.

Highlighted Details

  • Simplified Setup: Easy installation via tarball, Docker, or Kubernetes.
  • Extensibility: Micro-frontend architecture for the UI and SPI for custom plugin development.
  • In-flight Transformations: Supports various Transformer operators (e.g., data desensitization, string manipulation) during the data extraction phase.
  • Ecosystem Integration: Seamless integration with DolphinScheduler for task scheduling and management.
  • AI-Powered Pipelines: v5.0.0 introduces an AI Agent for natural language pipeline creation and LLM-assisted configuration.
  • Automatic SQL Generation: Generates Flink-SQL scripts automatically based on database metadata.

Maintenance & Community

The project lists numerous dependent projects including DataX, Flink, DolphinScheduler, Chunjun, and various TIS-specific plugins. Specific community channels (like Discord/Slack), a public roadmap, or notable contributors/sponsorships are not explicitly detailed in the provided README.

Licensing & Compatibility

TIS is licensed under the Apache 2.0 License, which is permissive and generally suitable for commercial use and integration into closed-source projects.

Limitations & Caveats

The provided README does not explicitly state any limitations, alpha status, or known bugs. The recent introduction of the AI Agent in v5.0.0 may indicate that this feature is still under active development and refinement.

Health Check
Last Commit

3 days ago

Responsiveness

Inactive

Pull Requests (30d)
0
Issues (30d)
13
Star History
41 stars in the last 30 days

Explore Similar Projects

Starred by Chaoyu Yang Chaoyu Yang(Founder of Bento), Chip Huyen Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), and
3 more.

DB-GPT by eosphoros-ai

0.3%
18k
AI-native data app development framework with agentic workflow
Created 2 years ago
Updated 3 days ago
Feedback? Help us improve.