ttpoe  by teslamotors

Ethernet transport protocol for AI/ML, datacenter interconnects

Created 1 year ago
639 stars

Top 52.0% on SourcePulse

GitHubView on GitHub
Project Summary

Tesla Transport Protocol over Ethernet (TTPoE) is an open-source, high-speed, low-latency interconnect protocol designed for AI/ML datacenters and supercomputers. It aims to standardize a non-proprietary, distributed, and self-managing fabric, reducing reliance on CPU/OS for network operations.

How It Works

TTPoE operates as a transport protocol directly over Ethernet II frames, guaranteeing full transmission by accepting dropped packets and replays as default behavior, similar to TCP. Its design emphasizes fundamental, point-to-point data movement, minimizing software execution overhead. Congestion management is decentralized, with each endpoint being resilient and self-managing, avoiding the complexities of centralized control for large-scale systems.

Quick Start & Requirements

  • Install/Run: Compile and load the modttpoe.ko kernel module using sudo insmod modttpoe.ko dev=<interface_name> ....
  • Prerequisites: Linux kernel (tested with 5.15), GCC, netsniff-ng toolkit for trafgen.
  • Setup: Compilation involves make all in the modttpoe directory. Loading the module requires root privileges.
  • Docs: Specification and usage details are in the doc folder. Unit tests are available in the tests directory.

Highlighted Details

  • Designed for hardware execution, eliminating CPU/OS involvement for core transport functions.
  • Supports distributed congestion control and self-managing endpoints.
  • Utilizes a simple Ethernet II frame encapsulation.
  • Includes a TTP Gateway Module (modttpip.ko) for IP-based routing.

Maintenance & Community

The project is maintained by Tesla and has joined the Ultra Ethernet Consortium (UEC) to promote standardization.

Licensing & Compatibility

The kernel module (modttpoe.ko, modttpip.ko) is licensed under GPL.

Limitations & Caveats

The provided software model is a Linux kernel module, requiring compilation against specific kernel versions. The TTP Gateway Module (modttpip.ko) currently lacks unit tests.

Health Check
Last Commit

9 months ago

Responsiveness

Inactive

Pull Requests (30d)
0
Issues (30d)
0
Star History
4 stars in the last 30 days

Explore Similar Projects

Feedback? Help us improve.