tensor2tensor  by tensorflow

Deprecated library for deep learning models/datasets, successor to Trax

Created 8 years ago
16,482 stars

Top 2.9% on SourcePulse

GitHubView on GitHub
Project Summary

Tensor2Tensor (T2T) is a deprecated library for deep learning models and datasets, designed to simplify ML research and model accessibility. It offers a comprehensive framework for various tasks including translation, image generation, and speech recognition, targeting ML researchers and engineers.

How It Works

T2T employs a "tensor-to-tensor" transformation approach, abstracting modality-specific processing through "bottom" and "top" transformations. This allows models to operate on modality-independent tensors, facilitating easy swapping of datasets, models, and hyperparameter configurations via command-line flags. It supports distributed training across multiple GPUs and TPUs.

Quick Start & Requirements

  • Install: pip install tensor2tensor (or with [tensorflow_gpu] or [tensorflow])
  • Prerequisites: TensorFlow (CPU or GPU)
  • Quick start notebook and command-line examples are provided.

Highlighted Details

  • Supports numerous state-of-the-art and baseline models, with easy extensibility for custom components.
  • Offers a wide array of datasets across text, audio, and image modalities.
  • Facilitates multi-GPU and distributed training (synchronous and asynchronous).
  • Enables training on Google Cloud ML and Cloud TPUs.

Maintenance & Community

T2T is deprecated and encourages users to migrate to its successor, Trax. While bug fixes are welcomed, active development has ceased.

Licensing & Compatibility

The repository does not explicitly state a license in the README. Compatibility for commercial use or closed-source linking is not specified.

Limitations & Caveats

The project is officially deprecated, with Trax recommended as the successor. Users should be aware that active development and support may be limited.

Health Check
Last Commit

2 years ago

Responsiveness

Inactive

Pull Requests (30d)
0
Issues (30d)
0
Star History
98 stars in the last 30 days

Explore Similar Projects

Starred by Shizhe Diao Shizhe Diao(Author of LMFlow; Research Scientist at NVIDIA), Evan Hubinger Evan Hubinger(Head of Alignment Stress-Testing at Anthropic), and
2 more.

awesome-deeplearning-resources by endymecy

0%
3k
Deep learning research paper and code repository
Created 8 years ago
Updated 1 week ago
Feedback? Help us improve.