tensor2tensor  by tensorflow

Deprecated library for deep learning models/datasets, successor to Trax

created 8 years ago
16,352 stars

Top 2.9% on sourcepulse

GitHubView on GitHub
Project Summary

Tensor2Tensor (T2T) is a deprecated library for deep learning models and datasets, designed to simplify ML research and model accessibility. It offers a comprehensive framework for various tasks including translation, image generation, and speech recognition, targeting ML researchers and engineers.

How It Works

T2T employs a "tensor-to-tensor" transformation approach, abstracting modality-specific processing through "bottom" and "top" transformations. This allows models to operate on modality-independent tensors, facilitating easy swapping of datasets, models, and hyperparameter configurations via command-line flags. It supports distributed training across multiple GPUs and TPUs.

Quick Start & Requirements

  • Install: pip install tensor2tensor (or with [tensorflow_gpu] or [tensorflow])
  • Prerequisites: TensorFlow (CPU or GPU)
  • Quick start notebook and command-line examples are provided.

Highlighted Details

  • Supports numerous state-of-the-art and baseline models, with easy extensibility for custom components.
  • Offers a wide array of datasets across text, audio, and image modalities.
  • Facilitates multi-GPU and distributed training (synchronous and asynchronous).
  • Enables training on Google Cloud ML and Cloud TPUs.

Maintenance & Community

T2T is deprecated and encourages users to migrate to its successor, Trax. While bug fixes are welcomed, active development has ceased.

Licensing & Compatibility

The repository does not explicitly state a license in the README. Compatibility for commercial use or closed-source linking is not specified.

Limitations & Caveats

The project is officially deprecated, with Trax recommended as the successor. Users should be aware that active development and support may be limited.

Health Check
Last commit

2 years ago

Responsiveness

1 day

Pull Requests (30d)
0
Issues (30d)
0
Star History
282 stars in the last 90 days

Explore Similar Projects

Starred by Elie Bursztein Elie Bursztein(Cybersecurity Lead at Google DeepMind), Lysandre Debut Lysandre Debut(Chief Open-Source Officer at Hugging Face), and
5 more.

gpt-neo by EleutherAI

0.0%
8k
GPT-2/3-style model implementation using mesh-tensorflow
created 5 years ago
updated 3 years ago
Feedback? Help us improve.