tensorpack  by tensorpack

Neural net training interface on TensorFlow

Created 9 years ago
6,304 stars

Top 8.2% on SourcePulse

GitHubView on GitHub
Project Summary

Tensorpack is a high-level neural network training interface for TensorFlow, designed for researchers and power users seeking maximum training speed and flexibility. It aims to provide a more efficient and reproducible environment for deep learning research compared to standard APIs like Keras, offering significant speedups and robust implementations of complex models.

How It Works

Tensorpack leverages TensorFlow's graph mode for optimized execution, achieving notable speed improvements (1.2-5x faster than Keras on common CNNs) without introducing extra overhead. Its tensorpack.dataflow module is engineered for high-performance data loading from pure Python, offering greater flexibility than symbolic data processing pipelines like tf.data. The library emphasizes reproducible research by providing faithful implementations of published papers, allowing users to integrate any TensorFlow symbolic functions.

Quick Start & Requirements

  • Install via pip: pip install --upgrade git+https://github.com/tensorpack/tensorpack.git (or add --user).
  • Dependencies: Python 3.3+, TensorFlow ≥ 1.5. OpenCV Python bindings are required for many features.
  • Note: Tensorpack uses TensorFlow 1.x compatibility mode for TensorFlow 2.x. Some examples may not yet support TF2.

Highlighted Details

  • Focus on training speed, outperforming Keras on common CNNs.
  • Scalable data-parallel multi-GPU and distributed training strategies.
  • High-performance, flexible data loading via tensorpack.dataflow.
  • Reproducible implementations of numerous research papers across vision, NLP, and reinforcement learning.
  • Supports integration with other TensorFlow libraries (Keras, slim, etc.).

Maintenance & Community

The project is primarily developed by Yuxin Wu. Further community engagement channels are not explicitly listed in the README.

Licensing & Compatibility

The README does not explicitly state a license. Users should verify licensing for commercial or closed-source use.

Limitations & Caveats

Tensorpack is explicitly marked as "not yet stable." Users are advised to pin specific versions for dependency management. Some examples may not be migrated to support TensorFlow 2.x.

Health Check
Last Commit

2 years ago

Responsiveness

1 day

Pull Requests (30d)
0
Issues (30d)
0
Star History
2 stars in the last 30 days

Explore Similar Projects

Starred by Shizhe Diao Shizhe Diao(Author of LMFlow; Research Scientist at NVIDIA), Evan Hubinger Evan Hubinger(Head of Alignment Stress-Testing at Anthropic), and
2 more.

awesome-deeplearning-resources by endymecy

0%
3k
Deep learning research paper and code repository
Created 8 years ago
Updated 1 week ago
Starred by Elie Bursztein Elie Bursztein(Cybersecurity Lead at Google DeepMind), Omar Khattab Omar Khattab(Coauthor of DSPy, ColBERT; Professor at MIT), and
15 more.

gpt-neo by EleutherAI

0.0%
8k
GPT-2/3-style model implementation using mesh-tensorflow
Created 5 years ago
Updated 3 years ago
Starred by Tobi Lutke Tobi Lutke(Cofounder of Shopify), Li Jiang Li Jiang(Coauthor of AutoGen; Engineer at Microsoft), and
26 more.

ColossalAI by hpcaitech

0.1%
41k
AI system for large-scale parallel training
Created 3 years ago
Updated 13 hours ago
Feedback? Help us improve.