NLP-Models-Tensorflow  by mesolitica

TensorFlow deep learning models for NLP problems

Created 7 years ago
1,786 stars

Top 24.0% on SourcePulse

GitHubView on GitHub
Project Summary

This repository provides a comprehensive collection of simplified TensorFlow 1.x implementations for various Natural Language Processing (NLP) tasks, targeting researchers and developers seeking to understand and experiment with deep learning models. It aims to make complex, state-of-the-art NLP architectures more accessible through Jupyter Notebooks.

How It Works

The project offers implementations of numerous NLP models, including sequence-to-sequence architectures with various attention mechanisms (Luong, Bahdanau), Transformers, BERT, and more. It covers a wide spectrum of tasks such as text classification, machine translation, summarization, chatbots, and speech-to-text, often providing multiple variations and configurations for each task. The code is designed to be beginner-friendly, simplifying original research implementations and including links to external repositories for models not implemented from scratch.

Quick Start & Requirements

  • Install dependencies: pip install -r requirements.txt
  • Requires TensorFlow versions 1.13 to 1.99.

Highlighted Details

  • Extensive coverage of NLP tasks: abstractive/extractive summarization, chatbots, dependency parsing, entity tagging, NMT, speech-to-text, text classification, and more.
  • Includes implementations of advanced architectures like BERT, Transformer-XL, and Tacotron.
  • Provides detailed accuracy metrics for many models, often based on specific datasets and training epochs.
  • Offers simplified versions of complex research papers and links to original codebases.

Maintenance & Community

No specific information on maintainers, community channels, or roadmap is provided in the README.

Licensing & Compatibility

The README does not explicitly state a license.

Limitations & Caveats

The project is strictly limited to TensorFlow versions between 1.13 and 2.0, making it incompatible with modern TensorFlow 2.x and later. Accuracy metrics are often based on limited training (e.g., 10 epochs) and specific datasets, which may not generalize.

Health Check
Last Commit

5 years ago

Responsiveness

Inactive

Pull Requests (30d)
0
Issues (30d)
0
Star History
0 stars in the last 30 days

Explore Similar Projects

Starred by Elvis Saravia Elvis Saravia(Founder of DAIR.AI) and Stas Bekman Stas Bekman(Author of "Machine Learning Engineering Open Book"; Research Engineer at Snowflake).

awesome-transformer-nlp by cedrickchee

0%
1k
Curated list of NLP resources for Transformer networks
Created 6 years ago
Updated 10 months ago
Starred by Boris Cherny Boris Cherny(Creator of Claude Code; MTS at Anthropic), Stas Bekman Stas Bekman(Author of "Machine Learning Engineering Open Book"; Research Engineer at Snowflake), and
18 more.

lectures by oxford-cs-deepnlp-2017

0.0%
16k
NLP course (lecture slides) for deep learning approaches to language
Created 8 years ago
Updated 2 years ago
Feedback? Help us improve.