This repository serves as a curated collection of Transformer models for Natural Language Processing (NLP), aimed at researchers and practitioners. It provides a comprehensive list of models, their publication year, and links to relevant papers, blogs, videos, official repositories, and code implementations, facilitating easier access to resources for understanding and utilizing these advanced NLP architectures.

How It Works

The project functions as an "awesome list," aggregating and organizing information about various Transformer models. It presents a tabular format detailing each model's name, release year, and categorized links to external resources such as research papers, explanatory blogs, video tutorials, official code repositories, and runnable code examples. This structured approach simplifies the discovery and exploration of the rapidly evolving Transformer landscape.

Quick Start & Requirements

This repository is a curated list and does not require installation or execution. It serves as a reference guide.

Highlighted Details

• Comprehensive listing of over 120 Transformer models from 2017 to 2021.
• Includes links to papers, blogs, videos, official repos, and code for each model.
• Covers a wide range of NLP tasks and architectural variations.
• Encourages community contributions for corrections and updates.

Maintenance & Community

The project is maintained by ashishpatel26, with a special thanks to Komal Lamba for contributions. Interested individuals can contribute by emailing ashishpatel.ce.2011@gmail.com.

Licensing & Compatibility

Copyright for source code belongs to the original authors. The repository itself encourages forking and minor corrections under fair use for the benefit of readers.

Limitations & Caveats

The repository is a static list and does not provide direct access to model implementations or execution environments. Links may become outdated, and the breadth of coverage might not include every single Transformer variant.