IMDB Classification using PyTorch Transformer Architecture

I have been exploring Transformer Architecture for natural language processing. I reached a big milestone when I put together a successful demo of the IMDB dataset problem using a PyTorch TransformerEncoder network. As is often the case, once I had the demo working, it all seemed easy. But the demo is in fact extremely complicated…

fastai A Layered API for Deep Learning

Transformers from scratch

Model Parallelism for Bert Models · Issue #10151 · huggingface

Text-to-Text Transformer (T5-Base Model) Testing For Summarization

Transfer learning with Transformers trainer and pipeline for NLP

Fine-tune Transformers Faster with Lightning Flash and Torch ORT

BERT vs ULMFiT Faceoff. A simple web-app for real-time…

Fine-tune Transformers Faster with Lightning Flash and Torch ORT

deeplearning-models/pytorch-lightning_ipynb/transformer/distilbert