[Unofficial] PyTorch implementation of "Conformer: Convolution-augmented Transformer for Speech Recognition" (INTERSPEECH 2020)

Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models

End-to-end ASR/LM implementation with PyTorch

Clean baseline implementation of PPO using an episodic TransformerXL memory

XLNet for generating language.

Challenging Memory-based Deep Reinforcement Learning Agents

Transformer-XL with checkpoint loader

custom cuda kernel for {2, 3}d relative attention with pytorch wrapper

A lightweight PyTorch implementation of the Transformer-XL architecture proposed by Dai et al. (2019)

Music and text generation with Transformer-XL.

[ACL‘20] Highway Transformer: A Gated Transformer.

2020 阿里云天池大数据竞赛-中医药文献问题生成挑战赛

Symbolic music generation taking inspiration from NLP and human composition process

YAI 11 x @POZAlabs : Improving & Evaluating Music Generation with ComMU

A refactored version of kimiyoung / transformer-xl/tf

Code Base for Transformer-XL on Finnish Language

search engine based on feature extracted on pretrained transformerXL.

Simple from-scratch implementations of transformer-based models that match the state of the art.

Implementation of Transformer-XL in Tensorflow 2.0.