Official NeurST Examples and Modules

The folder contains example (re-)implementations of selected research papers and benchmarks, with released model checkpoints.

Speech-to-Text Translation

2021

[ACL demo] Zhao et al. NeurST: Neural Speech Translation Toolkit. [paper]
- E2E ST benchmark: libri-trans, must-c
[IWLST 2021 System] Zhao et al. The Volctrans Neural Speech Translation System for IWSLT 2021. [paper]
- Offline ST
- Simultaneous Translation

Neural Machine Translation

2021

[AAAI] Liang et al. Finding Sparse Structures for Domain Specific Neural Machine Translation. [paper][example]

2020

[AAAI] Yang et al. Towards Making the Most of BERT in Neural Machine Translation. [paper][example]

2019

[ICLR] Wu et al. Pay Less Attention With Lightweight and Dynamic Convolutions. [paper][code only]

2017

[NIPS] Vaswani et al. Attention Is All You Need. [paper]
- MT benchmark: WMT14 EN->DE

Neural Network Techniques

Weight Pruning
- unstructured pruning [example]
Quantization
- quantization aware training [ref][example]