examples

Official NeurST Examples and Modules

The folder contains example (re-)implementations of selected research papers and benchmarks, with released model checkpoints.

Speech-to-Text Translation

2021

• [ACL demo] Zhao et al. NeurST: Neural Speech Translation Toolkit. [paper]

  • E2E ST benchmark: libri-trans, must-c

• [IWLST 2021 System] Zhao et al. The Volctrans Neural Speech Translation System for IWSLT 2021. [paper]

  • Offline ST
  • Simultaneous Translation

Neural Machine Translation

2021

• [AAAI] Liang et al. Finding Sparse Structures for Domain Specific Neural Machine Translation. [paper][example]

2020

• [AAAI] Yang et al. Towards Making the Most of BERT in Neural Machine Translation. [paper][example]

2019

• [ICLR] Wu et al. Pay Less Attention With Lightweight and Dynamic Convolutions. [paper][code only]

2017

• [NIPS] Vaswani et al. Attention Is All You Need. [paper]
  • MT benchmark: WMT14 EN->DE

Neural Network Techniques

• Weight Pruning
  • unstructured pruning [example]
• Quantization
  • quantization aware training [ref][example]