MT-paper-list-of-ACL

This is a reading list of machine translation papers in proceedings of ACL from 2016 to 2021.

We classify these machine translation papers by our categorization, and sorted the papers based on the categorization . And we also enrich our list with some paper interpretations collected from WeChat official account, Zhihu, CSDN, and bilibili. Of course, our categorization may not be accurate, and list is incomplete. We will keep updating and improving the list. Welcome to provide comments and suggestions!

List by Conference

• ACL

  • 2016

  • 2017

  • 2018

  • 2019

  • 2020

  • 2021

List by Area

• Statistical Machine Translation

  • Word-based Models

  • Distortion-based and Fertility-based models

  • Phrase-based Models

  • Syntax-based Models

• Evaluation

  • Reference-based

  • Reference-free

• Efficiency

  • Model Compression

    • Pruning

    • Knowledge Distillation

    • Quantization

    • Low-rank Factorization

    • Weight Sharing

  • Compution Optimization

  • Energy Cost

  • Conditional Computation

• Open-source Systems and Datasets

• Training Strategy

  • Contrastive Learning

  • Reinforcement Learning

  • Meta Learning

  • Dual Learning

  • Generative Adversarial Networks

• Inference

  • Non-autoregressive

  • Constrained Inference

    • Interactive NMT

    • Automatic Post-Editing

    • Restricted NMT

  • Beam Search

• Interpretability

• Ensemble

• Reranking

• Model Architecture

• Prior Knowledge

• Attention Mechanism

• Domain Adaptation

• Transfer Learning

• Pre-training

• Diversity and Fairness

• Robustness

• Data-based Methods

  • Word Segmentation

  • Character-level NMT

  • Data Augmentation

  • Schedule Strategy

    • Data Selection

    • Curriculum Learning

• Low-resource NMT

  • Unsupervised NMT

  • Semi-supervised NMT

  • Endangered Language Study

• Multilingual NMT

• Document-level NMT

• Real-time NMT

• Multimodal NMT

  • Speech

    • Cascaded Speech Translation

    • End-to-End Speech Translation

  • Image

• WMT

  • Efficiency

  • Quality Estimation

  • News Translation

• Survey

List by Conference

ACL

2016

1. Models and Inference for Prefix-Constrained Machine Translation. paper

   Joern Wuebker, Spence Green, John DeNero, Saša Hasan, Minh-Thang Luong

   Domain: Inference → Constrained Inference → Interactive NMT

2. Modeling Coverage for Neural Machine Translation. paper

   Zhaopeng Tu, Zhengdong Lu, Yang Liu, Xiaohua Liu, Hang Li

   Domain: Attention Mechanism

   Paper Reading&Interpretation1 ; Paper Reading&Interpretation2 ; Paper Reading&Interpretation3 ; Paper Reading&Interpretation4

3. Improving Neural Machine Translation Models with Monolingual Data. paper

   Rico Sennrich, Barry Haddow, Alexandra Birch

   Domain: Data-based Methods → Data Augmentation

   Paper Reading&Interpretation1 ; Paper Reading&Interpretation2

4. Pointing the Unknown Words. paper

   Caglar Gulcehre, Sungjin Ahn, Ramesh Nallapati, Bowen Zhou, Yoshua Bengio

   Domain: Model Architecture

   Paper Reading&Interpretation1 ; Paper Reading&Interpretation2 ; Paper Reading&Interpretation3

5. Tree-to-Sequence Attentional Neural Machine Translation. paper

   Akiko Eriguchi, Kazuma Hashimoto, Yoshimasa Tsuruoka

   Domain: Model Architecture ; Prior Knowledge

6. Achieving Open Vocabulary Neural Machine Translation with Hybrid Word-Character Models. paper

   Minh-Thang Luong, Christopher D. Manning

   Domain: Model Architecture

   Paper Reading&Interpretation1

7. Synthesizing Compound Words for Machine Translation. paper

   Austin Matthews, Eva Schlinger, Alon Lavie, Chris Dyer

   Domain: Inference → Constrained Inference → Restricted NMT

8. A Continuous Space Rule Selection Model for Syntax-based Statistical Machine Translation. paper

   Jingyi Zhang, Masao Utiyama, Eiichro Sumita, Graham Neubig, Satoshi Nakamura

   Domain: Statistical Machine Translation → Syntax-based Models

9. Learning Structured Predictors from Bandit Feedback for Interactive NLP. paper

   Artem Sokolov, Julia Kreutzer, Christopher Lo, Stefan Riezler

   Domain: Training Strategy → Reinforcement Learning

10. Minimum Risk Training for Neural Machine Translation. paper

    Shiqi Shen, Yong Cheng, Zhongjun He, Wei He, Hua Wu, Maosong Sun, Yang Liu

    Domain: Training Strategy → Reinforcement Learning

11. A Character-level Decoder without Explicit Segmentation for Neural Machine Translation. paper

    Junyoung Chung, Kyunghyun Cho, Yoshua Bengio

    Domain: Model Architecture

12. Target-Side Context for Discriminative Models in Statistical Machine Translation. paper

    Aleš Tamchyna, Alexander Fraser, Ondřej Bojar, Marcin Junczys-Dowmunt

    Domain: Statistical Machine Translation → Phrase-based Models

13. Neural Machine Translation of Rare Words with Subword Units. paper

    Rico Sennrich, Barry Haddow, Alexandra Birch

    Domain: Data-based Methods → Word Segmentation

    Paper Reading&Interpretation1 ; Paper Reading&Interpretation2

14. MUTT: Metric Unit TesTing for Language Generation Tasks. paper

    William Boag, Renan Campos, Kate Saenko, Anna Rumshisky

    Domain: Evaluation → Reference-free

15. N-gram language models for massively parallel devices. paper

    Nikolay Bogoychev, Adam Lopez

    Domain: Efficiency → Compution Optimization

    Paper Reading&Interpretation1

16. Semi-Supervised Learning for Neural Machine Translation. paper

    Yong Cheng, Wei Xu, Zhongjun He, Wei He, Hua Wu, Maosong Sun, Yang Liu

    Domain: Low-resource NMT → Semi-supervised NMT

17. Strategies for Training Large Vocabulary Neural Language Models. paper

    Wenlin Chen, David Grangier, Michael Auli

    Domain: Training Strategy ; Efficiency → Compution Optimization

18. Set-Theoretic Alignment for Comparable Corpora. paper

    Thierry Etchegoyhen, Andoni Azpeitia

    Domain: Data-based Methods → Data Augmentation

19. Jointly Learning to Embed and Predict with Multiple Languages. paper

    Daniel C. Ferreira, André F. T. Martins, Mariana S. C. Almeida

    Domain: Data-based Methods → Data Augmentation

20. Supersense Embeddings: A Unified Model for Supersense Interpretation, Prediction, and Utilization. paper

    Lucie Flekova, Iryna Gurevych

    Domain: Model Architecture

21. A New Psychometric-inspired Evaluation Metric for Chinese Word Segmentation. paper

    Peng Qian, Xipeng Qiu, Xuanjing Huang

    Domain: Evaluation → Reference-based

22. Grammatical Error Correction: Machine Translation and Classifiers. paper

    Alla Rozovskaya, Dan Roth

    Domain: Interpretability

23. Knowledge-Based Semantic Embedding for Machine Translation. paper

    Chen Shi, Shujie Liu, Shuo Ren, Shi Feng, Mu Li, Ming Zhou, Xu Sun, Houfeng Wang

    Domain: Model Architecture

24. Graph-based Dependency Parsing with Bidirectional LSTM. paper

    Wenhui Wang, Baobao Chang

    Domain: Model Architecture

25. Improving Statistical Machine Translation Performance by Oracle-BLEU Model Re-estimation. paper

    Praveen Dakwale, Christof Monz

    Domain: Statistical Machine Translation → Phrase-based Models

26. Reference Bias in Monolingual Machine Translation Evaluation. paper

    Marina Fomicheva, Lucia Specia

    Domain: Evaluation → Reference-based

27. Vocabulary Manipulation for Neural Machine Translation. paper

    Haitao Mi, Zhiguo Wang, Abe Ittycheriah

    Domain: Efficiency → Compution Optimization

28. An Open Web Platform for Rule-Based Speech-to-Sign Translation. paper

    Manny Rayner, Pierrette Bouillon, Sarah Ebling, Johanna Gerlach, Irene Strasly, Nikos Tsourakis

    Domain: Open-source Systems and Datasets

29. An Unsupervised Method for Automatic Translation Memory Cleaning. paper

    Masoud Jalili Sabet, Matteo Negri, Marco Turchi, Eduard Barbu

    Domain: Open-source Systems and Datasets

30. Exponentially Decaying Bag-of-Words Input Features for Feed-Forward Neural Network in Statistical Machine Translation. paper

    Jan-Thorsten Peter, Weiyue Wang, Hermann Ney

    Domain: Statistical Machine Translation → Word-based Models

31. Syntactically Guided Neural Machine Translation. paper

    Felix Stahlberg, Eva Hasler, Aurelien Waite, Bill Byrne

    Domain: Prior Knowledge

32. Character-based Neural Machine Translation. paper

    Marta R. Costa-jussà, José A. R. Fonollosa

    Domain: Model Architecture

33. Metrics for Evaluation of Word-level Machine Translation Quality Estimation. paper

    Varvara Logacheva, Michal Lukasik, Lucia Specia

    Domain: Evaluation → Reference-based

2017

1. A Convolutional Encoder Model for Neural Machine Translation. paper

   Jonas Gehring, Michael Auli, David Grangier, Yann Dauphin

   Domain: Model Architecture

   Paper Reading&Interpretation1 ; Paper Reading&Interpretation2

2. Deep Neural Machine Translation with Linear Associative Unit. paper

   Mingxuan Wang, Zhengdong Lu, Jie Zhou, Qun Liu

   Domain: Model Architecture

3. Creating Training Corpora for NLG Micro-Planners. paper

   Claire Gardent, Anastasia Shimorina, Shashi Narayan, Laura Perez-Beltrachini

   Domain: Data-based Methods → Data Augmentation

4. A *CCG Parsing with a Supertag and Dependency Factored Model. paper

   Masashi Yoshikawa, Hiroshi Noji, Yuji Matsumoto

   Domain: Statistical Machine Translation → Syntax-based Models

5. Multi-space Variational Encoder-Decoders for Semi-supervised Labeled Sequence Transduction. paper

   Chunting Zhou, Graham Neubig

   Domain: Low-resource NMT → Semi-supervised NMT

6. Joint CTC/attention decoding for end-to-end speech recognition. paper

   Takaaki Hori, Shinji Watanabe, John Hershey

   Domain: Multimodal NMT → Speech → End-to-End Speech Translation

   Paper Reading&Interpretation1

7. Modeling Source Syntax for Neural Machine Translation. paper

   Junhui Li, Deyi Xiong, Zhaopeng Tu, Muhua Zhu, Min Zhang, Guodong Zhou

   Domain: Prior Knowledge

8. Sequence-to-Dependency Neural Machine Translation. paper

   Shuangzhi Wu, Dongdong Zhang, Nan Yang, Mu Li, Ming Zhou

   Domain: Prior Knowledge

   Paper Reading&Interpretation1

9. A Nested Attention Neural Hybrid Model for Grammatical Error Correction. paper

   Jianshu Ji, Qinlong Wang, Kristina Toutanova, Yongen Gong, Steven Truong, Jianfeng Gao

   Domain: Ensemble

10. Automatic Annotation and Evaluation of Error Types for Grammatical Error Correction. paper

    Christopher Bryant, Mariano Felice, Ted Briscoe

    Domain: Prior Knowledge

11. Neural Machine Translation via Binary Code Prediction. paper

    Yusuke Oda, Philip Arthur, Graham Neubig, Koichiro Yoshino, Satoshi Nakamura

    Domain: Efficiency → Compution Optimization

12. What do Neural Machine Translation Models Learn about Morphology?. paper

    Yonatan Belinkov, Nadir Durrani, Fahim Dalvi, Hassan Sajjad, James Glass

    Domain: Interpretability

13. Visualizing and Understanding Neural Machine Translation. paper

    Yanzhuo Ding, Yang Liu, Huanbo Luan, Maosong Sun

    Domain: Interpretability

    Paper Reading&Interpretation1

14. Adversarial Multi-Criteria Learning for Chinese Word Segmentation. paper

    Xinchi Chen, Zhan Shi, Xipeng Qiu, Xuanjing Huang

    Domain: Data-based Methods → Word Segmentation

    Paper Reading&Interpretation1

15. Neural Joint Model for Transition-based Chinese Syntactic Analysis. paper

    Shuhei Kurita, Daisuke Kawahara, Sadao Kurohashi

    Domain: Data-based Methods → Word Segmentation

16. Robust Incremental Neural Semantic Graph Parsing. paper

    Jan Buys, Phil Blunsom

    Domain: Prior Knowledge

17. Adversarial Adaptation of Synthetic or Stale Data. paper

    Young-Bum Kim, Karl Stratos, Dongchan Kim

    Domain: Training Strategy → Generative Adversarial Networks

18. Can Syntax Help? Improving an LSTM-based Sentence Compression Model for New Domains. paper

    Liangguo Wang, Jing Jiang, Hai Leong Chieu, Chen Hui Ong, Dandan Song, Lejian Liao

    Domain: Domain Adaptation

    Paper Reading&Interpretation1

19. Bandit Structured Prediction for Neural Sequence-to-Sequence Learning. paper

    Julia Kreutzer, Artem Sokolov, Stefan Riezler

    Domain: Domain Adaptation

20. Prior Knowledge Integration for Neural Machine Translation using Posterior Regularization. paper

    Jiacheng Zhang, Yang Liu, Huanbo Luan, Jingfang Xu, Maosong Sun

    Domain: Prior Knowledge

    Paper Reading&Interpretation1 ; Paper Reading&Interpretation2

21. Incorporating Word Reordering Knowledge into Attention-based Neural Machine Translation. paper

    Jinchao Zhang, Mingxuan Wang, Qun Liu, Jie Zhou

    Domain: Attention Mechanism

22. Lexically Constrained Decoding for Sequence Generation Using Grid Beam Search. paper

    Chris Hokamp, Qun Liu

    Domain: Inference → Constrained Inference → Interactive NMT

    Paper Reading&Interpretation1 ; Paper Reading&Interpretation2

23. Enhanced LSTM for Natural Language Inference. paper

    Qian Chen, Xiaodan Zhu, Zhen-Hua Ling, Si Wei, Hui Jiang, Diana Inkpen

    Domain: Inference

    Paper Reading&Interpretation1 ; Paper Reading&Interpretation2 ; Paper Reading&Interpretation3 ; Paper Reading&Interpretation4 ; Paper Reading&Interpretation5

24. Universal Dependencies Parsing for Colloquial Singaporean English. paper

    Hongmin Wang, Yue Zhang, GuangYong Leonard Chan, Jie Yang, Hai Leong Chieu

    Domain: Low-resource NMT → Endangered Language Study

25. An Algebra for Feature Extraction. paper

    Vivek Srikumar

    Domain: Efficiency → Compution Optimization

26. Chunk-based Decoder for Neural Machine Translation. paper

    Shonosuke Ishiwatari, Jingtao Yao, Shujie Liu, Mu Li, Ming Zhou, Naoki Yoshinaga, Masaru Kitsuregawa, Weijia Jia

    Domain: Inference

27. Doubly-Attentive Decoder for Multi-modal Neural Machine Translation. paper

    Iacer Calixto, Qun Liu, Nick Campbell

    Domain: Multimodal NMT → Image

28. A Teacher-Student Framework for Zero-Resource Neural Machine Translation. paper

    Yun Chen, Yang Liu, Yong Cheng, Victor O.K. Li

    Domain: Low-resource NMT → Endangered Language Study

29. Improved Neural Machine Translation with a Syntax-Aware Encoder and Decoder. paper

    Huadong Chen, Shujian Huang, David Chiang, Jiajun Chen

    Domain: Model Architecture

30. One-Shot Neural Cross-Lingual Transfer for Paradigm Completion. paper

    Katharina Kann, Ryan Cotterell, Hinrich Schütze

    Domain: Transfer Learning

31. Revisiting Recurrent Networks for Paraphrastic Sentence Embeddings. paper

    John Wieting, Kevin Gimpel

    Domain: Transfer Learning

32. Neural Architectures for Multilingual Semantic Parsing. paper

    Raymond Hendy Susanto, Wei Lu

    Domain: Multilingual NMT

33. Incorporating Dialectal Variability for Socially Equitable Language Identification. paper

    David Jurgens, Yulia Tsvetkov, Dan Jurafsky

    Domain: Multilingual NMT

34. Learning to Parse and Translate Improves Neural Machine Translation. paper

    Akiko Eriguchi, Yoshimasa Tsuruoka, Kyunghyun Cho

    Domain: Model Architecture

35. Hybrid Neural Network Alignment and Lexicon Model in Direct HMM for Statistical Machine Translation. paper

    Weiyue Wang, Tamer Alkhouli, Derui Zhu, Hermann Ney

    Domain: Model Architecture

36. Towards String-To-Tree Neural Machine Translation. paper

    Roee Aharoni, Yoav Goldberg

    Domain: Model Architecture

37. The Role of Prosody and Speech Register in Word Segmentation: A Computational Modelling Perspective. paper

    Bogdan Ludusan, Reiko Mazuka, Mathieu Bernard, Alejandrina Cristia, Emmanuel Dupoux

    Domain: Data-based Methods → Word Segmentation

38. Attention Strategies for Multi-Source Sequence-to-Sequence Learning. paper

    Jindřich Libovický, Jindřich Helcl

    Domain: Attention Mechanism

39. Neural System Combination for Machine Translation. paper

    Long Zhou, Wenpeng Hu, Jiajun Zhang, Chengqing Zong

    Domain: Ensemble

40. An Empirical Comparison of Domain Adaptation Methods for Neural Machine Translation. paper

    Chenhui Chu, Raj Dabre, Sadao Kurohashi

    Domain: Domain Adaptation

41. Efficient Extraction of Pseudo-Parallel Sentences from Raw Monolingual Data Using Word Embeddings. paper

    Benjamin Marie, Atsushi Fujita

    Domain: Data-based Methods → Data Augmentation

42. Sentence Embedding for Neural Machine Translation Domain Adaptation. paper

    Rui Wang, Andrew Finch, Masao Utiyama, Eiichiro Sumita

    Domain: Domain Adaptation

43. Data Augmentation for Low-Resource Neural Machine Translation. paper

    Marzieh Fadaee, Arianna Bisazza, Christof Monz

    Domain: Data-based Methods → Data Augmentation

44. Speeding Up Neural Machine Translation Decoding by Shrinking Run-time Vocabulary. paper

    Xing Shi, Kevin Knight

    Domain: Efficiency → Compution Optimization

45. Chunk-Based Bi-Scale Decoder for Neural Machine Translation. paper

    Hao Zhou, Zhaopeng Tu, Shujian Huang, Xiaohua Liu, Hang Li, Jiajun Chen

    Domain: Model Architecture

46. Challenging Language-Dependent Segmentation for Arabic: An Application to Machine Translation and Part-of-Speech Tagging. paper

    Hassan Sajjad, Fahim Dalvi, Nadir Durrani, Ahmed Abdelali, Yonatan Belinkov, Stephan Vogel

    Domain: Data-based Methods → Word Segmentation

2018

1. Unsupervised Neural Machine Translation with Weight Sharing. paper

   Zhen Yang, Wei Chen, Feng Wang, Bo Xu

   Domain: Low-resource NMT → Unsupervised NMT

   Paper Reading&Interpretation1

2. Triangular Architecture for Rare Language Translation. paper

   Shuo Ren, Wenhu Chen, Shujie Liu, Mu Li, Ming Zhou, Shuai Ma

   Domain: Low-resource NMT → Endangered Language Study

   Paper Reading&Interpretation1

3. On the Limitations of Unsupervised Bilingual Dictionary Induction. paper

   Anders Søgaard, Sebastian Ruder, Ivan Vulić

   Domain: Low-resource NMT → Unsupervised NMT

4. The Best of Both Worlds: Combining Recent Advances in Neural Machine Translation. paper

   Mia Xu Chen, Orhan Firat, Ankur Bapna, Melvin Johnson, Wolfgang Macherey, George Foster, Llion Jones, Mike Schuster, Noam Shazeer, Niki Parmar, Ashish Vaswani, Jakob Uszkoreit, Lukasz Kaiser, Zhifeng Chen, Yonghui Wu, Macduff Hughes

   Domain: Model Architecture

   Paper Reading&Interpretation1

5. Attention Focusing for Neural Machine Translation by Bridging Source and Target Embeddings. paper

   Shaohui Kuang, Junhui Li, Antonio Branco, Weihua Luo, Deyi Xiong

   Domain: Attention Mechanism

   Paper Reading&Interpretation1

6. Accelerating Neural Transformer via an Average Attention Network. paper

   Biao Zhang, Deyi Xiong, Jinsong Su

   Domain: Attention Mechanism ; Efficiency → Compution Optimization ; Robustness

   Paper Reading&Interpretation1 ; Paper Reading&Interpretation2

7. Neural Hidden Markov Model for Machine Translation. paper

   Weiyue Wang, Derui Zhu, Tamer Alkhouli, Zixuan Gan, Hermann Ney

   Domain: Model Architecture

8. Subword Regularization: Improving Neural Network Translation Models with Multiple Subword Candidates. paper

   Taku Kudo

   Domain: Data-based Methods → Word Segmentation

   Paper Reading&Interpretation1 ; Paper Reading&Interpretation2 ; Paper Reading&Interpretation3 ; Paper Reading&Interpretation4

9. A Stochastic Decoder for Neural Machine Translation. paper

   Philip Schulz, Wilker Aziz, Trevor Cohn

   Domain: Model Architecture

10. Forest-Based Neural Machine Translation. paper

    Chunpeng Ma, Akihiro Tamura, Masao Utiyama, Tiejun Zhao, Eiichiro Sumita

    Domain: Model Architecture

    Paper Reading&Interpretation1

11. Towards Robust Neural Machine Translation. paper

    Yong Cheng, Zhaopeng Tu, Fandong Meng, Junjie Zhai, Yang Liu

    Domain: Robustness

    Paper Reading&Interpretation1 ; Paper Reading&Interpretation2

2019

1. Latent Variable Model for Multi-modal Translation. paper

   Iacer Calixto, Miguel Rios, Wilker Aziz

   Domain: Multimodal NMT → Image

2. Learning Deep Transformer Models for Machine Translation. paper

   Qiang Wang, Bei Li, Tong Xiao, Jingbo Zhu, Changliang Li, Derek F. Wong, Lidia S. Chao

   Domain: Model Architecture ; Robustness

   Paper Reading&Interpretation1

3. When a Good Translation is Wrong in Context: Context-Aware Machine Translation Improves on Deixis, Ellipsis, and Lexical Cohesion. paper

   Elena Voita, Rico Sennrich, Ivan Titov

   Domain: Data-based Methods → Data Augmentation

4. A Compact and Language-Sensitive Multilingual Translation Method. paper

   Yining Wang, Long Zhou, Jiajun Zhang, Feifei Zhai, Jingfang Xu, Chengqing Zong

   Domain: Multilingual NMT

5. Robust Neural Machine Translation with Doubly Adversarial Inputs. paper

   Yong Cheng, Lu Jiang, Wolfgang Macherey

   Domain: Robustness

   Paper Reading&Interpretation1 ; Paper Reading&Interpretation2 ; Paper Reading&Interpretation3 ; Paper Reading&Interpretation4

6. Shared-Private Bilingual Word Embeddings for Neural Machine Translation. paper

   Xuebo Liu, Derek F. Wong, Yang Liu, Lidia S. Chao, Tong Xiao, Jingbo Zhu

   Domain: Efficiency → Model Compression → Weight Sharing

7. Unsupervised Parallel Sentence Extraction with Parallel Segment Detection Helps Machine Translation. paper

   Viktor Hangya, Alexander Fraser

   Domain: Low-resource NMT → Unsupervised NMT

8. Unsupervised Bilingual Word Embedding Agreement for Unsupervised Neural Machine Translation. paper

   Haipeng Sun, Rui Wang, Kehai Chen, Masao Utiyama, Eiichiro Sumita, Tiejun Zhao

   Domain: Low-resource NMT → Unsupervised NMT ; Pre-training

   Paper Reading&Interpretation1

9. Neural Machine Translation with Reordering Embeddings. paper

   Kehai Chen, Rui Wang, Masao Utiyama, Eiichiro Sumita

   Domain: Prior Knowledge

10. Neural Fuzzy Repair: Integrating Fuzzy Matches into Neural Machine Translation. paper

    Bram Bulte, Arda Tezcan

    Domain: Data-based Methods → Data Augmentation

11. Effective Cross-lingual Transfer of Neural Machine Translation Models without Shared Vocabularies. paper

    Yunsu Kim, Yingbo Gao, Hermann Ney

    Domain: Transfer Learning

12. Bridging the Gap between Training and Inference for Neural Machine Translation. paper

    Wen Zhang, Yang Feng, Fandong Meng, Di You, Qun Liu

    Domain: Model Architecture

    Paper Reading&Interpretation1 ; Paper Reading&Interpretation2 ; Paper Reading&Interpretation3 ; Paper Reading&Interpretation4 ; Paper Reading&Interpretation5 ; Paper Reading&Interpretation6

13. Improved Zero-shot Neural Machine Translation via Ignoring Spurious Correlations. paper

    Jiatao Gu, Yong Wang, Kyunghyun Cho, Victor O.K. Li

    Domain: Low-resource NMT → Unsupervised NMT

    Paper Reading&Interpretation1

14. Lattice Transformer for Speech Translation. paper

    Pei Zhang, Niyu Ge, Boxing Chen, Kai Fan

    Domain: Multimodal NMT → Speech → Cascaded Speech Translation

15. Generalized Data Augmentation for Low-Resource Translation. paper

    Mengzhou Xia, Xiang Kong, Antonios Anastasopoulos, Graham Neubig

    Domain: Data-based Methods → Data Augmentation ; Low-resource NMT → Unsupervised NMT

16. Syntactically Supervised Transformers for Faster Neural Machine Translation. paper

    Nader Akoury, Kalpesh Krishna, Mohit Iyyer

    Domain: Inference → Constrained Inference → Restricted NMT

17. Unsupervised Pivot Translation for Distant Languages. paper

    Yichong Leng, Xu Tan, Tao Qin, Xiang-Yang Li, Tie-Yan Liu

    Domain: Low-resource NMT → Unsupervised NMT

    Paper Reading&Interpretation1

18. Dynamically Composing Domain-Data Selection with Clean-Data Selection by "Co-Curricular Learning" for Neural Machine Translation. paper

    Wei Wang, Isaac Caswell, Ciprian Chelba

    Domain: Transfer Learning

19. On the Word Alignment from Neural Machine Translation. paper

    Xintong Li, Guanlin Li, Lemao Liu, Max Meng, Shuming Shi

    Domain: Prior Knowledge

20. Imitation Learning for Non-Autoregressive Neural Machine Translation. paper

    Bingzhen Wei, Mingxuan Wang, Hao Zhou, Junyang Lin, Xu Sun

    Domain: Inference → Non-autoregressive

    Paper Reading&Interpretation1

21. Monotonic Infinite Lookback Attention for Simultaneous Machine Translation. paper

    Naveen Arivazhagan, Colin Cherry, Wolfgang Macherey, Chung-Cheng Chiu, Semih Yavuz, Ruoming Pang, Wei Li, Colin Raffel

    Domain: Real-time NMT

22. Domain Adaptation of Neural Machine Translation by Lexicon Induction. paper

    Junjie Hu, Mengzhou Xia, Graham Neubig, Jaime Carbonell

    Domain: Domain Adaptation

23. Beyond BLEU:Training Neural Machine Translation with Semantic Similarity. paper

    John Wieting, Taylor Berg-Kirkpatrick, Kevin Gimpel, Graham Neubig

    Domain: Evaluation → Reference-based

24. An Effective Approach to Unsupervised Machine Translation. paper

    Mikel Artetxe, Gorka Labaka, Eneko Agirre

    Domain: Low-resource NMT → Unsupervised NMT

    Paper Reading&Interpretation1 ; Paper Reading&Interpretation2

25. Distilling Translations with Visual Awareness. paper

    Julia Ive, Pranava Madhyastha, Lucia Specia

    Domain: Multimodal NMT → Image

26. Reference Network for Neural Machine Translation. paper

    Han Fu, Chenghao Liu, Jianling Sun

    Domain: Prior Knowledge

27. Retrieving Sequential Information for Non-Autoregressive Neural Machine Translation. paper

    Chenze Shao, Yang Feng, Jinchao Zhang, Fandong Meng, Xilin Chen, Jie Zhou

    Domain: Inference → Non-autoregressive

    Paper Reading&Interpretation1

28. Sparse Sequence-to-Sequence Models. paper

    Ben Peters, Vlad Niculae, André F. T. Martins

    Domain: Efficiency → Compution Optimization

29. Look Harder: A Neural Machine Translation Model with Hard Attention. paper

    Sathish Reddy Indurthi, Insoo Chung, Sangha Kim

    Domain: Attention Mechanism

30. Robust Neural Machine Translation with Joint Textual and Phonetic Embedding. paper

    Hairong Liu, Mingbo Ma, Liang Huang, Hao Xiong, Zhongjun He

    Domain: Robustness

31. Self-Supervised Neural Machine Translation. paper

    Dana Ruiter, Cristina España-Bonet, Josef van Genabith

    Domain: Low-resource NMT → Unsupervised NMT

32. Soft Contextual Data Augmentation for Neural Machine Translation. paper

    Fei Gao, Jinhua Zhu, Lijun Wu, Yingce Xia, Tao Qin, Xueqi Cheng, Wengang Zhou, Tie-Yan Liu

    Domain: Data-based Methods → Data Augmentation

    Paper Reading&Interpretation1

33. Domain Adaptive Inference for Neural Machine Translation. paper

    Danielle Saunders, Felix Stahlberg, Adrià de Gispert, Bill Byrne

    Domain: Domain Adaptation

34. Revisiting Low-Resource Neural Machine Translation: A Case Study. paper

    Rico Sennrich, Biao Zhang

    Domain: Low-resource NMT

35. Target Conditioned Sampling: Optimizing Data Selection for Multilingual Neural Machine Translation. paper

    Xinyi Wang, Graham Neubig

    Domain: Data-based Methods → Schedule Strategy → Data Selection ; Multilingual NMT

36. Reducing Word Omission Errors in Neural Machine Translation: A Contrastive Learning Approach. paper

    Zonghan Yang, Yong Cheng, Yang Liu, Maosong Sun

    Domain: Training Strategy → Contrastive Learning

    Paper Reading&Interpretation1 ; Paper Reading&Interpretation2

37. Translating Translationese: A Two-Step Approach to Unsupervised Machine Translation. paper

    Nima Pourdamghani, Nada Aldarrab, Marjan Ghazvininejad, Kevin Knight, Jonathan May

    Domain: Low-resource NMT → Unsupervised NMT

    Paper Reading&Interpretation1

38. Generating Diverse Translations with Sentence Codes. paper

    Raphael Shu, Hideki Nakayama, Kyunghyun Cho

    Domain: Diversity and Fairness

39. Exploring Phoneme-Level Speech Representations for End-to-End Speech Translation. paper

    Elizabeth Salesky, Matthias Sperber, Alan W Black

    Domain: Multimodal NMT → Speech → End-to-End Speech Translation

40. Training Neural Machine Translation To Apply Terminology Constraints. paper

    Georgiana Dinu, Prashant Mathur, Marcello Federico, Yaser Al-Onaizan

    Domain: Prior Knowledge

    Paper Reading&Interpretation1

41. Exploiting Sentential Context for Neural Machine Translation. paper

    Xing Wang, Zhaopeng Tu, Longyue Wang, Shuming Shi

    Domain: Model Architecture

    Paper Reading&Interpretation1

42. Depth Growing for Neural Machine Translation. paper

    Lijun Wu, Yiren Wang, Yingce Xia, Fei Tian, Fei Gao, Tao Qin, Jianhuang Lai, Tie-Yan Liu

    Domain: Model Architecture ; Training Strategy

43. Effective Adversarial Regularization for Neural Machine Translation. paper

    Motoki Sato, Jun Suzuki, Shun Kiyono

    Domain: Training Strategy ; Robustness

    Paper Reading&Interpretation1

44. Evaluating Gender Bias in Machine Translation. paper

    Gabriel Stanovsky, Noah A. Smith, Luke Zettlemoyer

    Domain: Evaluation → Reference-based

45. Putting Evaluation in Context: Contextual Embeddings improve Machine Translation Evaluation. paper

    Nitika Mathur, Timothy Baldwin, Trevor Cohn

    Domain: Evaluation → Reference-free

46. Sentence-Level Agreement for Neural Machine Translation. paper

    Mingming Yang, Rui Wang, Kehai Chen, Masao Utiyama, Eiichiro Sumita, Min Zhang, Tiejun Zhao

    Domain: Model Architecture

47. Bilingual Lexicon Induction through Unsupervised Machine Translation. paper

    Mikel Artetxe, Gorka Labaka, Eneko Agirre

    Domain: Low-resource NMT → Unsupervised NMT

    Paper Reading&Interpretation1

48. Better OOV Translation with Bilingual Terminology Mining. paper

    Matthias Huck, Viktor Hangya, Alexander Fraser

    Domain: Prior Knowledge

49. Lattice-Based Transformer Encoder for Neural Machine Translation. paper

    Fengshun Xiao, Jiangtong Li, Hai Zhao, Rui Wang, Kehai Chen

    Domain: Prior Knowledge ; Attention Mechanism

50. Simultaneous Translation with Flexible Policy via Restricted Imitation Learning. paper

    Baigong Zheng, Renjie Zheng, Mingbo Ma, Liang Huang

    Domain: Training Strategy → Contrastive Learning ; Real-time NMT

    Paper Reading&Interpretation1

2020

1. Addressing Posterior Collapse with Mutual Information for Improved Variational Neural Machine Translation. paper

   Arya D. McCarthy, Xian Li, Jiatao Gu, Ning Dong

   Domain: Model Architecture

2. Multiscale Collaborative Deep Models for Neural Machine Translation. paper

   Xiangpeng Wei, Heng Yu, Yue Hu, Yue Zhang, Rongxiang Weng, Weihua Luo

   Domain: Model Architecture

3. Hard-Coded Gaussian Attention for Neural Machine Translation. paper

   Weiqiu You, Simeng Sun, Mohit Iyyer

   Domain: Attention Mechanism

4. Improving Neural Machine Translation with Soft Template Prediction. paper

   Jian Yang, Shuming Ma, Dongdong Zhang, Zhoujun Li, Ming Zhou

   Domain: Model Architecture ; Prior Knowledge

5. Learning Source Phrase Representations for Neural Machine Translation. paper

   Hongfei Xu, Josef van Genabith, Deyi Xiong, Qiuhui Liu, Jingyi Zhang

   Domain: Model Architecture ; Attention Mechanism

6. A Reinforced Generation of Adversarial Examples for Neural Machine Translation. paper

   Wei Zou, Shujian Huang, Jun Xie, Xinyu Dai, Jiajun Chen

   Domain: Data-based Methods → Data Augmentation ; Robustness

   Paper Reading&Interpretation1

7. Boosting Neural Machine Translation with Similar Translations. paper

   Jitao XU, Josep Crego, Jean Senellart

   Domain: Data-based Methods → Data Augmentation

8. Selecting Backtranslated Data from Multiple Sources for Improved Neural Machine Translation. paper

   Xabier Soto, Dimitar Shterionov, Alberto Poncelas, Andy Way

   Domain: Data-based Methods → Schedule Strategy → Data Selection

9. AdvAug: Robust Adversarial Augmentation for Neural Machine Translation. paper

   Yong Cheng, Lu Jiang, Wolfgang Macherey, Jacob Eisenstein

   Domain: Data-based Methods → Data Augmentation

10. Norm-Based Curriculum Learning for Neural Machine Translation. paper

    Xuebo Liu, Houtim Lai, Derek F. Wong, Lidia S. Chao

    Domain: Data-based Methods → Schedule Strategy → Curriculum Learning

11. Uncertainty-Aware Curriculum Learning for Neural Machine Translation. paper

    Yikai Zhou, Baosong Yang, Derek F. Wong, Yu Wan, Lidia S. Chao

    Domain: Data-based Methods → Schedule Strategy → Curriculum Learning

    Paper Reading&Interpretation1

12. Balancing Training for Multilingual Neural Machine Translation. paper

    Xinyi Wang, Yulia Tsvetkov, Graham Neubig

    Domain: Data-based Methods → Schedule Strategy → Data Selection ; Multilingual NMT

13. Improving Massively Multilingual Neural Machine Translation and Zero-Shot Translation. paper

    Biao Zhang, Philip Williams, Ivan Titov, Rico Sennrich

    Domain: Multilingual NMT

    Paper Reading&Interpretation1

14. Knowledge Distillation for Multilingual Unsupervised Neural Machine Translation. paper

    Haipeng Sun, Rui Wang, Kehai Chen, Masao Utiyama, Eiichiro Sumita, Tiejun Zhao

    Domain: Efficiency → Model Compression → Knowledge Distillation ; Low-resource NMT → Unsupervised NMT ; Multilingual NMT

15. Translationese as a Language in “Multilingual” NMT. paper

    Parker Riley, Isaac Caswell, Markus Freitag, David Grangier

    Domain: Prior Knowledge

16. A Novel Graph-based Multi-modal Fusion Encoder for Neural Machine Translation. paper

    Yongjing Yin, Fandong Meng, Jinsong Su, Chulun Zhou, Zhengyuan Yang, Jie Zhou, Jiebo Luo

    Domain: Multimodal NMT → Image

    Paper Reading&Interpretation1 ; Paper Reading&Interpretation2

17. Unsupervised Multimodal Neural Machine Translation with Pseudo Visual Pivoting. paper

    Po-Yao Huang, Junjie Hu, Xiaojun Chang, Alexander Hauptmann

    Domain: Multimodal NMT → Image

18. Learning a Multi-Domain Curriculum for Neural Machine Translation. paper

    Wei Wang, Ye Tian, Jiquan Ngiam, Yinfei Yang, Isaac Caswell, Zarana Parekh

    Domain: Data-based Methods → Schedule Strategy → Curriculum Learning ; Domain Adaptation

19. Multi-Domain Neural Machine Translation with Word-Level Adaptive Layer-wise Domain Mixing. paper

    Haoming Jiang, Chen Liang, Chong Wang, Tuo Zhao

    Domain: Domain Adaptation

20. Reducing Gender Bias in Neural Machine Translation as a Domain Adaptation Problem. paper

    Danielle Saunders, Bill Byrne

    Domain: Domain Adaptation

21. BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension. paper

    Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Veselin Stoyanov, Luke Zettlemoyer

    Domain: Pre-training

    Paper Reading&Interpretation1 ; Paper Reading&Interpretation2 ; Paper Reading&Interpretation3

22. Curriculum Pre-training for End-to-End Speech Translation. paper

    Chengyi Wang, Yu Wu, Shujie Liu, Ming Zhou, Zhenglu Yang

    Domain: Data-based Methods → Schedule Strategy → Curriculum Learning ; Multimodal NMT → Speech → End-to-End Speech Translation ; Pre-training

23. Bilingual Dictionary Based Neural Machine Translation without Using Parallel Sentences. paper

    Xiangyu Duan, Baijun Ji, Hao Jia, Min Tan, Min Zhang, Boxing Chen, Weihua Luo, Yue Zhang

    Domain: Low-resource NMT → Unsupervised NMT

24. A Retrieve-and-Rewrite Initialization Method for Unsupervised Machine Translation. paper

    Shuo Ren, Yu Wu, Shujie Liu, Ming Zhou, Shuai Ma

    Domain: Low-resource NMT → Unsupervised NMT

25. Document Translation vs. Query Translation for Cross-Lingual Information Retrieval in the Medical Domain. paper

    Shadi Saleh, Pavel Pecina

    Domain: Document-level NMT

26. Dynamic Programming Encoding for Subword Segmentation in Neural Machine Translation. paper

    Xuanli He, Gholamreza Haffari, Mohammad Norouzi

    Domain: Data-based Methods → Word Segmentation

27. In Neural Machine Translation, What Does Transfer Learning Transfer?. paper

    Alham Fikri Aji, Nikolay Bogoychev, Kenneth Heafield, Rico Sennrich

    Domain: Interpretability

28. Jointly Masked Sequence-to-Sequence Model for Non-Autoregressive Neural Machine Translation. paper

    Junliang Guo, Linli Xu, Enhong Chen

    Domain: Inference → Non-autoregressive

    Paper Reading&Interpretation1

29. Learning to Recover from Multi-Modality Errors for Non-Autoregressive Neural Machine Translation. paper

    Qiu Ran, Yankai Lin, Peng Li, Jie Zhou

    Domain: Inference → Non-autoregressive

    Paper Reading&Interpretation1 ; Paper Reading&Interpretation2

30. Multi-Hypothesis Machine Translation Evaluation. paper

    Marina Fomicheva, Lucia Specia, Francisco Guzmán

    Domain: Evaluation → Reference-based

31. On the Limitations of Cross-lingual Encoders as Exposed by Reference-Free Machine Translation Evaluation. paper

    Wei Zhao, Goran Glavaš, Maxime Peyrard, Yang Gao, Robert West, Steffen Eger

    Domain: Evaluation → Reference-free

32. On The Evaluation of Machine Translation Systems Trained With Back-Translation. paper

    Sergey Edunov, Myle Ott, Marc’Aurelio Ranzato, Michael Auli

    Domain: Evaluation → Reference-based

33. Tangled up in BLEU: Reevaluating the Evaluation of Automatic Machine Translation Evaluation Metrics. paper

    Nitika Mathur, Timothy Baldwin, Trevor Cohn

    Domain: Evaluation → Reference-based

34. Evaluating Explanation Methods for Neural Machine Translation. paper

    Jierui Li, Lemao Liu, Huayang Li, Guanlin Li, Guoping Huang, Shuming Shi

    Domain: Interpretability

35. On the Inference Calibration of Neural Machine Translation. paper

    Shuo Wang, Zhaopeng Tu, Shuming Shi, Yang Liu

    Domain: Robustness

36. Regularized Context Gates on Transformer for Machine Translation. paper

    Xintong Li, Lemao Liu, Rui Wang, Guoping Huang, Max Meng

    Domain: Model Architecture

37. Character-Level Translation with Self-attention. paper

    Yingqiang Gao, Nikola I. Nikolov, Yuhuang Hu, Richard H.R. Hahnloser

    Domain: Model Architecture

38. Variational Neural Machine Translation with Normalizing Flows. paper

    Hendra Setiawan, Matthias Sperber, Udhyakumar Nallasamy, Matthias Paulik

    Domain: Model Architecture

    Paper Reading&Interpretation1

39. Enhancing Machine Translation with Dependency-Aware Self-Attention. paper

    Emanuele Bugliarello, Naoaki Okazaki

    Domain: Prior Knowledge

40. Content Word Aware Neural Machine Translation. paper

    Kehai Chen, Rui Wang, Masao Utiyama, Eiichiro Sumita

    Domain: Prior Knowledge

41. Using Context in Neural Machine Translation Training Objectives. paper

    Danielle Saunders, Felix Stahlberg, Bill Byrne

    Domain: Document-level NMT

42. A Simple and Effective Unified Encoder for Document-Level Machine Translation. paper

    Shuming Ma, Dongdong Zhang, Ming Zhou

    Domain: Document-level NMT ; Model Architecture

    Paper Reading&Interpretation1

43. Contextual Neural Machine Translation Improves Translation of Cataphoric Pronouns. paper

    KayYen Wong, Sameen Maruf, Gholamreza Haffari

    Domain: Document-level NMT

44. Does Multi-Encoder Help? A Case Study on Context-Aware Neural Machine Translation. paper

    Bei Li, Hui Liu, Ziyang Wang, Yufan Jiang, Tong Xiao, Jingbo Zhu, Tongran Liu, Changliang Li

    Domain: Document-level NMT ; Interpretability

    Paper Reading&Interpretation1 ; Paper Reading&Interpretation2

45. ENGINE: Energy-Based Inference Networks for Non-Autoregressive Machine Translation. paper

    Lifu Tu, Richard Yuanzhe Pang, Sam Wiseman, Kevin Gimpel

    Domain: Inference → Non-autoregressive

46. Lexically Constrained Neural Machine Translation with Levenshtein Transformer. paper

    Raymond Hendy Susanto, Shamil Chollampatt, Liling Tan

    Domain: Inference → Constrained Inference → Automatic Post-Editing ; Inference → Constrained Inference → Restricted NMT

47. Improving Non-autoregressive Neural Machine Translation with Monolingual Data. paper

    Jiawei Zhou, Phillip Keung

    Domain: Data-based Methods → Data Augmentation

48. Evaluating Robustness to Input Perturbations for Neural Machine Translation. paper

    Xing Niu, Prashant Mathur, Georgiana Dinu, Yaser Al-Onaizan

    Domain: Evaluation → Reference-based

    Paper Reading&Interpretation1 ; Paper Reading&Interpretation2

49. It’s Easier to Translate out of English than into it: Measuring Neural Translation Difficulty by Cross-Mutual Information. paper

    Emanuele Bugliarello, Sabrina J. Mielke, Antonios Anastasopoulos, Ryan Cotterell, Naoaki Okazaki

    Domain: Evaluation → Reference-based

50. Automatic Machine Translation Evaluation using Source Language Inputs and Cross-lingual Language Model. paper

    Kosuke Takahashi, Katsuhito Sudoh, Satoshi Nakamura

    Domain: Evaluation → Reference-based

51. Language-aware Interlingua for Multilingual Neural Machine Translation. paper

    Changfeng Zhu, Heng Yu, Shanbo Cheng, Weihua Luo

    Domain: Multilingual NMT

52. Leveraging Monolingual Data with Self-Supervision for Multilingual Neural Machine Translation. paper

    Aditya Siddhant, Ankur Bapna, Yuan Cao, Orhan Firat, Mia Chen, Sneha Kudugunta, Naveen Arivazhagan, Yonghui Wu

    Domain: Low-resource NMT → Unsupervised NMT ; Multilingual NMT

53. Multimodal Transformer for Multimodal Machine Translation. paper

    Shaowei Yao, Xiaojun Wan

    Domain: Multimodal NMT → Image

54. Opportunistic Decoding with Timely Correction for Simultaneous Translation. paper

    Renjie Zheng, Mingbo Ma, Baigong Zheng, Kaibo Liu, Liang Huang

    Domain: Real-time NMT

    Paper Reading&Interpretation1

55. Simultaneous Translation Policies: From Fixed to Adaptive. paper

    Baigong Zheng, Kaibo Liu, Renjie Zheng, Mingbo Ma, Hairong Liu, Liang Huang

    Domain: Real-time NMT

56. Tagged Back-translation Revisited: Why Does It Really Work?. paper

    Benjamin Marie, Raphael Rubino, Atsushi Fujita

    Domain: Data-based Methods → Data Augmentation

57. Modeling Word Formation in English–German Neural Machine Translation. paper

    Marion Weller-Di Marco, Alexander Fraser

    Domain: Data-based Methods → Word Segmentation

58. “You Sound Just Like Your Father” Commercial Machine Translation Systems Include Stylistic Biases. paper

    Dirk Hovy, Federico Bianchi, Tommaso Fornaciari

    Domain: Diversity and Fairness

59. On Exposure Bias, Hallucination and Domain Shift in Neural Machine Translation. paper

    Chaojun Wang, Rico Sennrich

    Domain: Training Strategy

2021

1. Contrastive Learning for Many-to-many Multilingual Neural Machine Translation. paper

   Xiao Pan, Mingxuan Wang, Liwei Wu, Lei Li

   Domain: Multilingual NMT ; Training Strategy → Contrastive Learning

   Paper Reading&Interpretation1

2. Understanding the Properties of Minimum Bayes Risk Decoding in Neural Machine Translation. paper

   Mathias Müller, Rico Sennrich

   Domain: Robustness ; Interpretability

3. Multi-Head Highly Parallelized LSTM Decoder for Neural Machine Translation. paper

   Hongfei Xu, Qiuhui Liu, Josef van Genabith, Deyi Xiong, Meng Zhang

   Domain: Efficiency → Compution Optimization

4. Learning Language Specific Sub-network for Multilingual Machine Translation. paper

   Zehui Lin, Liwei Wu, Mingxuan Wang, Lei Li

   Domain: Multilingual NMT

   Paper Reading&Interpretation1

5. Cascaded Head-colliding Attention. paper

   Lin Zheng, Zhiyong Wu, Lingpeng Kong

   Domain: Attention Mechanism

   Paper Reading&Interpretation1

6. Do Context-Aware Translation Models Pay the Right Attention?. paper

   Kayo Yin, Patrick Fernandes, Danish Pruthi, Aditi Chaudhary, André F. T. Martins, Graham Neubig

   Domain: Attention Mechanism ; Interpretability

7. Adapting High-resource NMT Models to Translate Low-resource Related Languages without Parallel Data. paper

   Wei-Jen Ko, Ahmed El-Kishky, Adithya Renduchintala, Vishrav Chaudhary, Naman Goyal, Francisco Guzmán, Pascale Fung, Philipp Koehn, Mona Diab

   Domain: Low-resource NMT → Endangered Language Study

8. Multilingual Speech Translation from Efficient Finetuning of Pretrained Models. paper

   Xian Li, Changhan Wang, Yun Tang, Chau Tran, Yuqing Tang, Juan Pino, Alexei Baevski, Alexis Conneau, Michael Auli

   Domain: Multimodal NMT → Speech → Cascaded Speech Translation ; Multilingual NMT ; Pre-training

9. Improving Zero-Shot Translation by Disentangling Positional Information. paper

   Danni Liu, Jan Niehues, James Cross, Francisco Guzmán, Xian Li

   Domain: Multilingual NMT

10. Exploiting Language Relatedness for Low Web-Resource Language Model Adaptation: An Indic Languages Study. paper

    Yash Khemchandani, Sarvesh Mehtani, Vaidehi Patil, Abhijeet Awasthi, Partha Talukdar, Sunita Sarawagi

    Domain: Pre-training

11. Glancing Transformer for Non-Autoregressive Neural Machine Translation. paper

    Lihua Qian, Hao Zhou, Yu Bao, Mingxuan Wang, Lin Qiu, Weinan Zhang, Yong Yu, Lei Li

    Domain: Inference → Non-autoregressive

    Paper Reading&Interpretation1 ; Paper Reading&Interpretation2

12. Weight Distillation: Transferring the Knowledge in Neural Network Parameters. paper

    Ye Lin, Yanyang Li, Ziyang Wang, Bei Li, Quan Du, Tong Xiao, Jingbo Zhu

    Domain: Efficiency → Model Compression → Knowledge Distillation

    Paper Reading&Interpretation1

13. Data Augmentation for Text Generation Without Any Augmented Data. paper

    Wei Bi, Huayang Li, Jiacheng Huang

    Domain: Data-based Methods → Data Augmentation

14. Beyond Sentence-Level End-to-End Speech Translation: Context Helps. paper

    Biao Zhang, Ivan Titov, Barry Haddow, Rico Sennrich

    Domain: Multimodal NMT → Speech → End-to-End Speech Translation

15. Self-Training Sampling with Monolingual Data Uncertainty for Neural Machine Translation. paper

    Wenxiang Jiao, Xing Wang, Zhaopeng Tu, Shuming Shi, Michael Lyu, Irwin King

    Domain: Data-based Methods → Data Augmentation

16. Breaking the Corpus Bottleneck for Context-Aware Neural Machine Translation with Cross-Task Pre-training. paper

    Linqing Chen, Junhui Li, Zhengxian Gong, Boxing Chen, Weihua Luo, Min Zhang, Guodong Zhou

    Domain: Pre-training

17. Guiding Teacher Forcing with Seer Forcing for Neural Machine Translation. paper

    Yang Feng, Shuhao Gu, Dengji Guo, Zhengxin Yang, Chenze Shao

    Domain: Efficiency → Model Compression → Knowledge Distillation ; Model Architecture

18. Cascade versus Direct Speech Translation: Do the Differences Still Make a Difference?. paper

    Luisa Bentivogli, Mauro Cettolo, Marco Gaido, Alina Karakanta, Alberto Martinelli, Matteo Negri, Marco Turchi

    Domain: Multimodal NMT → Speech → Cascaded Speech Translation

19. Unsupervised Neural Machine Translation for Low-Resource Domains via Meta-Learning. paper

    Cheonbok Park, Yunwon Tae, TaeHee Kim, Soyoung Yang, Mohammad Azam Khan, Lucy Park, Jaegul Choo

    Domain: Low-resource NMT → Unsupervised NMT ; Domain Adaptation

    Paper Reading&Interpretation1

20. Marginal Utility Diminishes: Exploring the Minimum Knowledge for BERT Knowledge Distillation. paper

    Yuanxin Liu, Fandong Meng, Zheng Lin, Weiping Wang, Jie Zhou

    Domain: Efficiency → Model Compression → Knowledge Distillation ; Pre-training

    Paper Reading&Interpretation1

21. LeeBERT: Learned Early Exit for BERT with cross-level optimization. paper

    Wei Zhu

    Domain: Pre-training

22. Meta-KD: A Meta Knowledge Distillation Framework for Language Model Compression across Domains. paper

    Haojie Pan, Chengyu Wang, Minghui Qiu, Yichang Zhang, Yaliang Li, Jun Huang

    Domain: Efficiency → Model Compression → Knowledge Distillation ; Domain Adaptation

    Paper Reading&Interpretation1

23. Online Learning Meets Machine Translation Evaluation: Finding the Best Systems with the Least Human Effort. paper

    Vânia Mendonça, Ricardo Rei, Luisa Coheur, Alberto Sardinha, Ana Lúcia Santos

    Domain: Evaluation → Reference-based

    Paper Reading&Interpretation1

24. How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models. paper

    Phillip Rust, Jonas Pfeiffer, Ivan Vulić, Sebastian Ruder, Iryna Gurevych

    Domain: Pre-training

    Paper Reading&Interpretation1

25. From Machine Translation to Code-Switching: Generating High-Quality Code-Switched Text. paper

    Ishan Tarunesh, Syamantak Kumar, Preethi Jyothi

    Domain: Low-resource NMT → Endangered Language Study

26. Fast and Accurate Neural Machine Translation with Translation Memory. paper

    Qiuxiang He, Guoping Huang, Qu Cui, Li Li, Lemao Liu

    Domain: Model Architecture

27. Meta-Learning to Compositionally Generalize. paper

    Henry Conklin, Bailin Wang, Kenny Smith, Ivan Titov

    Domain: Training Strategy → Meta Learning

28. Taming Pre-trained Language Models with N-gram Representations for Low-Resource Domain Adaptation. paper

    Shizhe Diao, Ruijia Xu, Hongjin Su, Yilei Jiang, Yan Song, Tong Zhang

    Domain: Domain Adaptation

29. Consistency Regularization for Cross-Lingual Fine-Tuning. paper

    Bo Zheng, Li Dong, Shaohan Huang, Wenhui Wang, Zewen Chi, Saksham Singhal, Wanxiang Che, Ting Liu, Xia Song, Furu Wei

    Domain: Multilingual NMT

    Paper Reading&Interpretation1 ; Paper Reading&Interpretation2

30. Rejuvenating Low-Frequency Words: Making the Most of Parallel Data in Non-Autoregressive Translation. paper

    Liang Ding, Longyue Wang, Xuebo Liu, Derek F. Wong, Dacheng Tao, Zhaopeng Tu

    Domain: Pre-training ; Efficiency → Model Compression → Knowledge Distillation

31. G-Transformer for Document-Level Machine Translation. paper

    Guangsheng Bao, Yue Zhang, Zhiyang Teng, Boxing Chen, Weihua Luo

    Domain: Document-level NMT

    Paper Reading&Interpretation1

32. Prevent the Language Model from being Overconfident in Neural Machine Translation. paper

    Mengqi Miao, Fandong Meng, Yijin Liu, Xiao-Hua Zhou, Jie Zhou

    Domain: Inference → Constrained Inference → Restricted NMT

    Paper Reading&Interpretation1 ; Paper Reading&Interpretation2

33. A Sweet Rabbit Hole by DARCY: Using Honeypots to Detect Universal Trigger’s Adversarial Attacks. paper

    Thai Le, Noseong Park, Dongwon Lee

    Domain: Training Strategy → Generative Adversarial Networks

34. Cross-language Sentence Selection via Data Augmentation and Rationale Training. paper

    Yanda Chen, Chris Kedzie, Suraj Nair, Petra Galuscakova, Rui Zhang, Douglas Oard, Kathleen McKeown

    Domain: Data-based Methods → Data Augmentation

    Paper Reading&Interpretation1

35. Point, Disambiguate and Copy: Incorporating Bilingual Dictionaries for Neural Machine Translation. paper

    Tong Zhang, Long Zhang, Wei Ye, Bo Li, Jinan Sun, Xiaoyu Zhu, Wen Zhao, Shikun Zhang

    Domain: Model Architecture

36. VECO: Variable and Flexible Cross-lingual Pre-training for Language Understanding and Generation. paper

    Fuli Luo, Wei Wang, Jiahao Liu, Yijia Liu, Bin Bi, Songfang Huang, Fei Huang, Luo Si

    Domain: Pre-training

    Paper Reading&Interpretation1

37. A unified approach to sentence segmentation of punctuated text in many languages. paper

    Rachel Wicks, Matt Post

    Domain: Data-based Methods → Word Segmentation

38. Towards User-Driven Neural Machine Translation. paper

    Huan Lin, Liang Yao, Baosong Yang, Dayiheng Liu, Haibo Zhang, Weihua Luo, Degen Huang, Jinsong Su

    Domain: Model Architecture

39. End-to-End Lexically Constrained Machine Translation for Morphologically Rich Languages. paper

    Josef Jon, João Paulo Aires, Dusan Varis, Ondřej Bojar

    Domain: Inference → Constrained Inference → Restricted NMT

40. Improving Speech Translation by Understanding and Learning from the Auxiliary Text Translation Task. paper

    Yun Tang, Juan Pino, Xian Li, Changhan Wang, Dmitriy Genzel

    Domain: Multimodal NMT → Speech → Cascaded Speech Translation

41. Reservoir Transformers. paper

    Sheng Shen, Alexei Baevski, Ari Morcos, Kurt Keutzer, Michael Auli, Douwe Kiela

    Domain: Model Architecture

42. SemFace: Pre-training Encoder and Decoder with a Semantic Interface for Neural Machine Translation. paper

    Shuo Ren, Long Zhou, Shujie Liu, Furu Wei, Ming Zhou, Shuai Ma

    Domain: Pre-training

    Paper Reading&Interpretation1

43. Energy-Based Reranking: Improving Neural Machine Translation Using Energy-Based Models. paper

    Sumanta Bhattacharyya, Amirmohammad Rooshenas, Subhajit Naskar, Simeng Sun, Mohit Iyyer, Andrew McCallum

    Domain: Reranking

44. On Compositional Generalization of Neural Machine Translation. paper

    Yafu Li, Yongjing Yin, Yulong Chen, Yue Zhang

    Domain: Robustness

    Paper Reading&Interpretation1 ; Paper Reading&Interpretation2

45. GWLAN: General Word-Level AutocompletioN for Computer-Aided Translation. paper

    Huayang Li, Lemao Liu, Guoping Huang, Shuming Shi

    Domain: Inference → Constrained Inference → Automatic Post-Editing

46. Rewriter-Evaluator Architecture for Neural Machine Translation. paper

    Yangming Li, Kaisheng Yao

    Domain: Model Architecture

47. Modeling Bilingual Conversational Characteristics for Neural Chat Translation. paper

    Yunlong Liang, Fandong Meng, Yufeng Chen, Jinan Xu, Jie Zhou

    Domain: Document-level NMT

48. Importance-based Neuron Allocation for Multilingual Neural Machine Translation. paper

    Wanying Xie, Yang Feng, Shuhao Gu, Dong Yu

    Domain: Multilingual NMT

    Paper Reading&Interpretation1

49. Transfer Learning for Sequence Generation: from Single-source to Multi-source. paper

    Xuancheng Huang, Jingfang Xu, Maosong Sun, Yang Liu

    Domain: Pre-training

50. Good for Misconceived Reasons: An Empirical Revisiting on the Need for Visual Context in Multimodal Machine Translation. paper

    Zhiyong Wu, Lingpeng Kong, Wei Bi, Xiang Li, Ben Kao

    Domain: Multimodal NMT → Image

51. Selective Knowledge Distillation for Neural Machine Translation. paper

    Fusheng Wang, Jianhao Yan, Fandong Meng, Jie Zhou

    Domain: Efficiency → Model Compression → Knowledge Distillation

    Paper Reading&Interpretation1

52. Measuring and Increasing Context Usage in Context-Aware Machine Translation. paper

    Patrick Fernandes, Kayo Yin, Graham Neubig, André F. T. Martins

    Domain: Document-level NMT

53. CCMatrix: Mining Billions of High-Quality Parallel Sentences on the Web. paper

    Holger Schwenk, Guillaume Wenzek, Sergey Edunov, Edouard Grave, Armand Joulin, Angela Fan

    Domain: Open-source Systems and Datasets

54. Determinantal Beam Search. paper

    Clara Meister, Martina Forster, Ryan Cotterell

    Domain: Inference → Beam Search

55. Mid-Air Hand Gestures for Post-Editing of Machine Translation. paper

    Rashad Albo Jamara, Nico Herbig, Antonio Krüger, Josef van Genabith

    Domain: Inference → Constrained Inference → Automatic Post-Editing

56. The statistical advantage of automatic NLG metrics at the system level. paper

    Johnny Wei, Robin Jia

    Domain: Interpretability

57. Beyond Noise: Mitigating the Impact of Fine-grained Semantic Divergences on Neural Machine Translation. paper

    Eleftheria Briakou, Marine Carpuat

    Domain: Robustness

58. Discriminative Reranking for Neural Machine Translation. paper

    Ann Lee, Michael Auli, Marc’Aurelio Ranzato

    Domain: Reranking

59. Scientific Credibility of Machine Translation Research: A Meta-Evaluation of 769 Papers. paper

    Benjamin Marie, Atsushi Fujita, Raphael Rubino

    Domain: Survey

60. Neural Machine Translation with Monolingual Translation Memory. paper

    Deng Cai, Yan Wang, Huayang Li, Wai Lam, Lemao Liu

    Domain: Prior Knowledge

    Paper Reading&Interpretation1 ; Paper Reading&Interpretation2 ; Paper Reading&Interpretation3 ; Paper Reading&Interpretation4

61. Vocabulary Learning via Optimal Transport for Neural Machine Translation. paper

    Jingjing Xu, Hao Zhou, Chun Gan, Zaixiang Zheng, Lei Li

    Domain: Data-based Methods → Word Segmentation

    Paper Reading&Interpretation1 ; Paper Reading&Interpretation2 ; Paper Reading&Interpretation3 ; Paper Reading&Interpretation4

62. Difficulty-Aware Machine Translation Evaluation. paper

    Runzhe Zhan, Xuebo Liu, Derek F. Wong, Lidia S. Chao

    Domain: Evaluation → Reference-based

63. Gender bias amplification during Speed-Quality optimization in Neural Machine Translation. paper

    Adithya Renduchintala, Denise Diaz, Kenneth Heafield, Xian Li, Mona Diab

    Domain: Diversity and Fairness

64. Machine Translation into Low-resource Language Varieties. paper

    Sachin Kumar, Antonios Anastasopoulos, Shuly Wintner, Yulia Tsvetkov

    Domain: Low-resource NMT → Endangered Language Study

65. Continual Quality Estimation with Online Bayesian Meta-Learning. paper

    Abiola Obamuyide, Marina Fomicheva, Lucia Specia

    Domain: Evaluation → Reference-free ; Training Strategy → Meta Learning

66. Anchor-based Bilingual Word Embeddings for Low-Resource Languages. paper

    Tobias Eder, Viktor Hangya, Alexander Fraser

    Domain: Low-resource NMT → Endangered Language Study

67. Multilingual Agreement for Multilingual Neural Machine Translation. paper

    Jian Yang, Yuwei Yin, Shuming Ma, Haoyang Huang, Dongdong Zhang, Zhoujun Li, Furu Wei

    Domain: Multilingual NMT

68. Modeling Task-Aware MIMO Cardinality for Efficient Multilingual Neural Machine Translation. paper

    Hongfei Xu, Qiuhui Liu, Josef van Genabith, Deyi Xiong

    Domain: Multilingual NMT

69. Adaptive Nearest Neighbor Machine Translation. paper

    Xin Zheng, Zhirui Zhang, Junliang Guo, Shujian Huang, Boxing Chen, Weihua Luo, Jiajun Chen

    Domain: Inference → Constrained Inference → Restricted NMT

70. On Orthogonality Constraints for Transformers. paper

    Aston Zhang, Alvin Chan, Yi Tay, Jie Fu, Shuohang Wang, Shuai Zhang, Huajie Shao, Shuochao Yao, Roy Ka-Wei Lee

    Domain: Training Strategy

71. An Exploratory Analysis of Multilingual Word-Level Quality Estimation with Cross-Lingual Transformers. paper

    Tharindu Ranasinghe, Constantin Orasan, Ruslan Mitkov

    Domain: Pre-training ; WMT → Quality Estimation

72. An Empirical Study on Adversarial Attack on NMT: Languages and Positions Matter. paper

    Zhiyuan Zeng, Deyi Xiong

    Domain: Robustness

73. Bilingual Mutual Information Based Adaptive Training for Neural Machine Translation. paper

    Yangyifan Xu, Yijin Liu, Fandong Meng, Jiajun Zhang, Jinan Xu, Jie Zhou

    Domain: Training Strategy

74. When is Char Better Than Subword: A Systematic Study of Segmentation Algorithms for Neural Machine Translation. paper

    Jiahuan Li, Yutong Shen, Shujian Huang, Xinyu Dai, Jiajun Chen

    Domain: Data-based Methods → Word Segmentation

75. nmT5 - Is parallel data still relevant for pre-training massively multilingual language models?. paper

    Mihir Kale, Aditya Siddhant, Rami Al-Rfou, Linting Xue, Noah Constant, Melvin Johnson

    Domain: Pre-training ; Multilingual NMT

76. Improving Lexically Constrained Neural Machine Translation with Source-Conditioned Masked Span Prediction. paper

    Gyubok Lee, Seongjun Yang, Edward Choi

    Domain: Training Strategy

77. Lightweight Adapter Tuning for Multilingual Speech Translation. paper

    Hang Le, Juan Pino, Changhan Wang, Jiatao Gu, Didier Schwab, Laurent Besacier

    Domain: Multimodal NMT → Speech → End-to-End Speech Translation ; Multilingual NMT

78. Don’t Rule Out Monolingual Speakers: A Method For Crowdsourcing Machine Translation Data. paper

    Rajat Bhatnagar, Ananya Ganesh, Katharina Kann

    Domain: Data-based Methods

List by Area

Statistical Machine Translation

Word-based Models

1. Exponentially Decaying Bag-of-Words Input Features for Feed-Forward Neural Network in Statistical Machine Translation. paper

   Jan-Thorsten Peter, Weiyue Wang, Hermann Ney

   Venue: ACL-2016

Distortion-based and Fertility-based models

Phrase-based Models

1. Target-Side Context for Discriminative Models in Statistical Machine Translation. paper

   Aleš Tamchyna, Alexander Fraser, Ondřej Bojar, Marcin Junczys-Dowmunt

   Venue: ACL-2016

2. Improving Statistical Machine Translation Performance by Oracle-BLEU Model Re-estimation. paper

   Praveen Dakwale, Christof Monz

   Venue: ACL-2016

Syntax-based Models

1. A Continuous Space Rule Selection Model for Syntax-based Statistical Machine Translation. paper

   Jingyi Zhang, Masao Utiyama, Eiichro Sumita, Graham Neubig, Satoshi Nakamura

   Venue: ACL-2016

2. A *CCG Parsing with a Supertag and Dependency Factored Model. paper

   Masashi Yoshikawa, Hiroshi Noji, Yuji Matsumoto

   Venue: ACL-2017

Evaluation

Reference-based

1. A New Psychometric-inspired Evaluation Metric for Chinese Word Segmentation. paper

   Peng Qian, Xipeng Qiu, Xuanjing Huang

   Venue: ACL-2016

2. Reference Bias in Monolingual Machine Translation Evaluation. paper

   Marina Fomicheva, Lucia Specia

   Venue: ACL-2016

3. Metrics for Evaluation of Word-level Machine Translation Quality Estimation. paper

   Varvara Logacheva, Michal Lukasik, Lucia Specia

   Venue: ACL-2016

4. Beyond BLEU:Training Neural Machine Translation with Semantic Similarity. paper

   John Wieting, Taylor Berg-Kirkpatrick, Kevin Gimpel, Graham Neubig

   Venue: ACL-2019

5. Evaluating Gender Bias in Machine Translation. paper

   Gabriel Stanovsky, Noah A. Smith, Luke Zettlemoyer

   Venue: ACL-2019

6. Multi-Hypothesis Machine Translation Evaluation. paper

   Marina Fomicheva, Lucia Specia, Francisco Guzmán

   Venue: ACL-2020

7. On The Evaluation of Machine Translation Systems Trained With Back-Translation. paper

   Sergey Edunov, Myle Ott, Marc’Aurelio Ranzato, Michael Auli

   Venue: ACL-2020

8. Tangled up in BLEU: Reevaluating the Evaluation of Automatic Machine Translation Evaluation Metrics. paper

   Nitika Mathur, Timothy Baldwin, Trevor Cohn

   Venue: ACL-2020

9. Evaluating Robustness to Input Perturbations for Neural Machine Translation. paper

   Xing Niu, Prashant Mathur, Georgiana Dinu, Yaser Al-Onaizan

   Venue: ACL-2020

   Paper Reading&Interpretation1 ; Paper Reading&Interpretation2

10. It’s Easier to Translate out of English than into it: Measuring Neural Translation Difficulty by Cross-Mutual Information. paper

    Emanuele Bugliarello, Sabrina J. Mielke, Antonios Anastasopoulos, Ryan Cotterell, Naoaki Okazaki

    Venue: ACL-2020

11. Automatic Machine Translation Evaluation using Source Language Inputs and Cross-lingual Language Model. paper

    Kosuke Takahashi, Katsuhito Sudoh, Satoshi Nakamura

    Venue: ACL-2020

12. Online Learning Meets Machine Translation Evaluation: Finding the Best Systems with the Least Human Effort. paper

    Vânia Mendonça, Ricardo Rei, Luisa Coheur, Alberto Sardinha, Ana Lúcia Santos

    Venue: ACL-2021

    Paper Reading&Interpretation1；

13. Difficulty-Aware Machine Translation Evaluation. paper

    Runzhe Zhan, Xuebo Liu, Derek F. Wong, Lidia S. Chao

    Venue: ACL-2021

Reference-free

1. MUTT: Metric Unit TesTing for Language Generation Tasks. paper

   William Boag, Renan Campos, Kate Saenko, Anna Rumshisky

   Venue: ACL-2016

2. Putting Evaluation in Context: Contextual Embeddings improve Machine Translation Evaluation. paper

   Nitika Mathur, Timothy Baldwin, Trevor Cohn

   Venue: ACL-2019

3. On the Limitations of Cross-lingual Encoders as Exposed by Reference-Free Machine Translation Evaluation. paper

   Wei Zhao, Goran Glavaš, Maxime Peyrard, Yang Gao, Robert West, Steffen Eger

   Venue: ACL-2020

4. Continual Quality Estimation with Online Bayesian Meta-Learning. paper

   Abiola Obamuyide, Marina Fomicheva, Lucia Specia

   Venue: ACL-2021

Efficiency

Model Compression

Pruning

Knowledge Distillation

1. Knowledge Distillation for Multilingual Unsupervised Neural Machine Translation. paper

   Haipeng Sun, Rui Wang, Kehai Chen, Masao Utiyama, Eiichiro Sumita, Tiejun Zhao

   Venue: ACL-2020

2. Weight Distillation: Transferring the Knowledge in Neural Network Parameters. paper

   Ye Lin, Yanyang Li, Ziyang Wang, Bei Li, Quan Du, Tong Xiao, Jingbo Zhu

   Venue: ACL-2021

   Paper Reading&Interpretation1；

3. Guiding Teacher Forcing with Seer Forcing for Neural Machine Translation. paper

   Yang Feng, Shuhao Gu, Dengji Guo, Zhengxin Yang, Chenze Shao

   Venue: ACL-2021

4. Marginal Utility Diminishes: Exploring the Minimum Knowledge for BERT Knowledge Distillation. paper

   Yuanxin Liu, Fandong Meng, Zheng Lin, Weiping Wang, Jie Zhou

   Venue: ACL-2021

   Paper Reading&Interpretation1；

5. Meta-KD: A Meta Knowledge Distillation Framework for Language Model Compression across Domains. paper

   Haojie Pan, Chengyu Wang, Minghui Qiu, Yichang Zhang, Yaliang Li, Jun Huang

   Venue: ACL-2021

   Paper Reading&Interpretation1；

6. Rejuvenating Low-Frequency Words: Making the Most of Parallel Data in Non-Autoregressive Translation. paper

   Liang Ding, Longyue Wang, Xuebo Liu, Derek F. Wong, Dacheng Tao, Zhaopeng Tu

   Venue: ACL-2021

7. Selective Knowledge Distillation for Neural Machine Translation. paper

   Fusheng Wang, Jianhao Yan, Fandong Meng, Jie Zhou

   Venue: ACL-2021

   Paper Reading&Interpretation1；

Quantization

Low-rank Factorization

Weight Sharing

1. Shared-Private Bilingual Word Embeddings for Neural Machine Translation. paper

   Xuebo Liu, Derek F. Wong, Yang Liu, Lidia S. Chao, Tong Xiao, Jingbo Zhu

   Venue: ACL-2019

Compution Optimization

1. N-gram language models for massively parallel devices. paper

   Nikolay Bogoychev, Adam Lopez

   Venue: ACL-2016

   Paper Reading&Interpretation1；

2. Strategies for Training Large Vocabulary Neural Language Models. paper

   Wenlin Chen, David Grangier, Michael Auli

   Venue: ACL-2016

3. Vocabulary Manipulation for Neural Machine Translation. paper

   Haitao Mi, Zhiguo Wang, Abe Ittycheriah

   Venue: ACL-2016

4. Neural Machine Translation via Binary Code Prediction. paper

   Yusuke Oda, Philip Arthur, Graham Neubig, Koichiro Yoshino, Satoshi Nakamura

   Venue: ACL-2017

5. An Algebra for Feature Extraction. paper

   Vivek Srikumar

   Venue: ACL-2017

6. Speeding Up Neural Machine Translation Decoding by Shrinking Run-time Vocabulary. paper

   Xing Shi, Kevin Knight

   Venue: ACL-2017

7. Accelerating Neural Transformer via an Average Attention Network. paper

   Biao Zhang, Deyi Xiong, Jinsong Su

   Venue: ACL-2018

   Paper Reading&Interpretation1 ; Paper Reading&Interpretation2

8. Sparse Sequence-to-Sequence Models. paper

   Ben Peters, Vlad Niculae, André F. T. Martins

   Venue: ACL-2019

9. Multi-Head Highly Parallelized LSTM Decoder for Neural Machine Translation. paper

   Hongfei Xu, Qiuhui Liu, Josef van Genabith, Deyi Xiong, Meng Zhang

   Venue: ACL-2021

Energy Cost

Conditional Computation

Open-source Systems and Datasets

1. An Open Web Platform for Rule-Based Speech-to-Sign Translation. paper

   Manny Rayner, Pierrette Bouillon, Sarah Ebling, Johanna Gerlach, Irene Strasly, Nikos Tsourakis

   Venue: ACL-2016

2. An Unsupervised Method for Automatic Translation Memory Cleaning. paper

   Masoud Jalili Sabet, Matteo Negri, Marco Turchi, Eduard Barbu

   Venue: ACL-2016

3. CCMatrix: Mining Billions of High-Quality Parallel Sentences on the Web. paper

   Holger Schwenk, Guillaume Wenzek, Sergey Edunov, Edouard Grave, Armand Joulin, Angela Fan

   Venue: ACL-2021

Training Strategy

1. Strategies for Training Large Vocabulary Neural Language Models. paper

   Wenlin Chen, David Grangier, Michael Auli

   Venue: ACL-2016

2. Depth Growing for Neural Machine Translation. paper

   Lijun Wu, Yiren Wang, Yingce Xia, Fei Tian, Fei Gao, Tao Qin, Jianhuang Lai, Tie-Yan Liu

   Venue: ACL-2019

3. Effective Adversarial Regularization for Neural Machine Translation. paper

   Motoki Sato, Jun Suzuki, Shun Kiyono

   Venue: ACL-2019

   Paper Reading&Interpretation1；

4. On Exposure Bias, Hallucination and Domain Shift in Neural Machine Translation. paper

   Chaojun Wang, Rico Sennrich

   Venue: ACL-2020

5. On Orthogonality Constraints for Transformers. paper

   Aston Zhang, Alvin Chan, Yi Tay, Jie Fu, Shuohang Wang, Shuai Zhang, Huajie Shao, Shuochao Yao, Roy Ka-Wei Lee

   Venue: ACL-2021

6. Bilingual Mutual Information Based Adaptive Training for Neural Machine Translation. paper

   Yangyifan Xu, Yijin Liu, Fandong Meng, Jiajun Zhang, Jinan Xu, Jie Zhou

   Venue: ACL-2021

7. Improving Lexically Constrained Neural Machine Translation with Source-Conditioned Masked Span Prediction. paper

   Gyubok Lee, Seongjun Yang, Edward Choi

   Venue: ACL-2021

Contrastive Learning

1. Reducing Word Omission Errors in Neural Machine Translation: A Contrastive Learning Approach. paper

   Zonghan Yang, Yong Cheng, Yang Liu, Maosong Sun

   Venue: ACL-2019

   Paper Reading&Interpretation1 ; Paper Reading&Interpretation2

2. Simultaneous Translation with Flexible Policy via Restricted Imitation Learning. paper

   Baigong Zheng, Renjie Zheng, Mingbo Ma, Liang Huang

   Venue: ACL-2019

   Paper Reading&Interpretation1；

3. Contrastive Learning for Many-to-many Multilingual Neural Machine Translation. paper

   Xiao Pan, Mingxuan Wang, Liwei Wu, Lei Li

   Venue: ACL-2021

   Paper Reading&Interpretation1；

Reinforcement Learning

1. Learning Structured Predictors from Bandit Feedback for Interactive NLP. paper

   Artem Sokolov, Julia Kreutzer, Christopher Lo, Stefan Riezler

   Venue: ACL-2016

2. Minimum Risk Training for Neural Machine Translation. paper

   Shiqi Shen, Yong Cheng, Zhongjun He, Wei He, Hua Wu, Maosong Sun, Yang Liu

   Venue: ACL-2016

Meta Learning

1. Meta-Learning to Compositionally Generalize. paper

   Henry Conklin, Bailin Wang, Kenny Smith, Ivan Titov

   Venue: ACL-2021

2. Continual Quality Estimation with Online Bayesian Meta-Learning. paper

   Abiola Obamuyide, Marina Fomicheva, Lucia Specia

   Venue: ACL-2021

Dual Learning

Generative Adversarial Networks

1. Adversarial Adaptation of Synthetic or Stale Data. paper

   Young-Bum Kim, Karl Stratos, Dongchan Kim

   Venue: ACL-2017

2. A Sweet Rabbit Hole by DARCY: Using Honeypots to Detect Universal Trigger’s Adversarial Attacks. paper

   Thai Le, Noseong Park, Dongwon Lee

   Venue: ACL-2021

Inference

1. Enhanced LSTM for Natural Language Inference. paper

   Qian Chen, Xiaodan Zhu, Zhen-Hua Ling, Si Wei, Hui Jiang, Diana Inkpen

   Venue: ACL-2017

   Paper Reading&Interpretation1 ; Paper Reading&Interpretation2 ; Paper Reading&Interpretation3 ; Paper Reading&Interpretation4 ; Paper Reading&Interpretation5

2. Chunk-based Decoder for Neural Machine Translation. paper

   Shonosuke Ishiwatari, Jingtao Yao, Shujie Liu, Mu Li, Ming Zhou, Naoki Yoshinaga, Masaru Kitsuregawa, Weijia Jia

   Venue: ACL-2017

Non-autoregressive

1. Imitation Learning for Non-Autoregressive Neural Machine Translation. paper

   Bingzhen Wei, Mingxuan Wang, Hao Zhou, Junyang Lin, Xu Sun

   Venue: ACL-2019

   Paper Reading&Interpretation1；

2. Retrieving Sequential Information for Non-Autoregressive Neural Machine Translation. paper

   Chenze Shao, Yang Feng, Jinchao Zhang, Fandong Meng, Xilin Chen, Jie Zhou

   Venue: ACL-2019

   Paper Reading&Interpretation1；

3. Jointly Masked Sequence-to-Sequence Model for Non-Autoregressive Neural Machine Translation. paper

   Junliang Guo, Linli Xu, Enhong Chen

   Venue: ACL-2020

   Paper Reading&Interpretation1；

4. Learning to Recover from Multi-Modality Errors for Non-Autoregressive Neural Machine Translation. paper

   Qiu Ran, Yankai Lin, Peng Li, Jie Zhou

   Venue: ACL-2020

   Paper Reading&Interpretation1 ; Paper Reading&Interpretation2

5. ENGINE: Energy-Based Inference Networks for Non-Autoregressive Machine Translation. paper

   Lifu Tu, Richard Yuanzhe Pang, Sam Wiseman, Kevin Gimpel

   Venue: ACL-2020

6. Glancing Transformer for Non-Autoregressive Neural Machine Translation. paper

   Lihua Qian, Hao Zhou, Yu Bao, Mingxuan Wang, Lin Qiu, Weinan Zhang, Yong Yu, Lei Li

   Venue: ACL-2021

   Paper Reading&Interpretation1 ; Paper Reading&Interpretation2

Constrained Inference

Interactive NMT

1. Models and Inference for Prefix-Constrained Machine Translation. paper

   Joern Wuebker, Spence Green, John DeNero, Saša Hasan, Minh-Thang Luong

   Venue: ACL-2016

2. Lexically Constrained Decoding for Sequence Generation Using Grid Beam Search. paper

   Chris Hokamp, Qun Liu

   Venue: ACL-2017

   Paper Reading&Interpretation1 ; Paper Reading&Interpretation2

Automatic Post-Editing

1. Lexically Constrained Neural Machine Translation with Levenshtein Transformer. paper

   Raymond Hendy Susanto, Shamil Chollampatt, Liling Tan

   Venue: ACL-2020

2. GWLAN: General Word-Level AutocompletioN for Computer-Aided Translation. paper

   Huayang Li, Lemao Liu, Guoping Huang, Shuming Shi

   Venue: ACL-2021

3. Mid-Air Hand Gestures for Post-Editing of Machine Translation. paper

   Rashad Albo Jamara, Nico Herbig, Antonio Krüger, Josef van Genabith

   Venue: ACL-2021

Restricted NMT

1. Synthesizing Compound Words for Machine Translation. paper

   Austin Matthews, Eva Schlinger, Alon Lavie, Chris Dyer

   Venue: ACL-2016

2. Syntactically Supervised Transformers for Faster Neural Machine Translation. paper

   Nader Akoury, Kalpesh Krishna, Mohit Iyyer

   Venue: ACL-2019

3. Lexically Constrained Neural Machine Translation with Levenshtein Transformer. paper

   Raymond Hendy Susanto, Shamil Chollampatt, Liling Tan

   Venue: ACL-2020

4. Prevent the Language Model from being Overconfident in Neural Machine Translation. paper

   Mengqi Miao, Fandong Meng, Yijin Liu, Xiao-Hua Zhou, Jie Zhou

   Venue: ACL-2021

   Paper Reading&Interpretation1 ; Paper Reading&Interpretation2

5. End-to-End Lexically Constrained Machine Translation for Morphologically Rich Languages. paper

   Josef Jon, João Paulo Aires, Dusan Varis, Ondřej Bojar

   Venue: ACL-2021

6. Adaptive Nearest Neighbor Machine Translation. paper

   Xin Zheng, Zhirui Zhang, Junliang Guo, Shujian Huang, Boxing Chen, Weihua Luo, Jiajun Chen

   Venue: ACL-2021

Beam Search

1. Determinantal Beam Search. paper

   Clara Meister, Martina Forster, Ryan Cotterell

   Venue: ACL-2021

Interpretability

1. Grammatical Error Correction: Machine Translation and Classifiers. paper

   Alla Rozovskaya, Dan Roth

   Venue: ACL-2016

2. What do Neural Machine Translation Models Learn about Morphology?. paper

   Yonatan Belinkov, Nadir Durrani, Fahim Dalvi, Hassan Sajjad, James Glass

   Venue: ACL-2017

3. Visualizing and Understanding Neural Machine Translation. paper

   Yanzhuo Ding, Yang Liu, Huanbo Luan, Maosong Sun

   Venue: ACL-2017

   Paper Reading&Interpretation1；

4. In Neural Machine Translation, What Does Transfer Learning Transfer?. paper

   Alham Fikri Aji, Nikolay Bogoychev, Kenneth Heafield, Rico Sennrich

   Venue: ACL-2020

5. Evaluating Explanation Methods for Neural Machine Translation. paper

   Jierui Li, Lemao Liu, Huayang Li, Guanlin Li, Guoping Huang, Shuming Shi

   Venue: ACL-2020

6. Does Multi-Encoder Help? A Case Study on Context-Aware Neural Machine Translation. paper

   Bei Li, Hui Liu, Ziyang Wang, Yufan Jiang, Tong Xiao, Jingbo Zhu, Tongran Liu, Changliang Li

   Venue: ACL-2020

   Paper Reading&Interpretation1 ; Paper Reading&Interpretation2

7. Understanding the Properties of Minimum Bayes Risk Decoding in Neural Machine Translation. paper

   Mathias Müller, Rico Sennrich

   Venue: ACL-2021

8. Do Context-Aware Translation Models Pay the Right Attention?. paper

   Kayo Yin, Patrick Fernandes, Danish Pruthi, Aditi Chaudhary, André F. T. Martins, Graham Neubig

   Venue: ACL-2021

9. The statistical advantage of automatic NLG metrics at the system level. paper

   Johnny Wei, Robin Jia

   Venue: ACL-2021

Ensemble

1. A Nested Attention Neural Hybrid Model for Grammatical Error Correction. paper

   Jianshu Ji, Qinlong Wang, Kristina Toutanova, Yongen Gong, Steven Truong, Jianfeng Gao

   Venue: ACL-2017

2. Neural System Combination for Machine Translation. paper

   Long Zhou, Wenpeng Hu, Jiajun Zhang, Chengqing Zong

   Venue: ACL-2017

Reranking

1. Energy-Based Reranking: Improving Neural Machine Translation Using Energy-Based Models. paper

   Sumanta Bhattacharyya, Amirmohammad Rooshenas, Subhajit Naskar, Simeng Sun, Mohit Iyyer, Andrew McCallum

   Venue: ACL-2021

2. Discriminative Reranking for Neural Machine Translation. paper

   Ann Lee, Michael Auli, Marc’Aurelio Ranzato

   Venue: ACL-2021

Model Architecture

1. Pointing the Unknown Words. paper

   Caglar Gulcehre, Sungjin Ahn, Ramesh Nallapati, Bowen Zhou, Yoshua Bengio

   Venue: ACL-2016

   Paper Reading&Interpretation1 ; Paper Reading&Interpretation2 ; Paper Reading&Interpretation3

2. Tree-to-Sequence Attentional Neural Machine Translation. paper

   Akiko Eriguchi, Kazuma Hashimoto, Yoshimasa Tsuruoka

   Venue: ACL-2016

3. Achieving Open Vocabulary Neural Machine Translation with Hybrid Word-Character Models. paper

   Minh-Thang Luong, Christopher D. Manning

   Venue: ACL-2016

   Paper Reading&Interpretation1；

4. A Character-level Decoder without Explicit Segmentation for Neural Machine Translation. paper

   Junyoung Chung, Kyunghyun Cho, Yoshua Bengio

   Venue: ACL-2016

5. Supersense Embeddings: A Unified Model for Supersense Interpretation, Prediction, and Utilization. paper

   Lucie Flekova, Iryna Gurevych

   Venue: ACL-2016

6. Knowledge-Based Semantic Embedding for Machine Translation. paper

   Chen Shi, Shujie Liu, Shuo Ren, Shi Feng, Mu Li, Ming Zhou, Xu Sun, Houfeng Wang

   Venue: ACL-2016

7. Graph-based Dependency Parsing with Bidirectional LSTM. paper

   Wenhui Wang, Baobao Chang

   Venue: ACL-2016

8. Character-based Neural Machine Translation. paper

   Marta R. Costa-jussà, José A. R. Fonollosa

   Venue: ACL-2016

9. A Convolutional Encoder Model for Neural Machine Translation. paper

   Jonas Gehring, Michael Auli, David Grangier, Yann Dauphin

   Venue: ACL-2017

   Paper Reading&Interpretation1 ; Paper Reading&Interpretation2

10. Deep Neural Machine Translation with Linear Associative Unit. paper

    Mingxuan Wang, Zhengdong Lu, Jie Zhou, Qun Liu

    Venue: ACL-2017

11. Improved Neural Machine Translation with a Syntax-Aware Encoder and Decoder. paper

    Huadong Chen, Shujian Huang, David Chiang, Jiajun Chen

    Venue: ACL-2017

12. Learning to Parse and Translate Improves Neural Machine Translation. paper

    Akiko Eriguchi, Yoshimasa Tsuruoka, Kyunghyun Cho

    Venue: ACL-2017

13. Hybrid Neural Network Alignment and Lexicon Model in Direct HMM for Statistical Machine Translation. paper

    Weiyue Wang, Tamer Alkhouli, Derui Zhu, Hermann Ney

    Venue: ACL-2017

14. Towards String-To-Tree Neural Machine Translation. paper

    Roee Aharoni, Yoav Goldberg

    Venue: ACL-2017

15. Chunk-Based Bi-Scale Decoder for Neural Machine Translation. paper

    Hao Zhou, Zhaopeng Tu, Shujian Huang, Xiaohua Liu, Hang Li, Jiajun Chen

    Venue: ACL-2017

16. The Best of Both Worlds: Combining Recent Advances in Neural Machine Translation. paper

    Mia Xu Chen, Orhan Firat, Ankur Bapna, Melvin Johnson, Wolfgang Macherey, George Foster, Llion Jones, Mike Schuster, Noam Shazeer, Niki Parmar, Ashish Vaswani, Jakob Uszkoreit, Lukasz Kaiser, Zhifeng Chen, Yonghui Wu, Macduff Hughes

    Venue: ACL-2018

    Paper Reading&Interpretation1；

17. Neural Hidden Markov Model for Machine Translation. paper

    Weiyue Wang, Derui Zhu, Tamer Alkhouli, Zixuan Gan, Hermann Ney

    Venue: ACL-2018

18. A Stochastic Decoder for Neural Machine Translation. paper

    Philip Schulz, Wilker Aziz, Trevor Cohn

    Venue: ACL-2018

19. Forest-Based Neural Machine Translation. paper

    Chunpeng Ma, Akihiro Tamura, Masao Utiyama, Tiejun Zhao, Eiichiro Sumita

    Venue: ACL-2018

    Paper Reading&Interpretation1；

20. Learning Deep Transformer Models for Machine Translation. paper

    Qiang Wang, Bei Li, Tong Xiao, Jingbo Zhu, Changliang Li, Derek F. Wong, Lidia S. Chao

    Venue: ACL-2019

    Paper Reading&Interpretation1；

21. Bridging the Gap between Training and Inference for Neural Machine Translation. paper

    Wen Zhang, Yang Feng, Fandong Meng, Di You, Qun Liu

    Venue: ACL-2019

    Paper Reading&Interpretation1 ; Paper Reading&Interpretation2 ; Paper Reading&Interpretation3 ; Paper Reading&Interpretation4 ; Paper Reading&Interpretation5 ; Paper Reading&Interpretation6

22. Exploiting Sentential Context for Neural Machine Translation. paper

    Xing Wang, Zhaopeng Tu, Longyue Wang, Shuming Shi

    Venue: ACL-2019

    Paper Reading&Interpretation1；

23. Depth Growing for Neural Machine Translation. paper

    Lijun Wu, Yiren Wang, Yingce Xia, Fei Tian, Fei Gao, Tao Qin, Jianhuang Lai, Tie-Yan Liu

    Venue: ACL-2019

24. Sentence-Level Agreement for Neural Machine Translation. paper

    Mingming Yang, Rui Wang, Kehai Chen, Masao Utiyama, Eiichiro Sumita, Min Zhang, Tiejun Zhao

    Venue: ACL-2019

25. Addressing Posterior Collapse with Mutual Information for Improved Variational Neural Machine Translation. paper

    Arya D. McCarthy, Xian Li, Jiatao Gu, Ning Dong

    Venue: ACL-2020

26. Multiscale Collaborative Deep Models for Neural Machine Translation. paper

    Xiangpeng Wei, Heng Yu, Yue Hu, Yue Zhang, Rongxiang Weng, Weihua Luo

    Venue: ACL-2020

27. Improving Neural Machine Translation with Soft Template Prediction. paper

    Jian Yang, Shuming Ma, Dongdong Zhang, Zhoujun Li, Ming Zhou

    Venue: ACL-2020

28. Learning Source Phrase Representations for Neural Machine Translation. paper

    Hongfei Xu, Josef van Genabith, Deyi Xiong, Qiuhui Liu, Jingyi Zhang

    Venue: ACL-2020

29. Regularized Context Gates on Transformer for Machine Translation. paper

    Xintong Li, Lemao Liu, Rui Wang, Guoping Huang, Max Meng

    Venue: ACL-2020

30. Character-Level Translation with Self-attention. paper

    Yingqiang Gao, Nikola I. Nikolov, Yuhuang Hu, Richard H.R. Hahnloser

    Venue: ACL-2020

31. Variational Neural Machine Translation with Normalizing Flows. paper

    Hendra Setiawan, Matthias Sperber, Udhyakumar Nallasamy, Matthias Paulik

    Venue: ACL-2020

    Paper Reading&Interpretation1；

32. A Simple and Effective Unified Encoder for Document-Level Machine Translation. paper

    Shuming Ma, Dongdong Zhang, Ming Zhou

    Venue: ACL-2020

    Paper Reading&Interpretation1；

33. Guiding Teacher Forcing with Seer Forcing for Neural Machine Translation. paper

    Yang Feng, Shuhao Gu, Dengji Guo, Zhengxin Yang, Chenze Shao

    Venue: ACL-2021

34. Fast and Accurate Neural Machine Translation with Translation Memory. paper

    Qiuxiang He, Guoping Huang, Qu Cui, Li Li, Lemao Liu

    Venue: ACL-2021

35. Point, Disambiguate and Copy: Incorporating Bilingual Dictionaries for Neural Machine Translation. paper

    Tong Zhang, Long Zhang, Wei Ye, Bo Li, Jinan Sun, Xiaoyu Zhu, Wen Zhao, Shikun Zhang

    Venue: ACL-2021

36. Towards User-Driven Neural Machine Translation. paper

    Huan Lin, Liang Yao, Baosong Yang, Dayiheng Liu, Haibo Zhang, Weihua Luo, Degen Huang, Jinsong Su

    Venue: ACL-2021

37. Reservoir Transformers. paper

    Sheng Shen, Alexei Baevski, Ari Morcos, Kurt Keutzer, Michael Auli, Douwe Kiela

    Venue: ACL-2021

38. Rewriter-Evaluator Architecture for Neural Machine Translation. paper

    Yangming Li, Kaisheng Yao

    Venue: ACL-2021

Prior Knowledge

1. Tree-to-Sequence Attentional Neural Machine Translation. paper

   Akiko Eriguchi, Kazuma Hashimoto, Yoshimasa Tsuruoka

   Venue: ACL-2016

2. Syntactically Guided Neural Machine Translation. paper

   Felix Stahlberg, Eva Hasler, Aurelien Waite, Bill Byrne

   Venue: ACL-2016

3. Modeling Source Syntax for Neural Machine Translation. paper

   Junhui Li, Deyi Xiong, Zhaopeng Tu, Muhua Zhu, Min Zhang, Guodong Zhou

   Venue: ACL-2017

4. Sequence-to-Dependency Neural Machine Translation. paper

   Shuangzhi Wu, Dongdong Zhang, Nan Yang, Mu Li, Ming Zhou

   Venue: ACL-2017

   Paper Reading&Interpretation1；

5. Automatic Annotation and Evaluation of Error Types for Grammatical Error Correction. paper

   Christopher Bryant, Mariano Felice, Ted Briscoe

   Venue: ACL-2017

6. Robust Incremental Neural Semantic Graph Parsing. paper

   Jan Buys, Phil Blunsom

   Venue: ACL-2017

7. Prior Knowledge Integration for Neural Machine Translation using Posterior Regularization. paper

   Jiacheng Zhang, Yang Liu, Huanbo Luan, Jingfang Xu, Maosong Sun

   Venue: ACL-2017

   Paper Reading&Interpretation1 ; Paper Reading&Interpretation2

8. Neural Machine Translation with Reordering Embeddings. paper

   Kehai Chen, Rui Wang, Masao Utiyama, Eiichiro Sumita

   Venue: ACL-2019

9. On the Word Alignment from Neural Machine Translation. paper

   Xintong Li, Guanlin Li, Lemao Liu, Max Meng, Shuming Shi

   Venue: ACL-2019

10. Reference Network for Neural Machine Translation. paper

    Han Fu, Chenghao Liu, Jianling Sun

    Venue: ACL-2019

11. Training Neural Machine Translation To Apply Terminology Constraints. paper

    Georgiana Dinu, Prashant Mathur, Marcello Federico, Yaser Al-Onaizan

    Venue: ACL-2019

    Paper Reading&Interpretation1；

12. Better OOV Translation with Bilingual Terminology Mining. paper

    Matthias Huck, Viktor Hangya, Alexander Fraser

    Venue: ACL-2019

13. Lattice-Based Transformer Encoder for Neural Machine Translation. paper

    Fengshun Xiao, Jiangtong Li, Hai Zhao, Rui Wang, Kehai Chen

    Venue: ACL-2019

14. Improving Neural Machine Translation with Soft Template Prediction. paper

    Jian Yang, Shuming Ma, Dongdong Zhang, Zhoujun Li, Ming Zhou

    Venue: ACL-2020

15. Translationese as a Language in “Multilingual” NMT. paper

    Parker Riley, Isaac Caswell, Markus Freitag, David Grangier

    Venue: ACL-2020

16. Enhancing Machine Translation with Dependency-Aware Self-Attention. paper

    Emanuele Bugliarello, Naoaki Okazaki

    Venue: ACL-2020

17. Content Word Aware Neural Machine Translation. paper

    Kehai Chen, Rui Wang, Masao Utiyama, Eiichiro Sumita

    Venue: ACL-2020

18. Neural Machine Translation with Monolingual Translation Memory. paper

    Deng Cai, Yan Wang, Huayang Li, Wai Lam, Lemao Liu

    Venue: ACL-2021

    Paper Reading&Interpretation1 ; Paper Reading&Interpretation2 ; Paper Reading&Interpretation3 ; Paper Reading&Interpretation4

Attention Mechanism

1. Modeling Coverage for Neural Machine Translation. paper

   Zhaopeng Tu, Zhengdong Lu, Yang Liu, Xiaohua Liu, Hang Li

   Venue: ACL-2016

   Paper Reading&Interpretation1 ; Paper Reading&Interpretation2 ; Paper Reading&Interpretation3 ; Paper Reading&Interpretation4

2. Incorporating Word Reordering Knowledge into Attention-based Neural Machine Translation. paper

   Jinchao Zhang, Mingxuan Wang, Qun Liu, Jie Zhou

   Venue: ACL-2017

3. Attention Strategies for Multi-Source Sequence-to-Sequence Learning. paper

   Jindřich Libovický, Jindřich Helcl

   Venue: ACL-2017

4. Attention Focusing for Neural Machine Translation by Bridging Source and Target Embeddings. paper

   Shaohui Kuang, Junhui Li, Antonio Branco, Weihua Luo, Deyi Xiong

   Venue: ACL-2018

   Paper Reading&Interpretation1；

5. Accelerating Neural Transformer via an Average Attention Network. paper

   Biao Zhang, Deyi Xiong, Jinsong Su

   Venue: ACL-2018

   Paper Reading&Interpretation1 ; Paper Reading&Interpretation2

6. Look Harder: A Neural Machine Translation Model with Hard Attention. paper

   Sathish Reddy Indurthi, Insoo Chung, Sangha Kim

   Venue: ACL-2019

7. Lattice-Based Transformer Encoder for Neural Machine Translation. paper

   Fengshun Xiao, Jiangtong Li, Hai Zhao, Rui Wang, Kehai Chen

   Venue: ACL-2019

8. Hard-Coded Gaussian Attention for Neural Machine Translation. paper

   Weiqiu You, Simeng Sun, Mohit Iyyer

   Venue: ACL-2020

9. Learning Source Phrase Representations for Neural Machine Translation. paper

   Hongfei Xu, Josef van Genabith, Deyi Xiong, Qiuhui Liu, Jingyi Zhang

   Venue: ACL-2020

10. Cascaded Head-colliding Attention. paper

    Lin Zheng, Zhiyong Wu, Lingpeng Kong

    Venue: ACL-2021

    Paper Reading&Interpretation1；

11. Do Context-Aware Translation Models Pay the Right Attention?. paper

    Kayo Yin, Patrick Fernandes, Danish Pruthi, Aditi Chaudhary, André F. T. Martins, Graham Neubig

    Venue: ACL-2021

Domain Adaptation

1. Can Syntax Help? Improving an LSTM-based Sentence Compression Model for New Domains. paper

   Liangguo Wang, Jing Jiang, Hai Leong Chieu, Chen Hui Ong, Dandan Song, Lejian Liao

   Venue: ACL-2017

   Paper Reading&Interpretation1；

2. Bandit Structured Prediction for Neural Sequence-to-Sequence Learning. paper

   Julia Kreutzer, Artem Sokolov, Stefan Riezler

   Venue: ACL-2017

3. An Empirical Comparison of Domain Adaptation Methods for Neural Machine Translation. paper

   Chenhui Chu, Raj Dabre, Sadao Kurohashi

   Venue: ACL-2017

4. Sentence Embedding for Neural Machine Translation Domain Adaptation. paper

   Rui Wang, Andrew Finch, Masao Utiyama, Eiichiro Sumita

   Venue: ACL-2017

5. Domain Adaptation of Neural Machine Translation by Lexicon Induction. paper

   Junjie Hu, Mengzhou Xia, Graham Neubig, Jaime Carbonell

   Venue: ACL-2019

6. Domain Adaptive Inference for Neural Machine Translation. paper

   Danielle Saunders, Felix Stahlberg, Adrià de Gispert, Bill Byrne

   Venue: ACL-2019

7. Learning a Multi-Domain Curriculum for Neural Machine Translation. paper

   Wei Wang, Ye Tian, Jiquan Ngiam, Yinfei Yang, Isaac Caswell, Zarana Parekh

   Venue: ACL-2020

8. Multi-Domain Neural Machine Translation with Word-Level Adaptive Layer-wise Domain Mixing. paper

   Haoming Jiang, Chen Liang, Chong Wang, Tuo Zhao

   Venue: ACL-2020

9. Reducing Gender Bias in Neural Machine Translation as a Domain Adaptation Problem. paper

   Danielle Saunders, Bill Byrne

   Venue: ACL-2020

10. Unsupervised Neural Machine Translation for Low-Resource Domains via Meta-Learning. paper

    Cheonbok Park, Yunwon Tae, TaeHee Kim, Soyoung Yang, Mohammad Azam Khan, Lucy Park, Jaegul Choo

    Venue: ACL-2021

    Paper Reading&Interpretation1；

11. Meta-KD: A Meta Knowledge Distillation Framework for Language Model Compression across Domains. paper

    Haojie Pan, Chengyu Wang, Minghui Qiu, Yichang Zhang, Yaliang Li, Jun Huang

    Venue: ACL-2021

    Paper Reading&Interpretation1；

12. Taming Pre-trained Language Models with N-gram Representations for Low-Resource Domain Adaptation. paper

    Shizhe Diao, Ruijia Xu, Hongjin Su, Yilei Jiang, Yan Song, Tong Zhang

    Venue: ACL-2021

Transfer Learning

1. One-Shot Neural Cross-Lingual Transfer for Paradigm Completion. paper

   Katharina Kann, Ryan Cotterell, Hinrich Schütze

   Venue: ACL-2017

2. Revisiting Recurrent Networks for Paraphrastic Sentence Embeddings. paper

   John Wieting, Kevin Gimpel

   Venue: ACL-2017

3. Effective Cross-lingual Transfer of Neural Machine Translation Models without Shared Vocabularies. paper

   Yunsu Kim, Yingbo Gao, Hermann Ney

   Venue: ACL-2019

4. Dynamically Composing Domain-Data Selection with Clean-Data Selection by "Co-Curricular Learning" for Neural Machine Translation. paper

   Wei Wang, Isaac Caswell, Ciprian Chelba

   Venue: ACL-2019

Pre-training

1. Unsupervised Bilingual Word Embedding Agreement for Unsupervised Neural Machine Translation. paper

   Haipeng Sun, Rui Wang, Kehai Chen, Masao Utiyama, Eiichiro Sumita, Tiejun Zhao

   Venue: ACL-2019

   Paper Reading&Interpretation1；

2. BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension. paper

   Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Veselin Stoyanov, Luke Zettlemoyer

   Venue: ACL-2020

   Paper Reading&Interpretation1 ; Paper Reading&Interpretation2 ; Paper Reading&Interpretation3

3. Curriculum Pre-training for End-to-End Speech Translation. paper

   Chengyi Wang, Yu Wu, Shujie Liu, Ming Zhou, Zhenglu Yang

   Venue: ACL-2020

4. Multilingual Speech Translation from Efficient Finetuning of Pretrained Models. paper

   Xian Li, Changhan Wang, Yun Tang, Chau Tran, Yuqing Tang, Juan Pino, Alexei Baevski, Alexis Conneau, Michael Auli

   Venue: ACL-2021

5. Exploiting Language Relatedness for Low Web-Resource Language Model Adaptation: An Indic Languages Study. paper

   Yash Khemchandani, Sarvesh Mehtani, Vaidehi Patil, Abhijeet Awasthi, Partha Talukdar, Sunita Sarawagi

   Venue: ACL-2021

6. Breaking the Corpus Bottleneck for Context-Aware Neural Machine Translation with Cross-Task Pre-training. paper

   Linqing Chen, Junhui Li, Zhengxian Gong, Boxing Chen, Weihua Luo, Min Zhang, Guodong Zhou

   Venue: ACL-2021

7. Marginal Utility Diminishes: Exploring the Minimum Knowledge for BERT Knowledge Distillation. paper

   Yuanxin Liu, Fandong Meng, Zheng Lin, Weiping Wang, Jie Zhou

   Venue: ACL-2021

   Paper Reading&Interpretation1；

8. LeeBERT: Learned Early Exit for BERT with cross-level optimization. paper

   Wei Zhu

   Venue: ACL-2021

9. How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models. paper

   Phillip Rust, Jonas Pfeiffer, Ivan Vulić, Sebastian Ruder, Iryna Gurevych

   Venue: ACL-2021

   Paper Reading&Interpretation1；

10. Rejuvenating Low-Frequency Words: Making the Most of Parallel Data in Non-Autoregressive Translation. paper

    Liang Ding, Longyue Wang, Xuebo Liu, Derek F. Wong, Dacheng Tao, Zhaopeng Tu

    Venue: ACL-2021

11. VECO: Variable and Flexible Cross-lingual Pre-training for Language Understanding and Generation. paper

    Fuli Luo, Wei Wang, Jiahao Liu, Yijia Liu, Bin Bi, Songfang Huang, Fei Huang, Luo Si

    Venue: ACL-2021

    Paper Reading&Interpretation1；

12. SemFace: Pre-training Encoder and Decoder with a Semantic Interface for Neural Machine Translation. paper

    Shuo Ren, Long Zhou, Shujie Liu, Furu Wei, Ming Zhou, Shuai Ma

    Venue: ACL-2021

    Paper Reading&Interpretation1；

13. Transfer Learning for Sequence Generation: from Single-source to Multi-source. paper

    Xuancheng Huang, Jingfang Xu, Maosong Sun, Yang Liu

    Venue: ACL-2021

14. An Exploratory Analysis of Multilingual Word-Level Quality Estimation with Cross-Lingual Transformers. paper

    Tharindu Ranasinghe, Constantin Orasan, Ruslan Mitkov

    Venue: ACL-2021

15. nmT5 - Is parallel data still relevant for pre-training massively multilingual language models?. paper

    Mihir Kale, Aditya Siddhant, Rami Al-Rfou, Linting Xue, Noah Constant, Melvin Johnson

    Venue: ACL-2021

Diversity and Fairness

1. Generating Diverse Translations with Sentence Codes. paper

   Raphael Shu, Hideki Nakayama, Kyunghyun Cho

   Venue: ACL-2019

2. “You Sound Just Like Your Father” Commercial Machine Translation Systems Include Stylistic Biases. paper

   Dirk Hovy, Federico Bianchi, Tommaso Fornaciari

   Venue: ACL-2020

3. Gender bias amplification during Speed-Quality optimization in Neural Machine Translation. paper

   Adithya Renduchintala, Denise Diaz, Kenneth Heafield, Xian Li, Mona Diab

   Venue: ACL-2021

Robustness

1. Accelerating Neural Transformer via an Average Attention Network. paper

   Biao Zhang, Deyi Xiong, Jinsong Su

   Venue: ACL-2018

   Paper Reading&Interpretation1 ; Paper Reading&Interpretation2

2. Towards Robust Neural Machine Translation. paper

   Yong Cheng, Zhaopeng Tu, Fandong Meng, Junjie Zhai, Yang Liu

   Venue: ACL-2018

   Paper Reading&Interpretation1 ; Paper Reading&Interpretation2

3. Learning Deep Transformer Models for Machine Translation. paper

   Qiang Wang, Bei Li, Tong Xiao, Jingbo Zhu, Changliang Li, Derek F. Wong, Lidia S. Chao

   Venue: ACL-2019

   Paper Reading&Interpretation1；

4. Robust Neural Machine Translation with Doubly Adversarial Inputs. paper

   Yong Cheng, Lu Jiang, Wolfgang Macherey

   Venue: ACL-2019

   Paper Reading&Interpretation1 ; Paper Reading&Interpretation2 ; Paper Reading&Interpretation3 ; Paper Reading&Interpretation4

5. Robust Neural Machine Translation with Joint Textual and Phonetic Embedding. paper

   Hairong Liu, Mingbo Ma, Liang Huang, Hao Xiong, Zhongjun He

   Venue: ACL-2019

6. Effective Adversarial Regularization for Neural Machine Translation. paper

   Motoki Sato, Jun Suzuki, Shun Kiyono

   Venue: ACL-2019

   Paper Reading&Interpretation1；

7. A Reinforced Generation of Adversarial Examples for Neural Machine Translation. paper

   Wei Zou, Shujian Huang, Jun Xie, Xinyu Dai, Jiajun Chen

   Venue: ACL-2020

   Paper Reading&Interpretation1；

8. On the Inference Calibration of Neural Machine Translation. paper

   Shuo Wang, Zhaopeng Tu, Shuming Shi, Yang Liu

   Venue: ACL-2020

9. Understanding the Properties of Minimum Bayes Risk Decoding in Neural Machine Translation. paper

   Mathias Müller, Rico Sennrich

   Venue: ACL-2021

10. On Compositional Generalization of Neural Machine Translation. paper

    Yafu Li, Yongjing Yin, Yulong Chen, Yue Zhang

    Venue: ACL-2021

    Paper Reading&Interpretation1 ; Paper Reading&Interpretation2

11. Beyond Noise: Mitigating the Impact of Fine-grained Semantic Divergences on Neural Machine Translation. paper

    Eleftheria Briakou, Marine Carpuat

    Venue: ACL-2021

12. An Empirical Study on Adversarial Attack on NMT: Languages and Positions Matter. paper

    Zhiyuan Zeng, Deyi Xiong

    Venue: ACL-2021

Data-based Methods

1. Don’t Rule Out Monolingual Speakers: A Method For Crowdsourcing Machine Translation Data. paper

   Rajat Bhatnagar, Ananya Ganesh, Katharina Kann

   Venue: ACL-2021

Word Segmentation

1. Neural Machine Translation of Rare Words with Subword Units. paper

   Rico Sennrich, Barry Haddow, Alexandra Birch

   Venue: ACL-2016

   Paper Reading&Interpretation1 ; Paper Reading&Interpretation2

2. Adversarial Multi-Criteria Learning for Chinese Word Segmentation. paper

   Xinchi Chen, Zhan Shi, Xipeng Qiu, Xuanjing Huang

   Venue: ACL-2017

   Paper Reading&Interpretation1；

3. Neural Joint Model for Transition-based Chinese Syntactic Analysis. paper

   Shuhei Kurita, Daisuke Kawahara, Sadao Kurohashi

   Venue: ACL-2017

4. The Role of Prosody and Speech Register in Word Segmentation: A Computational Modelling Perspective. paper

   Bogdan Ludusan, Reiko Mazuka, Mathieu Bernard, Alejandrina Cristia, Emmanuel Dupoux

   Venue: ACL-2017

5. Challenging Language-Dependent Segmentation for Arabic: An Application to Machine Translation and Part-of-Speech Tagging. paper

   Hassan Sajjad, Fahim Dalvi, Nadir Durrani, Ahmed Abdelali, Yonatan Belinkov, Stephan Vogel

   Venue: ACL-2017

6. Subword Regularization: Improving Neural Network Translation Models with Multiple Subword Candidates. paper

   Taku Kudo

   Venue: ACL-2018

   Paper Reading&Interpretation1 ; Paper Reading&Interpretation2 ; Paper Reading&Interpretation3 ; Paper Reading&Interpretation4

7. Dynamic Programming Encoding for Subword Segmentation in Neural Machine Translation. paper

   Xuanli He, Gholamreza Haffari, Mohammad Norouzi

   Venue: ACL-2020

8. Modeling Word Formation in English–German Neural Machine Translation. paper

   Marion Weller-Di Marco, Alexander Fraser

   Venue: ACL-2020

9. A unified approach to sentence segmentation of punctuated text in many languages. paper

   Rachel Wicks, Matt Post

   Venue: ACL-2021

10. Vocabulary Learning via Optimal Transport for Neural Machine Translation. paper

    Jingjing Xu, Hao Zhou, Chun Gan, Zaixiang Zheng, Lei Li

    Venue: ACL-2021

    Paper Reading&Interpretation1 ; Paper Reading&Interpretation2 ; Paper Reading&Interpretation3 ; Paper Reading&Interpretation4

11. When is Char Better Than Subword: A Systematic Study of Segmentation Algorithms for Neural Machine Translation. paper

    Jiahuan Li, Yutong Shen, Shujian Huang, Xinyu Dai, Jiajun Chen

    Venue: ACL-2021

Character-level NMT

Data Augmentation

1. Improving Neural Machine Translation Models with Monolingual Data. paper

   Rico Sennrich, Barry Haddow, Alexandra Birch

   Venue: ACL-2016

   Paper Reading&Interpretation1 ; Paper Reading&Interpretation2

2. Set-Theoretic Alignment for Comparable Corpora. paper

   Thierry Etchegoyhen, Andoni Azpeitia

   Venue: ACL-2016

3. Jointly Learning to Embed and Predict with Multiple Languages. paper

   Daniel C. Ferreira, André F. T. Martins, Mariana S. C. Almeida

   Venue: ACL-2016

4. Creating Training Corpora for NLG Micro-Planners. paper

   Claire Gardent, Anastasia Shimorina, Shashi Narayan, Laura Perez-Beltrachini

   Venue: ACL-2017

5. Efficient Extraction of Pseudo-Parallel Sentences from Raw Monolingual Data Using Word Embeddings. paper

   Benjamin Marie, Atsushi Fujita

   Venue: ACL-2017

6. Data Augmentation for Low-Resource Neural Machine Translation. paper

   Marzieh Fadaee, Arianna Bisazza, Christof Monz

   Venue: ACL-2017

7. When a Good Translation is Wrong in Context: Context-Aware Machine Translation Improves on Deixis, Ellipsis, and Lexical Cohesion. paper

   Elena Voita, Rico Sennrich, Ivan Titov

   Venue: ACL-2019

8. Neural Fuzzy Repair: Integrating Fuzzy Matches into Neural Machine Translation. paper

   Bram Bulte, Arda Tezcan

   Venue: ACL-2019

9. Generalized Data Augmentation for Low-Resource Translation. paper

   Mengzhou Xia, Xiang Kong, Antonios Anastasopoulos, Graham Neubig

   Venue: ACL-2019

10. Soft Contextual Data Augmentation for Neural Machine Translation. paper

    Fei Gao, Jinhua Zhu, Lijun Wu, Yingce Xia, Tao Qin, Xueqi Cheng, Wengang Zhou, Tie-Yan Liu

    Venue: ACL-2019

    Paper Reading&Interpretation1；

11. A Reinforced Generation of Adversarial Examples for Neural Machine Translation. paper

    Wei Zou, Shujian Huang, Jun Xie, Xinyu Dai, Jiajun Chen

    Venue: ACL-2020

    Paper Reading&Interpretation1；

12. Boosting Neural Machine Translation with Similar Translations. paper

    Jitao XU, Josep Crego, Jean Senellart

    Venue: ACL-2020

13. AdvAug: Robust Adversarial Augmentation for Neural Machine Translation. paper

    Yong Cheng, Lu Jiang, Wolfgang Macherey, Jacob Eisenstein

    Venue: ACL-2020

14. Improving Non-autoregressive Neural Machine Translation with Monolingual Data. paper

    Jiawei Zhou, Phillip Keung

    Venue: ACL-2020

15. Tagged Back-translation Revisited: Why Does It Really Work?. paper

    Benjamin Marie, Raphael Rubino, Atsushi Fujita

    Venue: ACL-2020

16. Data Augmentation for Text Generation Without Any Augmented Data. paper

    Wei Bi, Huayang Li, Jiacheng Huang

    Venue: ACL-2021

17. Self-Training Sampling with Monolingual Data Uncertainty for Neural Machine Translation. paper

    Wenxiang Jiao, Xing Wang, Zhaopeng Tu, Shuming Shi, Michael Lyu, Irwin King

    Venue: ACL-2021

18. Cross-language Sentence Selection via Data Augmentation and Rationale Training. paper

    Yanda Chen, Chris Kedzie, Suraj Nair, Petra Galuscakova, Rui Zhang, Douglas Oard, Kathleen McKeown

    Venue: ACL-2021

    Paper Reading&Interpretation1；

Schedule Strategy

Data Selection

1. Target Conditioned Sampling: Optimizing Data Selection for Multilingual Neural Machine Translation. paper

   Xinyi Wang, Graham Neubig

   Venue: ACL-2019

2. Selecting Backtranslated Data from Multiple Sources for Improved Neural Machine Translation. paper

   Xabier Soto, Dimitar Shterionov, Alberto Poncelas, Andy Way

   Venue: ACL-2020

3. Balancing Training for Multilingual Neural Machine Translation. paper

   Xinyi Wang, Yulia Tsvetkov, Graham Neubig

   Venue: ACL-2020

Curriculum Learning

1. Norm-Based Curriculum Learning for Neural Machine Translation. paper

   Xuebo Liu, Houtim Lai, Derek F. Wong, Lidia S. Chao

   Venue: ACL-2020

2. Uncertainty-Aware Curriculum Learning for Neural Machine Translation. paper

   Yikai Zhou, Baosong Yang, Derek F. Wong, Yu Wan, Lidia S. Chao

   Venue: ACL-2020

   Paper Reading&Interpretation1；

3. Learning a Multi-Domain Curriculum for Neural Machine Translation. paper

   Wei Wang, Ye Tian, Jiquan Ngiam, Yinfei Yang, Isaac Caswell, Zarana Parekh

   Venue: ACL-2020

4. Curriculum Pre-training for End-to-End Speech Translation. paper

   Chengyi Wang, Yu Wu, Shujie Liu, Ming Zhou, Zhenglu Yang

   Venue: ACL-2020

Low-resource NMT

1. Revisiting Low-Resource Neural Machine Translation: A Case Study. paper

   Rico Sennrich, Biao Zhang

   Venue: ACL-2019

Unsupervised NMT

1. Unsupervised Neural Machine Translation with Weight Sharing. paper

   Zhen Yang, Wei Chen, Feng Wang, Bo Xu

   Venue: ACL-2018

   Paper Reading&Interpretation1；

2. On the Limitations of Unsupervised Bilingual Dictionary Induction. paper

   Anders Søgaard, Sebastian Ruder, Ivan Vulić

   Venue: ACL-2018

3. Unsupervised Parallel Sentence Extraction with Parallel Segment Detection Helps Machine Translation. paper

   Viktor Hangya, Alexander Fraser

   Venue: ACL-2019

4. Unsupervised Bilingual Word Embedding Agreement for Unsupervised Neural Machine Translation. paper

   Haipeng Sun, Rui Wang, Kehai Chen, Masao Utiyama, Eiichiro Sumita, Tiejun Zhao

   Venue: ACL-2019

   Paper Reading&Interpretation1；

5. Improved Zero-shot Neural Machine Translation via Ignoring Spurious Correlations. paper

   Jiatao Gu, Yong Wang, Kyunghyun Cho, Victor O.K. Li

   Venue: ACL-2019

   Paper Reading&Interpretation1；

6. Generalized Data Augmentation for Low-Resource Translation. paper

   Mengzhou Xia, Xiang Kong, Antonios Anastasopoulos, Graham Neubig

   Venue: ACL-2019

7. Unsupervised Pivot Translation for Distant Languages. paper

   Yichong Leng, Xu Tan, Tao Qin, Xiang-Yang Li, Tie-Yan Liu

   Venue: ACL-2019

   Paper Reading&Interpretation1；

8. An Effective Approach to Unsupervised Machine Translation. paper

   Mikel Artetxe, Gorka Labaka, Eneko Agirre

   Venue: ACL-2019

   Paper Reading&Interpretation1 ; Paper Reading&Interpretation2

9. Self-Supervised Neural Machine Translation. paper

   Dana Ruiter, Cristina España-Bonet, Josef van Genabith

   Venue: ACL-2019

10. Translating Translationese: A Two-Step Approach to Unsupervised Machine Translation. paper

    Nima Pourdamghani, Nada Aldarrab, Marjan Ghazvininejad, Kevin Knight, Jonathan May

    Venue: ACL-2019

    Paper Reading&Interpretation1；

11. Bilingual Lexicon Induction through Unsupervised Machine Translation. paper

    Mikel Artetxe, Gorka Labaka, Eneko Agirre

    Venue: ACL-2019

    Paper Reading&Interpretation1；

12. Knowledge Distillation for Multilingual Unsupervised Neural Machine Translation. paper

    Haipeng Sun, Rui Wang, Kehai Chen, Masao Utiyama, Eiichiro Sumita, Tiejun Zhao

    Venue: ACL-2020

13. Bilingual Dictionary Based Neural Machine Translation without Using Parallel Sentences. paper

    Xiangyu Duan, Baijun Ji, Hao Jia, Min Tan, Min Zhang, Boxing Chen, Weihua Luo, Yue Zhang

    Venue: ACL-2020

14. A Retrieve-and-Rewrite Initialization Method for Unsupervised Machine Translation. paper

    Shuo Ren, Yu Wu, Shujie Liu, Ming Zhou, Shuai Ma

    Venue: ACL-2020

15. Leveraging Monolingual Data with Self-Supervision for Multilingual Neural Machine Translation. paper

    Aditya Siddhant, Ankur Bapna, Yuan Cao, Orhan Firat, Mia Chen, Sneha Kudugunta, Naveen Arivazhagan, Yonghui Wu

    Venue: ACL-2020

16. Unsupervised Neural Machine Translation for Low-Resource Domains via Meta-Learning. paper

    Cheonbok Park, Yunwon Tae, TaeHee Kim, Soyoung Yang, Mohammad Azam Khan, Lucy Park, Jaegul Choo

    Venue: ACL-2021

    Paper Reading&Interpretation1；

Semi-supervised NMT

1. Semi-Supervised Learning for Neural Machine Translation. paper

   Yong Cheng, Wei Xu, Zhongjun He, Wei He, Hua Wu, Maosong Sun, Yang Liu

   Venue: ACL-2016

2. Multi-space Variational Encoder-Decoders for Semi-supervised Labeled Sequence Transduction. paper

   Chunting Zhou, Graham Neubig

   Venue: ACL-2017

Endangered Language Study

1. Universal Dependencies Parsing for Colloquial Singaporean English. paper

   Hongmin Wang, Yue Zhang, GuangYong Leonard Chan, Jie Yang, Hai Leong Chieu

   Venue: ACL-2017

2. A Teacher-Student Framework for Zero-Resource Neural Machine Translation. paper

   Yun Chen, Yang Liu, Yong Cheng, Victor O.K. Li

   Venue: ACL-2017

3. Triangular Architecture for Rare Language Translation. paper

   Shuo Ren, Wenhu Chen, Shujie Liu, Mu Li, Ming Zhou, Shuai Ma

   Venue: ACL-2018

   Paper Reading&Interpretation1；

4. Adapting High-resource NMT Models to Translate Low-resource Related Languages without Parallel Data. paper

   Wei-Jen Ko, Ahmed El-Kishky, Adithya Renduchintala, Vishrav Chaudhary, Naman Goyal, Francisco Guzmán, Pascale Fung, Philipp Koehn, Mona Diab

   Venue: ACL-2021

5. From Machine Translation to Code-Switching: Generating High-Quality Code-Switched Text. paper

   Ishan Tarunesh, Syamantak Kumar, Preethi Jyothi

   Venue: ACL-2021

6. Machine Translation into Low-resource Language Varieties. paper

   Sachin Kumar, Antonios Anastasopoulos, Shuly Wintner, Yulia Tsvetkov

   Venue: ACL-2021

7. Anchor-based Bilingual Word Embeddings for Low-Resource Languages. paper

   Tobias Eder, Viktor Hangya, Alexander Fraser

   Venue: ACL-2021

Multilingual NMT

1. Neural Architectures for Multilingual Semantic Parsing. paper

   Raymond Hendy Susanto, Wei Lu

   Venue: ACL-2017

2. Incorporating Dialectal Variability for Socially Equitable Language Identification. paper

   David Jurgens, Yulia Tsvetkov, Dan Jurafsky

   Venue: ACL-2017

3. A Compact and Language-Sensitive Multilingual Translation Method. paper

   Yining Wang, Long Zhou, Jiajun Zhang, Feifei Zhai, Jingfang Xu, Chengqing Zong

   Venue: ACL-2019

4. Target Conditioned Sampling: Optimizing Data Selection for Multilingual Neural Machine Translation. paper

   Xinyi Wang, Graham Neubig

   Venue: ACL-2019

5. Balancing Training for Multilingual Neural Machine Translation. paper

   Xinyi Wang, Yulia Tsvetkov, Graham Neubig

   Venue: ACL-2020

6. Improving Massively Multilingual Neural Machine Translation and Zero-Shot Translation. paper

   Biao Zhang, Philip Williams, Ivan Titov, Rico Sennrich

   Venue: ACL-2020

   Paper Reading&Interpretation1；

7. Knowledge Distillation for Multilingual Unsupervised Neural Machine Translation. paper

   Haipeng Sun, Rui Wang, Kehai Chen, Masao Utiyama, Eiichiro Sumita, Tiejun Zhao

   Venue: ACL-2020

8. Language-aware Interlingua for Multilingual Neural Machine Translation. paper

   Changfeng Zhu, Heng Yu, Shanbo Cheng, Weihua Luo

   Venue: ACL-2020

9. Leveraging Monolingual Data with Self-Supervision for Multilingual Neural Machine Translation. paper

   Aditya Siddhant, Ankur Bapna, Yuan Cao, Orhan Firat, Mia Chen, Sneha Kudugunta, Naveen Arivazhagan, Yonghui Wu

   Venue: ACL-2020

10. Contrastive Learning for Many-to-many Multilingual Neural Machine Translation. paper

    Xiao Pan, Mingxuan Wang, Liwei Wu, Lei Li

    Venue: ACL-2021

    Paper Reading&Interpretation1；

11. Learning Language Specific Sub-network for Multilingual Machine Translation. paper

    Zehui Lin, Liwei Wu, Mingxuan Wang, Lei Li

    Venue: ACL-2021

    Paper Reading&Interpretation1；

12. Multilingual Speech Translation from Efficient Finetuning of Pretrained Models. paper

    Xian Li, Changhan Wang, Yun Tang, Chau Tran, Yuqing Tang, Juan Pino, Alexei Baevski, Alexis Conneau, Michael Auli

    Venue: ACL-2021

13. Improving Zero-Shot Translation by Disentangling Positional Information. paper

    Danni Liu, Jan Niehues, James Cross, Francisco Guzmán, Xian Li

    Venue: ACL-2021

14. Consistency Regularization for Cross-Lingual Fine-Tuning. paper

    Bo Zheng, Li Dong, Shaohan Huang, Wenhui Wang, Zewen Chi, Saksham Singhal, Wanxiang Che, Ting Liu, Xia Song, Furu Wei

    Venue: ACL-2021

    Paper Reading&Interpretation1 ; Paper Reading&Interpretation2

15. Importance-based Neuron Allocation for Multilingual Neural Machine Translation. paper

    Wanying Xie, Yang Feng, Shuhao Gu, Dong Yu

    Venue: ACL-2021

    Paper Reading&Interpretation1；

16. Multilingual Agreement for Multilingual Neural Machine Translation. paper

    Jian Yang, Yuwei Yin, Shuming Ma, Haoyang Huang, Dongdong Zhang, Zhoujun Li, Furu Wei

    Venue: ACL-2021

17. Modeling Task-Aware MIMO Cardinality for Efficient Multilingual Neural Machine Translation. paper

    Hongfei Xu, Qiuhui Liu, Josef van Genabith, Deyi Xiong

    Venue: ACL-2021

18. nmT5 - Is parallel data still relevant for pre-training massively multilingual language models?. paper

    Mihir Kale, Aditya Siddhant, Rami Al-Rfou, Linting Xue, Noah Constant, Melvin Johnson

    Venue: ACL-2021

19. Lightweight Adapter Tuning for Multilingual Speech Translation. paper

    Hang Le, Juan Pino, Changhan Wang, Jiatao Gu, Didier Schwab, Laurent Besacier

    Venue: ACL-2021

Document-level NMT

1. Document Translation vs. Query Translation for Cross-Lingual Information Retrieval in the Medical Domain. paper

   Shadi Saleh, Pavel Pecina

   Venue: ACL-2020

2. Using Context in Neural Machine Translation Training Objectives. paper

   Danielle Saunders, Felix Stahlberg, Bill Byrne

   Venue: ACL-2020

3. A Simple and Effective Unified Encoder for Document-Level Machine Translation. paper

   Shuming Ma, Dongdong Zhang, Ming Zhou

   Venue: ACL-2020

   Paper Reading&Interpretation1；

4. Contextual Neural Machine Translation Improves Translation of Cataphoric Pronouns. paper

   KayYen Wong, Sameen Maruf, Gholamreza Haffari

   Venue: ACL-2020

5. Does Multi-Encoder Help? A Case Study on Context-Aware Neural Machine Translation. paper

   Bei Li, Hui Liu, Ziyang Wang, Yufan Jiang, Tong Xiao, Jingbo Zhu, Tongran Liu, Changliang Li

   Venue: ACL-2020

   Paper Reading&Interpretation1 ; Paper Reading&Interpretation2

6. G-Transformer for Document-Level Machine Translation. paper

   Guangsheng Bao, Yue Zhang, Zhiyang Teng, Boxing Chen, Weihua Luo

   Venue: ACL-2021

   Paper Reading&Interpretation1；

7. Modeling Bilingual Conversational Characteristics for Neural Chat Translation. paper

   Yunlong Liang, Fandong Meng, Yufeng Chen, Jinan Xu, Jie Zhou

   Venue: ACL-2021

8. Measuring and Increasing Context Usage in Context-Aware Machine Translation. paper

   Patrick Fernandes, Kayo Yin, Graham Neubig, André F. T. Martins

   Venue: ACL-2021

Real-time NMT

1. Monotonic Infinite Lookback Attention for Simultaneous Machine Translation. paper

   Naveen Arivazhagan, Colin Cherry, Wolfgang Macherey, Chung-Cheng Chiu, Semih Yavuz, Ruoming Pang, Wei Li, Colin Raffel

   Venue: ACL-2019

2. Simultaneous Translation with Flexible Policy via Restricted Imitation Learning. paper

   Baigong Zheng, Renjie Zheng, Mingbo Ma, Liang Huang

   Venue: ACL-2019

   Paper Reading&Interpretation1；

3. Opportunistic Decoding with Timely Correction for Simultaneous Translation. paper

   Renjie Zheng, Mingbo Ma, Baigong Zheng, Kaibo Liu, Liang Huang

   Venue: ACL-2020

   Paper Reading&Interpretation1；

4. Simultaneous Translation Policies: From Fixed to Adaptive. paper

   Baigong Zheng, Kaibo Liu, Renjie Zheng, Mingbo Ma, Hairong Liu, Liang Huang

   Venue: ACL-2020

Multimodal NMT

Speech

Cascaded Speech Translation

1. Lattice Transformer for Speech Translation. paper

   Pei Zhang, Niyu Ge, Boxing Chen, Kai Fan

   Venue: ACL-2019

2. Multilingual Speech Translation from Efficient Finetuning of Pretrained Models. paper

   Xian Li, Changhan Wang, Yun Tang, Chau Tran, Yuqing Tang, Juan Pino, Alexei Baevski, Alexis Conneau, Michael Auli

   Venue: ACL-2021

3. Cascade versus Direct Speech Translation: Do the Differences Still Make a Difference?. paper

   Luisa Bentivogli, Mauro Cettolo, Marco Gaido, Alina Karakanta, Alberto Martinelli, Matteo Negri, Marco Turchi

   Venue: ACL-2021

4. Improving Speech Translation by Understanding and Learning from the Auxiliary Text Translation Task. paper

   Yun Tang, Juan Pino, Xian Li, Changhan Wang, Dmitriy Genzel

   Venue: ACL-2021

End-to-End Speech Translation

1. Joint CTC/attention decoding for end-to-end speech recognition. paper

   Takaaki Hori, Shinji Watanabe, John Hershey

   Venue: ACL-2017

   Paper Reading&Interpretation1；

2. Exploring Phoneme-Level Speech Representations for End-to-End Speech Translation. paper

   Elizabeth Salesky, Matthias Sperber, Alan W Black

   Venue: ACL-2019

3. Curriculum Pre-training for End-to-End Speech Translation. paper

   Chengyi Wang, Yu Wu, Shujie Liu, Ming Zhou, Zhenglu Yang

   Venue: ACL-2020

4. Beyond Sentence-Level End-to-End Speech Translation: Context Helps. paper

   Biao Zhang, Ivan Titov, Barry Haddow, Rico Sennrich

   Venue: ACL-2021

5. Lightweight Adapter Tuning for Multilingual Speech Translation. paper

   Hang Le, Juan Pino, Changhan Wang, Jiatao Gu, Didier Schwab, Laurent Besacier

   Venue: ACL-2021

Image

1. Doubly-Attentive Decoder for Multi-modal Neural Machine Translation. paper

   Iacer Calixto, Qun Liu, Nick Campbell

   Venue: ACL-2017

2. Latent Variable Model for Multi-modal Translation. paper

   Iacer Calixto, Miguel Rios, Wilker Aziz

   Venue: ACL-2019

3. Distilling Translations with Visual Awareness. paper

   Julia Ive, Pranava Madhyastha, Lucia Specia

   Venue: ACL-2019

4. A Novel Graph-based Multi-modal Fusion Encoder for Neural Machine Translation. paper

   Yongjing Yin, Fandong Meng, Jinsong Su, Chulun Zhou, Zhengyuan Yang, Jie Zhou, Jiebo Luo

   Venue: ACL-2020

   Paper Reading&Interpretation1 ; Paper Reading&Interpretation2

5. Unsupervised Multimodal Neural Machine Translation with Pseudo Visual Pivoting. paper

   Po-Yao Huang, Junjie Hu, Xiaojun Chang, Alexander Hauptmann

   Venue: ACL-2020

6. Multimodal Transformer for Multimodal Machine Translation. paper

   Shaowei Yao, Xiaojun Wan

   Venue: ACL-2020

7. Good for Misconceived Reasons: An Empirical Revisiting on the Need for Visual Context in Multimodal Machine Translation. paper

   Zhiyong Wu, Lingpeng Kong, Wei Bi, Xiang Li, Ben Kao

   Venue: ACL-2021

WMT

Efficiency

Quality Estimation

1. An Exploratory Analysis of Multilingual Word-Level Quality Estimation with Cross-Lingual Transformers. paper

   Tharindu Ranasinghe, Constantin Orasan, Ruslan Mitkov

   Venue: ACL-2021

News Translation

Survey

1. Scientific Credibility of Machine Translation Research: A Meta-Evaluation of 769 Papers. paper

   Benjamin Marie, Atsushi Fujita, Raphael Rubino

   Venue: ACL-2021