week12_style

Lecture on Text Style Transfer (by altsoph@) slides

Materials

• Russian videos: lecture, seminar

Papers

Definitions and evaluation

• What is wrong with style transfer for texts?
• Evaluating Style Transfer for Text
• Style Transfer for Texts: Retrain, Report Errors, Compare with Rewrites
• Evaluating the Evaluation Metrics for Style Transfer: A Case Study in Multilingual Formality Transfer
• Style-transfer and Paraphrase: Looking for a Sensible Semantic Similarity Metric

Modern approaches (with non exhaustive list of examples)

• NMT-like:
  • Shakespearizing Modern Language Using Copy-Enriched Sequence-to-Sequence Models
  • Non-Parallel Text Style Transfer with Self-Parallel Supervision
• UNMT-like:
  • A Probabilistic Formulation of Unsupervised Text Style Transfer
• Template/edit-based:
  • Unsupervised Text Style Transfer with Padded Masked Language Models
  • Stable Style Transformer: Delete and Generate Approach with Encoder-Decoder for Text Style Transfer
• Z-space search:
  • Revision in Continuous Space: Unsupervised Text Style Transfer without Adversarial Learning
  • Controllable Unsupervised Text Attribute Transfer via Editing Entangled Latent Representation
  • A Simple Geometric Method for Cross-Lingual Linguistic Transformations with Pre-trained Autoencoders
• Disentangled representations:
  • Disentangled Representation Learning for Non-Parallel Text Style Transfer
  • Toward Controlled Generation of Text
  • Adversarial Decomposition of Text Representation
  • ST2: Small-data Text Style Transfer via Multi-task Meta-Learning
  • Multiple-Attribute Text Style Transfer
• More tricks:
  • TextSETTR: Few-Shot Text Style Extraction and Tunable Targeted Restyling
  • A Recipe For Arbitrary Text Style Transfer with Large Language Models
  • Texar: A Modularized, Versatile, and Extensible Toolkit for Text Generation

More papers

• A systematic review of text style transfer methodologies
• Long list of papers on Text Style Transfer
• Another list of papers on Text Style Transfer

Other links

Quick intro to VAEs and latent spaces

• Short intro to VAEs
• Transformer-based text VAE
• RNN-based text VAE

Datasets

• YELP
• YELP-aug
• GYAFC
• parallel Bibles
• parallel Shakespeare
• Politeness transfer dataset