Disentangling Latent Representations for Interpretability and Controllability: Summary

1 Jun 2024

Author:

(1) Mingda Chen.

5.3 Summary

In this chapter, we demonstrated the utility of our proposed latent-variable framework in the context of representation learning (Section 5.1) and controllable generation (Section 5.2). In both cases, we leveraged the structures of paired data to disentangle semantics and syntax in sentence representations. We found that the syntactic and semantic latent variables showed desirable characteristics. For controlled generation, we provided human-annotated evaluation sets to promote future research in this direction. In addition, in a follow-up work, we showed that the multi-task, latent-variable framework can generalize to bilingual text corpora (Chen et al., 2020b).

This paper is available on arxiv under CC 4.0 license.