Dual Learning

Introduction to Dual Learning
Many AI tasks are emerged in dual forms, e.g., English-to-French translation vs. French-to-English translation, speech recognition vs. text to speech, question answering vs. question generation, and image classification vs. image generation. While structural duality is common in AI, most learning algorithms have not exploited it in learning/inference. We propose a new learning paradigm, dual learning, which leverages the primal-dual structure of AI tasks to obtain effective feedback or regularization signals to enhance the learning/inference process. Dual learning has been studied in different learning settings, including unsupervised/supervised/semi-supervised/transfer settings, and applied to different applications, including machine translation, sentimental analysis, image classification/generation, question answering/generation …

Tutorial and code
The book on Dual Learning (opens in new tab) is published by Springer!

(opens in new tab)

Tutorial and code
Tutorial (opens in new tab) at IJCAI 2019
Tutorial on dual learning (opens in new tab) at ACML 2018
Dual Supervised Learning for image classification/generation and sentiment analysis, [Code@Github (opens in new tab)]

Our papers
Yiren Wang, Yingce Xia, Tianyu He, Fei Tian, Tao Qin, ChengXiang Zhai, Tie-Yan Liu, Multi-Agent Dual Learning (opens in new tab), ICLR 2019.
Yingce Xia, Xu Tan, Fei Tian, Tao Qin, Nenghai Yu, and Tie-Yan Liu, Model-Level Dual Learning (opens in new tab), ICML 2018.
Hany Hassan, Anthony Aue, Chang Chen, Vishal Chowdhary, Jonathan Clark, Christian Federmann, Xuedong Huang, Marcin Junczys-Dowmunt, William Lewis, Mu Li, Shujie Liu, Tie-Yan Liu, Renqian Luo, Arul Menezes, Tao Qin, Frank Seide, Xu Tan, Fei Tian, Lijun Wu, Shuangzhi Wu, Yingce Xia, Dongdong Zhang, Zhirui Zhang, Ming Zhou, Achieving Human Parity on Automatic Chinese to English News Translation (opens in new tab), arXiv 2018.
Jianxin Lin, Yingce Xia, Tao Qin, Zhibo Chen, and Tie-Yan Liu, Conditional Image-to-Image Translation (opens in new tab), CVPR 2018.
Yijun Wang, Yingce Xia, Li Zhao, Jiang Bian, Tao Qin, Guiquan Liu, and Tie-Yan Liu, Dual Transfer Learning for Neural Machine Translation with Marginal Distribution Regularization (opens in new tab), AAAI 2018.
Duyu Tang, Nan Duan, Tao Qin, Zhao Yan, and Ming Zhou, Question Answering and Question Generation as Dual Tasks, arXiv 2017.
Yingce Xia, Tao Qin, Wei Chen, Jiang Bian, Nenghai Yu and Tie-Yan Liu, Dual Supervised Learning (opens in new tab), ICML 2017.
Yingce Xia, Jiang Bian, Tao Qin, Tie-Yan Liu, Dual Inference for Machine Learning (opens in new tab), IJCAI 2017.
Di He, Yingce Xia, Tao Qin, Liwei Wang, Nenghai Yu, Tie-Yan Liu, and Wei-Ying Ma, Dual Learning for Machine Translation (opens in new tab), NIPS 2016.