Contextual Representation for Natural Language Understanding

Neural Machine Translation provides very useful representation for the language in context. The sentences and words representation leaned from Neural Machine translation models can be efficiently used to boost the performance of many Natural Language Understanding (NLU) tasks that usually have less data than Machine Translation. These techniques are being successfully utilized within many models that are used in Microsoft products and systems.