Portrait of Yifan Xiong

Yifan Xiong

Senior Researcher

News & features

Research Focus: August 5, 2024
Microsoft Research Blog

In this issue: Research Forum Ep. 4 explores multimodal AI. Registration is now open; Surveying developers’ AI needs; SuperBench improves cloud AI infrastructure reliability; Virtual Voices: Exploring factors influencing participation in virtual meetings.

Awards | USENIX ATC 2024

Our paper titled "SuperBench: Improving Cloud AI Infrastructure Reliability with Proactive Validation" received the Best Paper Award at the 2024 USENIX Annual Technical Conference (USENIX ATC '24).

A line graph comparing the end-to-end performance of Meta’s MoE language model using Azure NDm A100 v4 VMs with and without Tutel. The x-axis is the number of A100 (80GB) GPUs, beginning at 8 and going up to 512, and the y-axis is the throughput (K tokens/s), beginning with 0 and going up to 1,000 in intervals of 100. Tutel always achieves higher throughput than fairseq.
Microsoft Research Blog

| Wei Cui, Yifan Xiong, Peng Cheng, and Rafael Salas

Mixture of experts (MoE) is a deep learning model architecture in which computational cost is sublinear to the number of parameters, making scaling easier. Nowadays, MoE is the only approach demonstrated to scale deep learning models to trillion-plus parameters, paving…