Yuqing Xia
Researcher
News & features
Loading
In the news | Venture Beat
Microsoft’s Differential Transformer cancels attention noise in LLMs
Improving LLMs’ ability to retrieve in-prompt information can impact important applications such as retrieval-augmented generation (RAG) and in-context learning (ICL). Microsoft Research and Tsinghua University researchers have introduced Differential Transformer (Diff Transformer), a new LLM architecture that amplifies attention to relevant context while…
Awards | NeurIPS Conference 2022
Yujing Wang, Ziming Miao, Qi Chen, Yuqing Xia, Xing Xie, Mao Yang and Zheng Liu receive Outstanding Paper award at NeurIPS 2022
Yujing Wang, Ziming Miao, Qi Chen, Yuqing Xia, Xing Xie, Mao Yang, and Zheng Liu researchers from Microsoft Research Asia lab along with co-authors Yujing Wang, Yingyan Hou, Haonan Wang, Ziming Miao, Shibin Wu, Hao Sun, Chengmin Chi, Guoshuai Zhao,Zheng…