About
I currently lead a modeling team in Microsoft GenAI. We are a product team working on large-scale (OpenAI and Microsoft) model training, including post-training, pre-training, and data. We also publish some of our works, such as LoRA (opens in new tab), DeBERTa (opens in new tab), Phi (opens in new tab), Rho-1 (opens in new tab)(best paper runner-up award in Neurips-2024). Please check: Weizhu Chen – Google Scholar (opens in new tab) for our recent works.