Orca
Using AI, to improve AI
News & features
Orca-AgentInstruct: Agentic flows can be effective synthetic-data generators
| Arindam Mitra, Ahmed Awadallah, and Yash Lara
Orca-AgentInstruct, from Microsoft Research, can generate diverse, high-quality synthetic data at scale to post-train and fine-tune base LLMs for expanded capabilities, continual learning, and increased performance.
Abstracts: July 18, 2024
| Gretchen Huizinga and Arindam Mitra
Senior Researcher Arindam Mitra introduces AgentInstruct. Using raw data sources, the automated multi-agent framework can create diverse, high-quality synthetic data at scale for the post-training of small and large language models.
Orca-Math: Demonstrating the potential of SLMs with model specialization
| Arindam Mitra, Hamed Khanpour, Corby Rosset, and Ahmed Awadallah
Microsoft’s Orca-Math, a specialized small language model, outperforms much larger models in solving math problems that require multi-step reasoning and shows the potential of using feedback to improve language models. Learn more.
In the news | Microsoft News Center
3 big AI trends to watch in 2024
2023 was a major year for generative AI, as it went from research labs to real life with millions of people using it through popular tools like ChatGPT and Microsoft Copilot. This year, AI is expected to become more accessible,…
Research at Microsoft 2023: A year of groundbreaking AI advances and discoveries
AI saw unparalleled growth in 2023, reaching millions daily. This progress owes much to the extensive work of Microsoft researchers and collaborators. In this review, learn about the advances in 2023, which set the stage for further progress in 2024.
Orca 2: Teaching Small Language Models How to Reason
| Ahmed Awadallah, Andres Codas, Luciano Del Corro, Hamed Khanpour, Shweti Mahajan, Arindam Mitra, Hamid Palangi, Corby Rosset, Clarisse Simoes Ribeiro, and Guoqing Zheng
At Microsoft, we’re expanding AI capabilities by training small language models to achieve the kind of enhanced reasoning and comprehension typically found only in much larger models.
In the news | VentureBeat
Microsoft releases Orca 2, a pair of small language models that outperform larger counterparts
Even as the world bears witness to the power struggle and mass resignation at OpenAI, Microsoft, the long-time backer of the AI major, is not slowing down its own AI efforts. Today, the research arm of the Satya Nadella-led company…