Directions in ML: AutoML and Automating Algorithms

March 24, 2021 | Misha Khodak, Neil Tenenholtz, Lester Mackey, and Nicolo Fusi

From BiT (928 million parameters) to GPT-3 (175 billion parameters), state-of-the-art machine learning models are rapidly growing in size. With the greater expressivity and easier trainability of these models come skyrocketing training costs, deployment difficulties, and even climate impact. As…

December 17, 2020

Microsoft researchers pursue the big questions about what the world will be like in the future and the role technology will play. Not only do they take on the responsibility of exploring the long-term vision of their research, but they…