Research talk: Torchy: A tracing JIT compiler for PyTorch
This session will introduce current technologies to speed up training of machine learning models and their limitations, and it will also include a presentation of Torchy (opens in new tab), a transparent solution to speed up PyTorch workloads through the means of JIT compilation. Machine learning models and their respective code keep getting more complex and dynamic. Traditional static compilation techniques (for example, TorchScript) can’t handle these real-world, modern code bases. Furthermore, using techniques like TorchScript is risky and requires a very good understanding of the technology. The researchers present Torchy, a new tracing JIT compiler for PyTorch that works with any code base—improving its performance—and automates parallelism and distribution across multiple devices.
Learn more about the 2021 Microsoft Research Summit: https://Aka.ms/researchsummit (opens in new tab)
- Track:
- Empowering Developers and Mathematicians with Next-Gen AI
- Date:
- Speakers:
- Nuno Lopes
- Affiliation:
- Microsoft Research Cambridge
-
-
Nuno Lopes
Principal Researcher
-
-
Empowering Developers and Mathematicians with Next-Gen AI
-
-
Research talks: AI for software development
Speakers:- Neel Sundaresan,
- Oege de Moor,
- Todd Mytkowicz
-
-
Research talk: Torchy: A tracing JIT compiler for PyTorch
Speakers:- Nuno Lopes
-
Lightning talks: Augmented Mathematical Intelligence
Speakers:- Leonardo de Moura,
- Kevin Buzzard,
- Daniel Selsam
-
Research talks: Software supply chain security
Speakers:- Adrian Diglio,
- Michael Scovetta
-
Panel: Preparing for the next generation of developer communities
Speakers:- Margaret Price,
- Bobby Dresser,
- Mala Kumar
-