Pinwheel graphic representing the Microsoft Research Summit
Return to Event: Microsoft Research Summit 2021

Microsoft Research Summit 2021 • Videos

Research talk: Torchy: A tracing JIT compiler for PyTorch

  • Nuno Lopes | Microsoft Research Cambridge
  • Microsoft Research Summit 2021 | Empowering Developers and Mathematicians with Next-Gen AI

This session will introduce current technologies to speed up training of machine learning models and their limitations, and it will also include a presentation of Torchy (opens in new tab), a transparent solution to speed up PyTorch workloads through the means of JIT compilation. Machine learning models and their respective code keep getting more complex and dynamic. Traditional static compilation techniques (for example, TorchScript) can’t handle these real-world, modern code bases. Furthermore, using techniques like TorchScript is risky and requires a very good understanding of the technology. The researchers present Torchy, a new tracing JIT compiler for PyTorch that works with any code base—improving its performance—and automates parallelism and distribution across multiple devices.

Learn more about the 2021 Microsoft Research Summit: https://Aka.ms/researchsummit (opens in new tab)

Empowering Developers and Mathematicians with Next-Gen AI