{"id":792797,"date":"2021-11-16T08:00:19","date_gmt":"2021-11-16T16:00:19","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-research-item&#038;p=792797"},"modified":"2021-11-18T07:05:58","modified_gmt":"2021-11-18T15:05:58","slug":"research-talk-torchy-a-tracing-jit-compiler-for-pytorch","status":"publish","type":"msr-video","link":"https:\/\/www.microsoft.com\/en-us\/research\/video\/research-talk-torchy-a-tracing-jit-compiler-for-pytorch\/","title":{"rendered":"Research talk: Torchy: A tracing JIT compiler for PyTorch"},"content":{"rendered":"<p>This session will introduce current technologies to speed up training of machine learning models and their limitations, and it will also include a presentation of <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/github.com\/nunoplopes\/torchy\" target=\"_blank\" rel=\"noopener\">Torchy<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, a transparent solution to speed up PyTorch workloads through the means of JIT compilation. Machine learning models and their respective code keep getting more complex and dynamic. Traditional static compilation techniques (for example, TorchScript) can&#8217;t handle these real-world, modern code bases. Furthermore, using techniques like TorchScript is risky and requires a very good understanding of the technology. The researchers present Torchy, a new tracing JIT compiler for PyTorch that works with any code base\u2014improving its performance\u2014and automates parallelism and distribution across multiple devices.<\/p>\n<p>Learn more about the 2021 Microsoft Research Summit: <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/Aka.ms\/researchsummit\">https:\/\/Aka.ms\/researchsummit<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>This session will introduce current technologies to speed up training of machine learning models and their limitations, and it will also include a presentation of Torchy, a transparent solution to speed up PyTorch workloads through the means of JIT compilation. Machine learning models and their respective code keep getting more complex and dynamic. Traditional static [&hellip;]<\/p>\n","protected":false},"featured_media":792800,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","footnotes":""},"research-area":[13560,13547],"msr-video-type":[261305,261263],"msr-locale":[268875],"msr-post-option":[],"msr-impact-theme":[],"msr-pillar":[],"class_list":["post-792797","msr-video","type-msr-video","status-publish","has-post-thumbnail","hentry","msr-research-area-programming-languages-software-engineering","msr-research-area-systems-and-networking","msr-video-type-empowering-software-developers-and-mathematicians-with-next-generation-ai","msr-video-type-research-summit-2021","msr-locale-en_us"],"msr_download_urls":"","msr_external_url":"https:\/\/youtu.be\/Rrd5oG4TBHM","msr_secondary_video_url":"","msr_video_file":"","_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video\/792797"}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-video"}],"version-history":[{"count":3,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video\/792797\/revisions"}],"predecessor-version":[{"id":797902,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video\/792797\/revisions\/797902"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/792800"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=792797"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=792797"},{"taxonomy":"msr-video-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video-type?post=792797"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=792797"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=792797"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=792797"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=792797"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}