Deep Learning Compiler and Optimizer

Cocktailer: Analyzing and Optimizing Dynamic Control Flow in Deep Learning

Chen Zhang, Lingxiao Ma, Jilong Xue, Yining Shi, Ziming Miao, Fan Yang, Jidong Zhai, Zhi Yang, Mao Yang

17th USENIX Symposium on Operating Systems Design and Implementation (OSDI'23) | July 2023

Publication

Welder: Scheduling Deep Learning Memory Access via Tile-graph

Yining Shi, Zhi Yang, Jilong Xue, Lingxiao Ma, Yuqing Xia, Ziming Miao, Yuxiao Guo, Fan Yang, Lidong Zhou

17th USENIX Symposium on Operating Systems Design and Implementation (OSDI'23) | July 2023

Publication

Efficient GPU Kernels for N:M-SPARSE Weights in Deep Learning

Bin Lin, Ningxin Zheng, Lei Wang, Shijie Cao, Lingxiao Ma, Quanlu Zhang, Yi Zhu, Ting Cao, Jilong Xue, Yuqing Yang, Fan Yang

Sixth Conference on Machine Learning and Systems (MLSys'23) | June 2023

Publication

Roller: Fast and Efficient Tensor Compilation for Deep Learning

Hongyu Zhu , Ruofan Wu , Yijia Diao , Shanbin Ke , Haoyu Li , Chen Zhang , Jilong Xue, Lingxiao Ma, Yuqing Xia, Wei Cui, Fan Yang, Mao Yang, Lidong Zhou, Asaf Cidon , Gennady Pekhimenko

The 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI'22) | July 2022

Publication

SparTA: Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute

Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Yang Wang, Mao Yang, Lidong Zhou

OSDI 2022 | July 2022

Publication Project

Rammer: Enabling Holistic Deep Learning Compiler Optimizations with rTasks

Lingxiao Ma, Zhiqiang Xie, Zhi Yang, Jilong Xue, Youshan Miao, Wei Cui, Wenxiang Hu, Fan Yang, Lintao Zhang, Lidong Zhou

14th USENIX Symposium on Operating Systems Design and Implementation (OSDI'20) | November 2020

Publication

NeuGraph: Parallel Deep Neural Network Computation on Large Graphs

Lingxiao Ma, Zhi Yang, Youshan Miao, Jilong Xue, Ming Wu, Lidong Zhou, Yafei Dai

2019 USENIX Annual Technical Conference | July 2019

Publication Project

Fast Distributed Deep Learning over RDMA

Jilong Xue, Youshan Miao, Cheng Chen, Ming Wu, Lintao Zhang, Lidong Zhou

EuroSys | March 2019

Publication

TuX2: Distributed Graph Computation for Machine Learning

Jilong Xue, Youshan Miao, Cheng Chen, Ming Wu, Lidong Zhou

14th USENIX Symposium on Networked Systems Design and Implementation (NSDI 17) | March 2017

ISBN: 978-1-931971-37-9

Publication Project

Cocktailer: Analyzing and Optimizing Dynamic Control Flow in Deep Learning

Chen Zhang, Lingxiao Ma, Jilong Xue, Yining Shi, Ziming Miao, Fan Yang, Jidong Zhai, Zhi Yang, Mao Yang

17th USENIX Symposium on Operating Systems Design and Implementation (OSDI'23) | July 2023

Publication

Welder: Scheduling Deep Learning Memory Access via Tile-graph

Yining Shi, Zhi Yang, Jilong Xue, Lingxiao Ma, Yuqing Xia, Ziming Miao, Yuxiao Guo, Fan Yang, Lidong Zhou

17th USENIX Symposium on Operating Systems Design and Implementation (OSDI'23) | July 2023

Publication

Efficient GPU Kernels for N:M-SPARSE Weights in Deep Learning

Bin Lin, Ningxin Zheng, Lei Wang, Shijie Cao, Lingxiao Ma, Quanlu Zhang, Yi Zhu, Ting Cao, Jilong Xue, Yuqing Yang, Fan Yang

Sixth Conference on Machine Learning and Systems (MLSys'23) | June 2023

Publication

SparTA: Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute

Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Yang Wang, Mao Yang, Lidong Zhou

OSDI 2022 | July 2022

Publication Project

Roller: Fast and Efficient Tensor Compilation for Deep Learning

Hongyu Zhu , Ruofan Wu , Yijia Diao , Shanbin Ke , Haoyu Li , Chen Zhang , Jilong Xue, Lingxiao Ma, Yuqing Xia, Wei Cui, Fan Yang, Mao Yang, Lidong Zhou, Asaf Cidon , Gennady Pekhimenko

The 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI'22) | July 2022

Publication

Rammer: Enabling Holistic Deep Learning Compiler Optimizations with rTasks

Lingxiao Ma, Zhiqiang Xie, Zhi Yang, Jilong Xue, Youshan Miao, Wei Cui, Wenxiang Hu, Fan Yang, Lintao Zhang, Lidong Zhou

14th USENIX Symposium on Operating Systems Design and Implementation (OSDI'20) | November 2020

Publication

NeuGraph: Parallel Deep Neural Network Computation on Large Graphs

Lingxiao Ma, Zhi Yang, Youshan Miao, Jilong Xue, Ming Wu, Lidong Zhou, Yafei Dai

2019 USENIX Annual Technical Conference | July 2019

Publication Project

Fast Distributed Deep Learning over RDMA

Jilong Xue, Youshan Miao, Cheng Chen, Ming Wu, Lintao Zhang, Lidong Zhou

EuroSys | March 2019

Publication

TuX2: Distributed Graph Computation for Machine Learning

Jilong Xue, Youshan Miao, Cheng Chen, Ming Wu, Lidong Zhou

14th USENIX Symposium on Networked Systems Design and Implementation (NSDI 17) | March 2017

ISBN: 978-1-931971-37-9

Publication Project

NeuGraph: Parallel Deep Neural Network Computation on Large Graphs

Lingxiao Ma, Zhi Yang, Youshan Miao, Jilong Xue, Ming Wu, Lidong Zhou, Yafei Dai

2019 USENIX Annual Technical Conference | July 2019

Publication Project

Cocktailer: Analyzing and Optimizing Dynamic Control Flow in Deep Learning

Chen Zhang, Lingxiao Ma, Jilong Xue, Yining Shi, Ziming Miao, Fan Yang, Jidong Zhai, Zhi Yang, Mao Yang

17th USENIX Symposium on Operating Systems Design and Implementation (OSDI'23) | July 2023

Publication

Welder: Scheduling Deep Learning Memory Access via Tile-graph

Yining Shi, Zhi Yang, Jilong Xue, Lingxiao Ma, Yuqing Xia, Ziming Miao, Yuxiao Guo, Fan Yang, Lidong Zhou

17th USENIX Symposium on Operating Systems Design and Implementation (OSDI'23) | July 2023

Publication

Efficient GPU Kernels for N:M-SPARSE Weights in Deep Learning

Bin Lin, Ningxin Zheng, Lei Wang, Shijie Cao, Lingxiao Ma, Quanlu Zhang, Yi Zhu, Ting Cao, Jilong Xue, Yuqing Yang, Fan Yang

Sixth Conference on Machine Learning and Systems (MLSys'23) | June 2023

Publication

SparTA: Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute

Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Yang Wang, Mao Yang, Lidong Zhou

OSDI 2022 | July 2022

Publication Project

Roller: Fast and Efficient Tensor Compilation for Deep Learning

Hongyu Zhu , Ruofan Wu , Yijia Diao , Shanbin Ke , Haoyu Li , Chen Zhang , Jilong Xue, Lingxiao Ma, Yuqing Xia, Wei Cui, Fan Yang, Mao Yang, Lidong Zhou, Asaf Cidon , Gennady Pekhimenko

The 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI'22) | July 2022

Publication

Rammer: Enabling Holistic Deep Learning Compiler Optimizations with rTasks

Lingxiao Ma, Zhiqiang Xie, Zhi Yang, Jilong Xue, Youshan Miao, Wei Cui, Wenxiang Hu, Fan Yang, Lintao Zhang, Lidong Zhou

14th USENIX Symposium on Operating Systems Design and Implementation (OSDI'20) | November 2020

Publication

NeuGraph: Parallel Deep Neural Network Computation on Large Graphs

Lingxiao Ma, Zhi Yang, Youshan Miao, Jilong Xue, Ming Wu, Lidong Zhou, Yafei Dai

2019 USENIX Annual Technical Conference | July 2019

Publication Project

Fast Distributed Deep Learning over RDMA

Jilong Xue, Youshan Miao, Cheng Chen, Ming Wu, Lintao Zhang, Lidong Zhou

EuroSys | March 2019

Publication

TuX2: Distributed Graph Computation for Machine Learning

Jilong Xue, Youshan Miao, Cheng Chen, Ming Wu, Lidong Zhou

14th USENIX Symposium on Networked Systems Design and Implementation (NSDI 17) | March 2017

ISBN: 978-1-931971-37-9

Publication Project