Intelligent Cloud and Edge Group

Cocktailer: Analyzing and Optimizing Dynamic Control Flow in Deep Learning

Chen Zhang, Lingxiao Ma, Jilong Xue, Yining Shi, Ziming Miao, Fan Yang, Jidong Zhai, Zhi Yang, Mao Yang

17th USENIX Symposium on Operating Systems Design and Implementation (OSDI’23) | July 2023

Publication Projet

Welder: Scheduling Deep Learning Memory Access via Tile-graph

Yining Shi, Zhi Yang, Jilong Xue, Lingxiao Ma, Yuqing Xia, Ziming Miao, Yuxiao Guo, Fan Yang, Lidong Zhou

17th USENIX Symposium on Operating Systems Design and Implementation (OSDI’23) | July 2023

Publication Projet

Efficient GPU Kernels for N:M-SPARSE Weights in Deep Learning

Bin Lin, Ningxin Zheng, Lei Wang, Shijie Cao, Lingxiao Ma, Quanlu Zhang, Yi Zhu, Ting Cao, Jilong Xue, Yuqing Yang, Fan Yang

Sixth Conference on Machine Learning and Systems (MLSys’23) | June 2023

Publication Projet

Roller: Fast and Efficient Tensor Compilation for Deep Learning

Hongyu Zhu , Ruofan Wu , Yijia Diao , Shanbin Ke , Haoyu Li , Chen Zhang , Jilong Xue, Lingxiao Ma, Yuqing Xia, Wei Cui, Fan Yang, Mao Yang, Lidong Zhou, Asaf Cidon , Gennady Pekhimenko

The 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI’22) | July 2022

Publication Projet

SparTA: Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute

Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Yang Wang, Mao Yang, Lidong Zhou

OSDI 2022 | July 2022

Publication Projet Projet

Tutel: Adaptive Mixture-of-Experts at Scale

Changho Hwang, Wei Cui, Yifan Xiong, Ziyue Yang, Ze Liu, Han Hu, Zilong Wang, Rafael Salas, Jithin Jose, Prabhat Ram, Joe Chau, Peng Cheng, Fan Yang, Mao Yang, Yongqiang Xiong

July 2022

Publication

Accelerating GNN training with locality-aware partial execution

Taehyun Kim, Changho Hwang, KyoungSoo Park, Zhiqi Lin, Peng Cheng, Youshan Miao, Lingxiao Ma, Yongqiang Xiong

August 2021

Publication

Rammer: Enabling Holistic Deep Learning Compiler Optimizations with rTasks

Lingxiao Ma, Zhiqiang Xie, Zhi Yang, Jilong Xue, Youshan Miao, Wei Cui, Wenxiang Hu, Fan Yang, Lintao Zhang, Lidong Zhou

14th USENIX Symposium on Operating Systems Design and Implementation (OSDI’20) | November 2020

Publication Projet

Distributed Graph Computation Meets Machine Learning

Wencong Xiao, Jilong Xue, Youshan Miao, Zhen Li, Cheng Chen, Ming Wu, Wei Li, Lidong Zhou

IEEE Transactions on Parallel and Distributed Systems | January 2020, Vol 31(7): pp. 1588-1604

Publication Projet

NeuGraph: Parallel Deep Neural Network Computation on Large Graphs

Lingxiao Ma, Zhi Yang, Youshan Miao, Jilong Xue, Ming Wu, Lidong Zhou, Yafei Dai

2019 USENIX Annual Technical Conference | July 2019

Publication Projet Projet

Fast Distributed Deep Learning over RDMA

Jilong Xue, Youshan Miao, Cheng Chen, Ming Wu, Lintao Zhang, Lidong Zhou

EuroSys | March 2019

Publication Projet

TuX2: Distributed Graph Computation for Machine Learning

Jilong Xue, Youshan Miao, Cheng Chen, Ming Wu, Lidong Zhou

14th USENIX Symposium on Networked Systems Design and Implementation (NSDI 17) | March 2017

ISBN: 978-1-931971-37-9

Publication Projet Projet

Cocktailer: Analyzing and Optimizing Dynamic Control Flow in Deep Learning

Chen Zhang, Lingxiao Ma, Jilong Xue, Yining Shi, Ziming Miao, Fan Yang, Jidong Zhai, Zhi Yang, Mao Yang

17th USENIX Symposium on Operating Systems Design and Implementation (OSDI’23) | July 2023

Publication Projet

Welder: Scheduling Deep Learning Memory Access via Tile-graph

Yining Shi, Zhi Yang, Jilong Xue, Lingxiao Ma, Yuqing Xia, Ziming Miao, Yuxiao Guo, Fan Yang, Lidong Zhou

17th USENIX Symposium on Operating Systems Design and Implementation (OSDI’23) | July 2023

Publication Projet

Efficient GPU Kernels for N:M-SPARSE Weights in Deep Learning

Bin Lin, Ningxin Zheng, Lei Wang, Shijie Cao, Lingxiao Ma, Quanlu Zhang, Yi Zhu, Ting Cao, Jilong Xue, Yuqing Yang, Fan Yang

Sixth Conference on Machine Learning and Systems (MLSys’23) | June 2023

Publication Projet

Tutel: Adaptive Mixture-of-Experts at Scale

Changho Hwang, Wei Cui, Yifan Xiong, Ziyue Yang, Ze Liu, Han Hu, Zilong Wang, Rafael Salas, Jithin Jose, Prabhat Ram, Joe Chau, Peng Cheng, Fan Yang, Mao Yang, Yongqiang Xiong

July 2022

Publication

SparTA: Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute

Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Yang Wang, Mao Yang, Lidong Zhou

OSDI 2022 | July 2022

Publication Projet Projet

Roller: Fast and Efficient Tensor Compilation for Deep Learning

Hongyu Zhu , Ruofan Wu , Yijia Diao , Shanbin Ke , Haoyu Li , Chen Zhang , Jilong Xue, Lingxiao Ma, Yuqing Xia, Wei Cui, Fan Yang, Mao Yang, Lidong Zhou, Asaf Cidon , Gennady Pekhimenko

The 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI’22) | July 2022

Publication Projet

Accelerating GNN training with locality-aware partial execution

Taehyun Kim, Changho Hwang, KyoungSoo Park, Zhiqi Lin, Peng Cheng, Youshan Miao, Lingxiao Ma, Yongqiang Xiong

August 2021

Publication

Rammer: Enabling Holistic Deep Learning Compiler Optimizations with rTasks

Lingxiao Ma, Zhiqiang Xie, Zhi Yang, Jilong Xue, Youshan Miao, Wei Cui, Wenxiang Hu, Fan Yang, Lintao Zhang, Lidong Zhou

14th USENIX Symposium on Operating Systems Design and Implementation (OSDI’20) | November 2020

Publication Projet

Distributed Graph Computation Meets Machine Learning

Wencong Xiao, Jilong Xue, Youshan Miao, Zhen Li, Cheng Chen, Ming Wu, Wei Li, Lidong Zhou

IEEE Transactions on Parallel and Distributed Systems | January 2020, Vol 31(7): pp. 1588-1604

Publication Projet

NeuGraph: Parallel Deep Neural Network Computation on Large Graphs

Lingxiao Ma, Zhi Yang, Youshan Miao, Jilong Xue, Ming Wu, Lidong Zhou, Yafei Dai

2019 USENIX Annual Technical Conference | July 2019

Publication Projet Projet

Fast Distributed Deep Learning over RDMA

Jilong Xue, Youshan Miao, Cheng Chen, Ming Wu, Lintao Zhang, Lidong Zhou

EuroSys | March 2019

Publication Projet

TuX2: Distributed Graph Computation for Machine Learning

Jilong Xue, Youshan Miao, Cheng Chen, Ming Wu, Lidong Zhou

14th USENIX Symposium on Networked Systems Design and Implementation (NSDI 17) | March 2017

ISBN: 978-1-931971-37-9

Publication Projet Projet

NeuGraph: Parallel Deep Neural Network Computation on Large Graphs

Lingxiao Ma, Zhi Yang, Youshan Miao, Jilong Xue, Ming Wu, Lidong Zhou, Yafei Dai

2019 USENIX Annual Technical Conference | July 2019

Publication Projet Projet

Cocktailer: Analyzing and Optimizing Dynamic Control Flow in Deep Learning

Chen Zhang, Lingxiao Ma, Jilong Xue, Yining Shi, Ziming Miao, Fan Yang, Jidong Zhai, Zhi Yang, Mao Yang

17th USENIX Symposium on Operating Systems Design and Implementation (OSDI’23) | July 2023

Publication Projet

Welder: Scheduling Deep Learning Memory Access via Tile-graph

Yining Shi, Zhi Yang, Jilong Xue, Lingxiao Ma, Yuqing Xia, Ziming Miao, Yuxiao Guo, Fan Yang, Lidong Zhou

17th USENIX Symposium on Operating Systems Design and Implementation (OSDI’23) | July 2023

Publication Projet

Efficient GPU Kernels for N:M-SPARSE Weights in Deep Learning

Bin Lin, Ningxin Zheng, Lei Wang, Shijie Cao, Lingxiao Ma, Quanlu Zhang, Yi Zhu, Ting Cao, Jilong Xue, Yuqing Yang, Fan Yang

Sixth Conference on Machine Learning and Systems (MLSys’23) | June 2023

Publication Projet

Tutel: Adaptive Mixture-of-Experts at Scale

Changho Hwang, Wei Cui, Yifan Xiong, Ziyue Yang, Ze Liu, Han Hu, Zilong Wang, Rafael Salas, Jithin Jose, Prabhat Ram, Joe Chau, Peng Cheng, Fan Yang, Mao Yang, Yongqiang Xiong

July 2022

Publication

SparTA: Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute

Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Yang Wang, Mao Yang, Lidong Zhou

OSDI 2022 | July 2022

Publication Projet Projet

Roller: Fast and Efficient Tensor Compilation for Deep Learning

Hongyu Zhu , Ruofan Wu , Yijia Diao , Shanbin Ke , Haoyu Li , Chen Zhang , Jilong Xue, Lingxiao Ma, Yuqing Xia, Wei Cui, Fan Yang, Mao Yang, Lidong Zhou, Asaf Cidon , Gennady Pekhimenko

The 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI’22) | July 2022

Publication Projet

Accelerating GNN training with locality-aware partial execution

Taehyun Kim, Changho Hwang, KyoungSoo Park, Zhiqi Lin, Peng Cheng, Youshan Miao, Lingxiao Ma, Yongqiang Xiong

August 2021

Publication

Rammer: Enabling Holistic Deep Learning Compiler Optimizations with rTasks

Lingxiao Ma, Zhiqiang Xie, Zhi Yang, Jilong Xue, Youshan Miao, Wei Cui, Wenxiang Hu, Fan Yang, Lintao Zhang, Lidong Zhou

14th USENIX Symposium on Operating Systems Design and Implementation (OSDI’20) | November 2020

Publication Projet

NeuGraph: Parallel Deep Neural Network Computation on Large Graphs

Lingxiao Ma, Zhi Yang, Youshan Miao, Jilong Xue, Ming Wu, Lidong Zhou, Yafei Dai

2019 USENIX Annual Technical Conference | July 2019

Publication Projet Projet

Fast Distributed Deep Learning over RDMA

Jilong Xue, Youshan Miao, Cheng Chen, Ming Wu, Lintao Zhang, Lidong Zhou

EuroSys | March 2019

Publication Projet

TuX2: Distributed Graph Computation for Machine Learning

Jilong Xue, Youshan Miao, Cheng Chen, Ming Wu, Lidong Zhou

14th USENIX Symposium on Networked Systems Design and Implementation (NSDI 17) | March 2017

ISBN: 978-1-931971-37-9

Publication Projet Projet

Distributed Graph Computation Meets Machine Learning

Wencong Xiao, Jilong Xue, Youshan Miao, Zhen Li, Cheng Chen, Ming Wu, Wei Li, Lidong Zhou

IEEE Transactions on Parallel and Distributed Systems | January 2020, Vol 31(7): pp. 1588-1604

Publication Projet