Scaling Deep Learning Computation over the Inter-Core Connected Intelligence Processor
Yiqi Liu, Yu Xue, Yu Cheng, Lingxiao Ma, Ziming Miao, Jilong Xue, Jian Huang
SOSP 2024 | August 2024
Jilong Xue
Principal Researcher/ Research Manager
Publications
Publications by Year
-
Ladder: Enabling Efficient Low-Precision Deep Learning Computing through Hardware-aware Tensor Transformation
Lei Wang, Lingxiao Ma, Shijie Cao, Quanlu Zhang, Jilong Xue, Yining Shi, Ningxin Zheng, Ziming Miao, Fan Yang, Ting Cao, Yuqing Yang, Mao Yang
OSDI 2024 | July 2024
The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits
Shuming Ma, Hongyu Wang, Lingxiao Ma, Lei Wang, Wenhui Wang, Shaohan Huang, Lifeng Dong, Ruiping Wang, Jilong Xue, Furu Wei
February 2024
Work in progress
-
Retentive Network: A Successor to Transformer for Large Language Models
Yutao Sun, Li Dong, Shaohan Huang, Shuming Ma, Yuqing Xia, Jilong Xue, Jianyong Wang, Furu Wei
August 2023
Cocktailer: Analyzing and Optimizing Dynamic Control Flow in Deep Learning
Chen Zhang, Lingxiao Ma, Jilong Xue, Yining Shi, Ziming Miao, Fan Yang, Jidong Zhai, Zhi Yang, Mao Yang
17th USENIX Symposium on Operating Systems Design and Implementation (OSDI'23) | July 2023
Optimizing Dynamic Neural Networks with Brainstorm
Weihao Cui, Zhenhua Han, Lingji Ouyang, Yichuan Wang, Ningxin Zheng, Lingxiao Ma, Yuqing Yang, Fan Yang, Jilong Xue, Lili Qiu, Lidong Zhou, Quan Chen, Haisheng Tan, Minyi Guo
OSDI'23 | July 2023
Welder: Scheduling Deep Learning Memory Access via Tile-graph
Yining Shi, Zhi Yang, Jilong Xue, Lingxiao Ma, Yuqing Xia, Ziming Miao, Yuxiao Guo, Fan Yang, Lidong Zhou
17th USENIX Symposium on Operating Systems Design and Implementation (OSDI'23) | July 2023
Efficient GPU Kernels for N:M-SPARSE Weights in Deep Learning
Bin Lin, Ningxin Zheng, Lei Wang, Shijie Cao, Lingxiao Ma, Quanlu Zhang, Yi Zhu, Ting Cao, Jilong Xue, Yuqing Yang, Fan Yang
Sixth Conference on Machine Learning and Systems (MLSys'23) | June 2023
-
Roller: Fast and Efficient Tensor Compilation for Deep Learning
Hongyu Zhu , Ruofan Wu , Yijia Diao , Shanbin Ke , Haoyu Li , Chen Zhang , Jilong Xue, Lingxiao Ma, Yuqing Xia, Wei Cui, Fan Yang, Mao Yang, Lidong Zhou, Asaf Cidon , Gennady Pekhimenko
The 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI'22) | July 2022
-
Rammer: Enabling Holistic Deep Learning Compiler Optimizations with rTasks
Lingxiao Ma, Zhiqiang Xie, Zhi Yang, Jilong Xue, Youshan Miao, Wei Cui, Wenxiang Hu, Fan Yang, Lintao Zhang, Lidong Zhou
14th USENIX Symposium on Operating Systems Design and Implementation (OSDI'20) | November 2020
Distributed Graph Computation Meets Machine Learning
Wencong Xiao, Jilong Xue, Youshan Miao, Zhen Li, Cheng Chen, Ming Wu, Wei Li, Lidong Zhou
IEEE Transactions on Parallel and Distributed Systems | January 2020, Vol 31(7): pp. 1588-1604
-
NeuGraph: Parallel Deep Neural Network Computation on Large Graphs
Lingxiao Ma, Zhi Yang, Youshan Miao, Jilong Xue, Ming Wu, Lidong Zhou, Yafei Dai
2019 USENIX Annual Technical Conference | July 2019
Fast Distributed Deep Learning over RDMA
Jilong Xue, Youshan Miao, Cheng Chen, Ming Wu, Lintao Zhang, Lidong Zhou
EuroSys | March 2019
-
TuX2: Distributed Graph Computation for Machine Learning
Jilong Xue, Youshan Miao, Cheng Chen, Ming Wu, Lidong Zhou
14th USENIX Symposium on Networked Systems Design and Implementation (NSDI 17) | March 2017
ISBN: 978-1-931971-37-9
Publications by Research Area
-
Scaling Deep Learning Computation over the Inter-Core Connected Intelligence Processor
Yiqi Liu, Yu Xue, Yu Cheng, Lingxiao Ma, Ziming Miao, Jilong Xue, Jian Huang
SOSP 2024 | August 2024
-
Scaling Deep Learning Computation over the Inter-Core Connected Intelligence Processor
Yiqi Liu, Yu Xue, Yu Cheng, Lingxiao Ma, Ziming Miao, Jilong Xue, Jian Huang
SOSP 2024 | August 2024
Ladder: Enabling Efficient Low-Precision Deep Learning Computing through Hardware-aware Tensor Transformation
Lei Wang, Lingxiao Ma, Shijie Cao, Quanlu Zhang, Jilong Xue, Yining Shi, Ningxin Zheng, Ziming Miao, Fan Yang, Ting Cao, Yuqing Yang, Mao Yang
OSDI 2024 | July 2024
Optimizing Dynamic Neural Networks with Brainstorm
Weihao Cui, Zhenhua Han, Lingji Ouyang, Yichuan Wang, Ningxin Zheng, Lingxiao Ma, Yuqing Yang, Fan Yang, Jilong Xue, Lili Qiu, Lidong Zhou, Quan Chen, Haisheng Tan, Minyi Guo
OSDI'23 | July 2023
Cocktailer: Analyzing and Optimizing Dynamic Control Flow in Deep Learning
Chen Zhang, Lingxiao Ma, Jilong Xue, Yining Shi, Ziming Miao, Fan Yang, Jidong Zhai, Zhi Yang, Mao Yang
17th USENIX Symposium on Operating Systems Design and Implementation (OSDI'23) | July 2023
Welder: Scheduling Deep Learning Memory Access via Tile-graph
Yining Shi, Zhi Yang, Jilong Xue, Lingxiao Ma, Yuqing Xia, Ziming Miao, Yuxiao Guo, Fan Yang, Lidong Zhou
17th USENIX Symposium on Operating Systems Design and Implementation (OSDI'23) | July 2023
Efficient GPU Kernels for N:M-SPARSE Weights in Deep Learning
Bin Lin, Ningxin Zheng, Lei Wang, Shijie Cao, Lingxiao Ma, Quanlu Zhang, Yi Zhu, Ting Cao, Jilong Xue, Yuqing Yang, Fan Yang
Sixth Conference on Machine Learning and Systems (MLSys'23) | June 2023
Roller: Fast and Efficient Tensor Compilation for Deep Learning
Hongyu Zhu , Ruofan Wu , Yijia Diao , Shanbin Ke , Haoyu Li , Chen Zhang , Jilong Xue, Lingxiao Ma, Yuqing Xia, Wei Cui, Fan Yang, Mao Yang, Lidong Zhou, Asaf Cidon , Gennady Pekhimenko
The 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI'22) | July 2022
Rammer: Enabling Holistic Deep Learning Compiler Optimizations with rTasks
Lingxiao Ma, Zhiqiang Xie, Zhi Yang, Jilong Xue, Youshan Miao, Wei Cui, Wenxiang Hu, Fan Yang, Lintao Zhang, Lidong Zhou
14th USENIX Symposium on Operating Systems Design and Implementation (OSDI'20) | November 2020
Distributed Graph Computation Meets Machine Learning
Wencong Xiao, Jilong Xue, Youshan Miao, Zhen Li, Cheng Chen, Ming Wu, Wei Li, Lidong Zhou
IEEE Transactions on Parallel and Distributed Systems | January 2020, Vol 31(7): pp. 1588-1604
NeuGraph: Parallel Deep Neural Network Computation on Large Graphs
Lingxiao Ma, Zhi Yang, Youshan Miao, Jilong Xue, Ming Wu, Lidong Zhou, Yafei Dai
2019 USENIX Annual Technical Conference | July 2019
Fast Distributed Deep Learning over RDMA
Jilong Xue, Youshan Miao, Cheng Chen, Ming Wu, Lintao Zhang, Lidong Zhou
EuroSys | March 2019
TuX2: Distributed Graph Computation for Machine Learning
Jilong Xue, Youshan Miao, Cheng Chen, Ming Wu, Lidong Zhou
14th USENIX Symposium on Networked Systems Design and Implementation (NSDI 17) | March 2017
ISBN: 978-1-931971-37-9
-
The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits
Shuming Ma, Hongyu Wang, Lingxiao Ma, Lei Wang, Wenhui Wang, Shaohan Huang, Lifeng Dong, Ruiping Wang, Jilong Xue, Furu Wei
February 2024
Work in progress
Retentive Network: A Successor to Transformer for Large Language Models
Yutao Sun, Li Dong, Shaohan Huang, Shuming Ma, Yuqing Xia, Jilong Xue, Jianyong Wang, Furu Wei
August 2023
NeuGraph: Parallel Deep Neural Network Computation on Large Graphs
Lingxiao Ma, Zhi Yang, Youshan Miao, Jilong Xue, Ming Wu, Lidong Zhou, Yafei Dai
2019 USENIX Annual Technical Conference | July 2019
Publications by Type
-
Scaling Deep Learning Computation over the Inter-Core Connected Intelligence Processor
Yiqi Liu, Yu Xue, Yu Cheng, Lingxiao Ma, Ziming Miao, Jilong Xue, Jian Huang
SOSP 2024 | August 2024
Ladder: Enabling Efficient Low-Precision Deep Learning Computing through Hardware-aware Tensor Transformation
Lei Wang, Lingxiao Ma, Shijie Cao, Quanlu Zhang, Jilong Xue, Yining Shi, Ningxin Zheng, Ziming Miao, Fan Yang, Ting Cao, Yuqing Yang, Mao Yang
OSDI 2024 | July 2024
Optimizing Dynamic Neural Networks with Brainstorm
Weihao Cui, Zhenhua Han, Lingji Ouyang, Yichuan Wang, Ningxin Zheng, Lingxiao Ma, Yuqing Yang, Fan Yang, Jilong Xue, Lili Qiu, Lidong Zhou, Quan Chen, Haisheng Tan, Minyi Guo
OSDI'23 | July 2023
Cocktailer: Analyzing and Optimizing Dynamic Control Flow in Deep Learning
Chen Zhang, Lingxiao Ma, Jilong Xue, Yining Shi, Ziming Miao, Fan Yang, Jidong Zhai, Zhi Yang, Mao Yang
17th USENIX Symposium on Operating Systems Design and Implementation (OSDI'23) | July 2023
Welder: Scheduling Deep Learning Memory Access via Tile-graph
Yining Shi, Zhi Yang, Jilong Xue, Lingxiao Ma, Yuqing Xia, Ziming Miao, Yuxiao Guo, Fan Yang, Lidong Zhou
17th USENIX Symposium on Operating Systems Design and Implementation (OSDI'23) | July 2023
Efficient GPU Kernels for N:M-SPARSE Weights in Deep Learning
Bin Lin, Ningxin Zheng, Lei Wang, Shijie Cao, Lingxiao Ma, Quanlu Zhang, Yi Zhu, Ting Cao, Jilong Xue, Yuqing Yang, Fan Yang
Sixth Conference on Machine Learning and Systems (MLSys'23) | June 2023
Roller: Fast and Efficient Tensor Compilation for Deep Learning
Hongyu Zhu , Ruofan Wu , Yijia Diao , Shanbin Ke , Haoyu Li , Chen Zhang , Jilong Xue, Lingxiao Ma, Yuqing Xia, Wei Cui, Fan Yang, Mao Yang, Lidong Zhou, Asaf Cidon , Gennady Pekhimenko
The 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI'22) | July 2022
Rammer: Enabling Holistic Deep Learning Compiler Optimizations with rTasks
Lingxiao Ma, Zhiqiang Xie, Zhi Yang, Jilong Xue, Youshan Miao, Wei Cui, Wenxiang Hu, Fan Yang, Lintao Zhang, Lidong Zhou
14th USENIX Symposium on Operating Systems Design and Implementation (OSDI'20) | November 2020
NeuGraph: Parallel Deep Neural Network Computation on Large Graphs
Lingxiao Ma, Zhi Yang, Youshan Miao, Jilong Xue, Ming Wu, Lidong Zhou, Yafei Dai
2019 USENIX Annual Technical Conference | July 2019
Fast Distributed Deep Learning over RDMA
Jilong Xue, Youshan Miao, Cheng Chen, Ming Wu, Lintao Zhang, Lidong Zhou
EuroSys | March 2019
TuX2: Distributed Graph Computation for Machine Learning
Jilong Xue, Youshan Miao, Cheng Chen, Ming Wu, Lidong Zhou
14th USENIX Symposium on Networked Systems Design and Implementation (NSDI 17) | March 2017
ISBN: 978-1-931971-37-9
-
The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits
Shuming Ma, Hongyu Wang, Lingxiao Ma, Lei Wang, Wenhui Wang, Shaohan Huang, Lifeng Dong, Ruiping Wang, Jilong Xue, Furu Wei
February 2024
Work in progress
Retentive Network: A Successor to Transformer for Large Language Models
Yutao Sun, Li Dong, Shaohan Huang, Shuming Ma, Yuqing Xia, Jilong Xue, Jianyong Wang, Furu Wei
August 2023
-
Distributed Graph Computation Meets Machine Learning
Wencong Xiao, Jilong Xue, Youshan Miao, Zhen Li, Cheng Chen, Ming Wu, Wei Li, Lidong Zhou
IEEE Transactions on Parallel and Distributed Systems | January 2020, Vol 31(7): pp. 1588-1604