MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attention

Huiqiang Jiang, Yucheng Li, Chengruidong Zhang, Qianhui Wu, Xufang Luo, Surin Ahn, Zhenhua Han, Amir H. Abdi, Dongsheng Li, Chin-Yew Lin, Yuqing Yang, Lili Qiu

July 2024

Preprint Github Project

Empowering In-Browser Deep Learning Inference on Edge Devices with Just-in-Time Kernel Optimizations

Fucheng Jia, Shiqi Jiang, Ting Cao, Wei Cui, Tianrui Xia, Xu Cao, Yuanchun Li, Qipeng Wang, Deyu Zhang, Ju Ren, Yunxin Liu, Lili Qiu, Mao Yang

the 22nd Annual International Conference on Mobile Systems, Applications and Services (MobiSys’24) | June 2024

Publication

Mitigate Position Bias in Large Language Models via Scaling a Single Dimension

Yijiong Yu, Huiqiang Jiang, Xufang Luo, Qianhui Wu, Chin-Yew Lin, Dongsheng Li, Yuqing Yang, Yongfeng Huang, Lili Qiu

June 2024

Preprint

Autodroid: LLM-Powered Task Automation in Android

Hao Wen, Yuanchun Li, Guohong Liu, Shanhui Zhao, Tao Yu, Toby Jia-Jun Li, Shiqi Jiang, Yunhao Liu, Yaqin Zhang, Yunxin Liu

the 30th Annual International Conference on Mobile Computing and Networking (MobiCom’24) | May 2024

Publication

Advancing Spiking Neural Networks for Sequential Modeling with Central Pattern Generators

Changze Lv, Dongqi Han, Yansen Wang, Xiaoqing Zheng, Xuanjing Huang, Dongsheng Li

May 2024

Publication

LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compression

Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Menglin Xia, Xufang Luo, Jue Zhang, Qingwei Lin 林庆维, Victor Ruehle, Yuqing Yang, Chin-Yew Lin, H. Vicky Zhao, Lili Qiu, Dongmei Zhang

The 62nd Annual Meeting of the Association for Computational Linguistics (Findings of ACL 2024) | March 2024

Preprint Project

LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Models

Huiqiang Jiang, Qianhui Wu, Chin-Yew Lin, Yuqing Yang, Lili Qiu

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP 2023) | December 2023

Publication Project

Large-scale Video Analytics with Cloud–Edge Collaborative Continuous Learning

Ya Nan, Shiqi Jiang, Mo Li

ACM Transactions on Sensor Network | October 2023, Vol 20(1): pp. 1-23

Publication

LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression

Huiqiang Jiang, Qianhui Wu, Xufang Luo, Dongsheng Li, Chin-Yew Lin, Yuqing Yang, Lili Qiu

The 62nd Annual Meeting of the Association for Computational Linguistics (ACL 2024) | October 2023

Preprint Project

Attentive Mask CLIP

Yifan Yang, Houwen Peng, Xinyang Jiang, Huiqiang Jiang, Yuqing Yang, Lili Qiu

2023 International Conference on Computer Vision | October 2023

Publication

ImageBrush: Learning Visual In-Context Instructions for Exemplar-Based Image Manipulation

Yasheng Sun, Yifan Yang, Houwen Peng, Yifei Shen, Yuqing Yang, Han Hu, Lili Qiu, Hideki Koike, Yuqing Yang

NeurIPS 2023 | October 2023

Publication

Accurate and Structured Pruning for Efficient Automatic Speech Recognition

Huiqiang Jiang, Li Lyna Zhang, Yuang Li, Yu Wu, Shijie Cao, Ting Cao, Yuqing Yang, Jinyu Li, Mao Yang, Lili Qiu

INTERSPEECH 2023 | August 2023

Publication

End-to-End Word-Level Pronunciation Assessment with MASK Pre-training

Yukang Liang, Kaitao Song, Shaoguang Mao, Huiqiang Jiang, Luna K. Qiu, Yuqing Yang, Dongsheng Li, Linli Xu, Lili Qiu

INTERSPEECH 2023 | August 2023

Publication

CoLaDa: A Collaborative Label Denoising Framework for Cross-lingual Named Entity Recognition

Tingting Ma, Qianhui Wu, Huiqiang Jiang, Börje F. Karlsson, Tiejun Zhao, Chin-Yew Lin

ACL 2023 | July 2023

Publication Project

Multi-Level Knowledge Distillation for Out-of-Distribution Detection in Text

Qianhui Wu, Huiqiang Jiang, Haonan Yin, Börje F. Karlsson, Chin-Yew Lin

The 61st Annual Meeting of the Association for Computational Linguistics (ACL 2023) | July 2023

Publication

A Hierarchical Regression Chain Framework for Affective Vocal Burst Recognition

Jinchao Li, Xixin Wu, Kaitao Song, Dongsheng Li, Xunying Liu, Helen Meng

ICASSP 2023 | June 2023

Publication

Leveraging Pretrained Representations with Task-related Keywords for Alzheimer’s Disease Detection

Jinchao Li, Kaitao Song, Junan Li, Bo Zheng, Dongsheng Li, Xixin Wu, Xunying Liu, Helen Meng

ICASSP 2023 | June 2023

Publication

Unsupervised Video Anomaly Detection for Stereotypical Behaviours in Autism

Jiaqi Gao, Xinyang Jiang, Yuqing Yang, Dongsheng Li, Lili Qiu

ICASSP 23 | June 2023

Author's Version

AdaptiveNet: Post-deployment Neural Architecture Adaptation for Diverse Edge Environments

Hao Wen, Yuanchun Li, Zunshuai Zhang, Shiqi Jiang, Xiaozhou Ye, Ye Ouyang, Ya-Qin Zhang, Yunxin Liu

The 29th Annual International Conference On Mobile Computing And Networking (MobiCom’23)) | May 2023

Publication

Data Continuity Matters: Improving Sequence Modeling with Lipschitz Regularizer

Eric Qu, Xufang Luo, Dongsheng Li

ICLR 23 | May 2023

Spotlight

Publication

EA-HAS-Bench: Energy-aware Hyperparameter and Architecture Search Benchmark

Shuguang Dou, Xinyang Jiang, Cairong Zhao, Dongsheng Li

ICLR 23 | May 2023

Spotlight

Publication

Over-parameterized Model Optimization with Polyak-{\L}ojasiewicz Condition

Yixuan Chen, Yubin Shi, Mingzhi Dong, Xiaochen Yang, Dongsheng Li, Yujiang Wang, Robert Dick, Qin Lv, Yingying Zhao, Fan Yang, Ning Gu, Li Shang

ICLR 23 | May 2023

Publication

SIMPLE: Specialized Model-Sample Matching for Domain Generalization

Ziyue Li, Kan Ren, Xinyang Jiang, Yifei Shen, Haipeng Zhang, Dongsheng Li

ICLR 23 | May 2023

Publication

Personalized Graph Signal Processing for Collaborative Filtering

Jiahao Liu, Dongsheng Li, Hansu Gu, Tun Lu, Peng Zhang, Li Shang, Ning Gu

WWW 23 | April 2023

Author's Version

Self-supervised Semi-implicit Graph Variational Auto-encoders with Masking

Xiang Li, Tiandi Ye, Caihua Shan, Dongsheng Li, Ming Gao

WWW 23 | April 2023

Author's Version

Learning Decomposed Spatial Relations for Multi-Variate Time-Series Modeling

Yuchen Fang, Kan Ren, Caihua Shan, Yifei Shen, You Li, Weinan Zhang, Yong Yu, Dongsheng Li

AAAI 2023 | February 2023

Publication

Similarity Distribution based Membership Inference Attack on Person Re-identification

Junyao Gao, Xinyang Jiang, Huishuai Zhang, Yifan Yang, Shuguang Dou, Dongsheng Li, Duoqian Miao, Cheng Deng, Cairong Zhao

AAAI 2023 | February 2023

Author's Version

Towards Inference Efficient Deep Ensemble Learning

Ziyue Li, Kan Ren, Yifan Yang, Xinyang Jiang, Yuqing Yang, Dongsheng Li

AAAI 23 | February 2023

Author's Version

Turbo: Opportunistic Enhancement for Edge Video Analytics

Yan Lu, Shiqi Jiang, Ting Cao, Yuanchao Shu

The 20th ACM Conference on Embedded Networked Sensor Systems (SenSys ’22) | November 2022

Publication

CMMD: Cross-Metric Multi-Dimensional Root Cause Analysis

Shifu Yan, Caihua Shan, Wenyi Yang, Bixiong Xu, Dongsheng Li, Lili Qiu, Jie Tong, Qi Zhang

KDD 2022 | August 2022

Publication

CLARE: A Semi-supervised Community Detection Algorithm

Xixi Wu, Yao Zhang, Yun Xiong, Yizhu Jiao, Caihua Shan, Yangyong Zhu, Philip S Yu

KDD 2022 | August 2022

Publication

Analyzing and Mitigating Interference in Neural Architecture Search

Jin Xu, Xu Tan, Kaitao Song, Renqian Luo, Yichong Leng, Tao Qin, Tie-Yan Liu, Sujian Li

ICML 2022 | July 2022

Publication

Finding Global Homophily in Graph Neural Networks When Meeting Heterophily

Xiang Li, Renyu Zhu, Yao Cheng, Caihua Shan, Siqiang Luo, Dongsheng Li, Weining Qian

ICML 2022 | July 2022

Publication

PilotFish: Harvesting Free Cycles of Cloud Gaming with Deep Learning Training

Wei Zhang , Binghao Chen, Zhenhua Han, Quan Chen, Peng Cheng, Fan Yang, Ran Shu, Yuqing Yang, Minyi Guo

2022 USENIX Annual Technical Conference | July 2022

PDF

SparTA: Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute

Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Yang Wang, Mao Yang, Lidong Zhou

OSDI 2022 | July 2022

Publication Project Project

Towards Applicable Reinforcement Learning: Improving the Generalization and Sample Efficiency with Policy Ensemble

Zhengyu Yang, Kan Ren, Xufang Luo, Minghuan Liu, Weiqing Liu, Jiang Bian, Weinan Zhang, Dongsheng Li

IJCAI 2022 | July 2022

Publication

Improving Hypernasality Estimation with Automatic Speech Recognition in Cleft Palate Speech

Kaitao Song, Teng Wan, Bixia Wang, Huiqiang Jiang, Luna K. Qiu, Jiahang Xu, Yuqing Yang, Liping Jiang, Qun Lou, Dongsheng Li, Xudong Wang, Lili Qiu

INTERSPEECH 2022 | June 2022

Publication

Mixed-phoneme bert: Improving bert with mixed phoneme and sup-phoneme representations for text to speech

Guangyan Zhang, Kaitao Song, Xu Tan, Daxin Tan, Yuzi Yan, Yanqing Liu, Gang Wang, Wei Zhou, Tao Qin, Tan Lee, Sheng Zhao

INTERSPEECH 2022 | June 2022

Publication

RendNet: Unified 2D/3D Recognizer With Latent Space Rendering

Ruoxi Shi, Xinyang Jiang, Caihua Shan, Yansen Wang, Dongsheng Li

CVPR 2022 | June 2022

Publication

Decomposed Meta-Learning for Few-Shot Named Entity Recognition

Tingting Ma, Huiqiang Jiang, Qianhui Wu, Tiejun Zhao, Chin-Yew Lin

60th Annual Meeting of the Association for Computational Linguistics (ACL 2022) | Findings | May 2022

Publication Project

Metabolic characterization of hypertrophic cardiomyopathy in human heart

Wenmin Wang, Jizheng Wang, Ke Yao, Shuiyun Wang, Meng Nie, Yizi Zhao, Bohong Wang, Huanhuan Pang, Jingjing Xu, Guixin Wu, Minjie Lu, Nan Tang, Chunmei Qi, Hengzhi Pei, Xufang Luo, Dongsheng Li, Tianshu Yang, Qing Sun, Xiang Wei, Yan Li, ingsheng Jiang, Peng Li, Lei Song, Zeping Hu

Nature Cardiovascular Research | May 2022, Vol 1: pp. 445-461

Publication

Privacy-preserving Online AutoML for Domain-Specific Face Detection

Chenqian Yan, Yuge Zhang, Quanlu Zhang, Yaming Yang, Xinyang Jiang, Yuqing Yang, Baoyuan Wang

CVPR 2022 | May 2022

Publication

Accurate and Explainable Recommendation via Review Rationalization

Sicheng Pan, Dongsheng Li, Hansu Gu, Tun Lu, Xufang Luo, Ning Gu

TheWebConf 2022 | April 2022

PDF DOI

Cross-Modal Ambiguity Learning for Multimodal Fake News Detection

Yixuan Chen, Dongsheng Li, Peng Zhang, Jie Sui, Qin Lv, Lu Tun, Li Shang

TheWebConf 2022 | April 2022

PDF DOI

FIRE: Fast Incremental Recommendation with Graph Signal Processing

Jiafeng Xia, Dongsheng Li, Hansu Gu, Jiahao Liu, Tun Lu, Ning Gu

TheWebConf 2022 | April 2022

PDF DOI

MINDSim: User Simulator for News Recommenders

Xufang Luo, Zheng Liu, Shitao Xiao, Xing Xie, Dongsheng Li

TheWebConf 2022 | April 2022

Publication

Recursive Disentanglement Network

Yixuan Chen, Yubin Shi, Dongsheng Li, Yujiang Wang, Mingzhi Dong, Yingying Zhao, Robert Dick, Qin Lv, Fan Yang, Li Shang

ICLR 2022 | April 2022

Publication

Variational oracle guiding for reinforcement learning

Dongqi Han, Tadashi Kozuno, Xufang Luo, Zhao-Yun Chen, Kenji Doya, Yuqing Yang, Dongsheng Li

ICLR 2022 | April 2022

Publication

Astraea: towards QoS-aware and resource-efficient multi-stage GPU services

Wei Zhang, Quan Chen, Kaihua Fu, Ningxin Zheng, Zhiyi Huang, Jingwen Leng, Minyi Guo

ASPLOS 2022 | February 2022

Publication

Invariant Information Bottleneck for Domain Generalization

Bo Li, Yifei Shen, Yezhen Wang, Wenzhen Zhu, Colorado J Reed, Dongsheng Li, Kurt Keutzer, Han Zhao

AAAI 2022 | February 2022

Publication

Neural Piecewise-Constant Delay Differential Equations

Qunxi Zhu, Yifei Shen, Dongsheng Li, Wei Lin

AAAI 2022 | February 2022

Publication

Recognizing Vector Graphics without Rasterization

Xinyang Jiang, Lu Liu, Caihua Shan, Yifei Shen, Xuanyi Dong, Dongsheng Li

NeurIPS 2021 | December 2021

Publication

Reinforcement Learning Enhanced Explainer for Graph Neural Networks

Caihua Shan, Yifei Shen, Yao Zhang, Xiang Li, Dongsheng Li

NeurIPS 2021 | December 2021

Publication

Towards Generating Real-World Time Series Data

Hengzhi Pei, Kan Ren, Yuqing Yang, Chang Liu, Tao Qin, Dongsheng Li

ICDM 21 | November 2021

Publication Publication Publication

CoPE: Modeling Continuous Propagation and Evolution on Interaction Graph

Yao Zhang, Yun Xiong, Dongsheng Li, Caihua Shan, Kan Ren, Yangyong Zhu

2021 Conference on Information and Knowledge Management | October 2021

DOI PDF Publication

How Powerful is Graph Convolution for Recommendation

Yifei Shen, Yongji Wu, Yao Zhang, Caihua Shan, Jun Zhang, B. Khaled Letaief, Dongsheng Li

2021 Conference on Information and Knowledge Management | October 2021

DOI Publication Publication Publication Publication

Incremental Graph Convolutional Network for Collaborative Filtering

Jiafeng Xia, Dongsheng Li, Hansu Gu, Tun Lu, Peng Zhang, Ning Gu

2021 Conference on Information and Knowledge Management | October 2021

DOI Publication Publication

Energy-Based Open-World Uncertainty Modeling for Confidence Calibration

Yezhen Wang, Bo Li, Tong Che, Kaiyang Zhou, Ziwei Liu, Dongsheng Li

ICCV 2021 | October 2021

Publication

Predicting the effect of confinement on the COVID-19 spread using machine learning enriched with satellite air pollution observations.

Xiaofan Xing, Yuankang Xiong, Ruipu Yang, Rong Wang, Weibing Wang, Haidong Kan, Tun Lu, Dongsheng Li, Junji Cao, Josep Peñuelas, Philippe Ciais, Nico Bauer, Olivier Boucher, Yves Balkanski, Didier Hauglustaine, Guy Brasseur, Lidia Morawska, Ivan A Janssens, Xiangrong Wang, Jordi Sardans, Yijing Wang, Yifei Deng, Lin Wang, Jianmin Chen, Xu Tang, Renhe Zhang

Proceedings of the National Academy of Sciences of the United States of America | August 2021, Vol 118(33)

DOI Publication Publication Publication Publication Publication Publication Project

CHARM: Collaborative Host and Accelerator Resource Management for GPU Datacenters

Wei Zhang, Kaihua Fu, Ningxin Zheng, Quan Chen, Chao Li, Wenli Zheng, Minyi Guo

ICCD 2021 | July 2021

Publication

Enable simultaneous DNN services based on deterministic operator overlap and precise latency prediction.

Weihao Cui, Han Zhao, Quan Chen, Ningxin Zheng, Jingwen Leng, Jieru Zhao, Zhuo Song, Tao Ma, Yong Yang, Chao Li, Minyi Guo

SC 2021 | July 2021

Publication

nn-Meter: Towards Accurate Latency Prediction of Deep-Learning Model Inference on Diverse Edge Devices

Li Lyna Zhang, Shihao Han, Jianyu Wei, Ningxin Zheng, Ting Cao, Yuqing Yang, Yunxin Liu

The 19th ACM International Conference on Mobile Systems, Applications, and Services (MobiSys’21) | June 2021

Best Paper Award

Publication

Scalable and Explainable 1-Bit Matrix Completion via Graph Signal Learning

Chao Chen, Dongsheng Li, Junchi Yan, Hanchi Huang, Xiaokang Yang

Thirty-Fifth AAAI Conference on Artificial Intelligence | May 2021

Publication Publication

A Reinforcement-Learning-based Energy-Efficient Framework for Multi-Task Video Analytics Pipeline

Yingying Zhao, Mingzhi Dong, Yujiang Wang, Da Feng, Qin Lv, Robert P. Dick, Dongsheng Li, Tun Lu, Ning Gu, Li Shang

IEEE Transactions on Multimedia | April 2021

DOI Publication Publication

Towards QoS-awareness and Improved Utilization of Spatial Multitasking GPUs

Wei Zhang, Quan Chen, Ningxin Zheng, Weihao Cui, Kaihua Fu, Minyi Guo

IEEE Transactions on Computers | March 2021, pp. 1-1

DOI Publication

Modeling Dynamic User Preference via Dictionary Learning for Sequential Recommendation

Chao Chen, Dongsheng Li, Junchi Yan, Xiaokang Yang

IEEE Transactions on Knowledge and Data Engineering | January 2021, (01): pp. 1-1

DOI Publication

HiveD: Sharing a GPU Cluster for Deep Learning with Guarantees

Hanyu Zhao, Zhenhua Han, Zhi Yang, Quanlu Zhang, Fan Yang, Lidong Zhou, Mao Yang, Yuqi Wang, Yifan Xiong, Bin Wang

2020 Operating Systems Design and Implementation | November 2020

Publication Project

Retiarii: A Deep Learning Exploratory-Training Framework

Quanlu Zhang, Zhenhua Han, Fan Yang, Yuge Zhang, Zhe Liu, Mao Yang, Lidong Zhou

2020 Operating Systems Design and Implementation | November 2020

Publication Video

MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attention

Huiqiang Jiang, Yucheng Li, Chengruidong Zhang, Qianhui Wu, Xufang Luo, Surin Ahn, Zhenhua Han, Amir H. Abdi, Dongsheng Li, Chin-Yew Lin, Yuqing Yang, Lili Qiu

July 2024

Preprint Github Project

Empowering In-Browser Deep Learning Inference on Edge Devices with Just-in-Time Kernel Optimizations

Fucheng Jia, Shiqi Jiang, Ting Cao, Wei Cui, Tianrui Xia, Xu Cao, Yuanchun Li, Qipeng Wang, Deyu Zhang, Ju Ren, Yunxin Liu, Lili Qiu, Mao Yang

the 22nd Annual International Conference on Mobile Systems, Applications and Services (MobiSys’24) | June 2024

Publication

Mitigate Position Bias in Large Language Models via Scaling a Single Dimension

Yijiong Yu, Huiqiang Jiang, Xufang Luo, Qianhui Wu, Chin-Yew Lin, Dongsheng Li, Yuqing Yang, Yongfeng Huang, Lili Qiu

June 2024

Preprint

Autodroid: LLM-Powered Task Automation in Android

Hao Wen, Yuanchun Li, Guohong Liu, Shanhui Zhao, Tao Yu, Toby Jia-Jun Li, Shiqi Jiang, Yunhao Liu, Yaqin Zhang, Yunxin Liu

the 30th Annual International Conference on Mobile Computing and Networking (MobiCom’24) | May 2024

Publication

Advancing Spiking Neural Networks for Sequential Modeling with Central Pattern Generators

Changze Lv, Dongqi Han, Yansen Wang, Xiaoqing Zheng, Xuanjing Huang, Dongsheng Li

May 2024

Publication

LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compression

Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Menglin Xia, Xufang Luo, Jue Zhang, Qingwei Lin 林庆维, Victor Ruehle, Yuqing Yang, Chin-Yew Lin, H. Vicky Zhao, Lili Qiu, Dongmei Zhang

The 62nd Annual Meeting of the Association for Computational Linguistics (Findings of ACL 2024) | March 2024

Preprint Project

LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Models

Huiqiang Jiang, Qianhui Wu, Chin-Yew Lin, Yuqing Yang, Lili Qiu

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP 2023) | December 2023

Publication Project

Large-scale Video Analytics with Cloud–Edge Collaborative Continuous Learning

Ya Nan, Shiqi Jiang, Mo Li

ACM Transactions on Sensor Network | October 2023, Vol 20(1): pp. 1-23

Publication

LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression

Huiqiang Jiang, Qianhui Wu, Xufang Luo, Dongsheng Li, Chin-Yew Lin, Yuqing Yang, Lili Qiu

The 62nd Annual Meeting of the Association for Computational Linguistics (ACL 2024) | October 2023

Preprint Project

Attentive Mask CLIP

Yifan Yang, Houwen Peng, Xinyang Jiang, Huiqiang Jiang, Yuqing Yang, Lili Qiu

2023 International Conference on Computer Vision | October 2023

Publication

ImageBrush: Learning Visual In-Context Instructions for Exemplar-Based Image Manipulation

Yasheng Sun, Yifan Yang, Houwen Peng, Yifei Shen, Yuqing Yang, Han Hu, Lili Qiu, Hideki Koike, Yuqing Yang

NeurIPS 2023 | October 2023

Publication

End-to-End Word-Level Pronunciation Assessment with MASK Pre-training

Yukang Liang, Kaitao Song, Shaoguang Mao, Huiqiang Jiang, Luna K. Qiu, Yuqing Yang, Dongsheng Li, Linli Xu, Lili Qiu

INTERSPEECH 2023 | August 2023

Publication

Accurate and Structured Pruning for Efficient Automatic Speech Recognition

Huiqiang Jiang, Li Lyna Zhang, Yuang Li, Yu Wu, Shijie Cao, Ting Cao, Yuqing Yang, Jinyu Li, Mao Yang, Lili Qiu

INTERSPEECH 2023 | August 2023

Publication

CoLaDa: A Collaborative Label Denoising Framework for Cross-lingual Named Entity Recognition

Tingting Ma, Qianhui Wu, Huiqiang Jiang, Börje F. Karlsson, Tiejun Zhao, Chin-Yew Lin

ACL 2023 | July 2023

Publication Project

Multi-Level Knowledge Distillation for Out-of-Distribution Detection in Text

Qianhui Wu, Huiqiang Jiang, Haonan Yin, Börje F. Karlsson, Chin-Yew Lin

The 61st Annual Meeting of the Association for Computational Linguistics (ACL 2023) | July 2023

Publication

Unsupervised Video Anomaly Detection for Stereotypical Behaviours in Autism

Jiaqi Gao, Xinyang Jiang, Yuqing Yang, Dongsheng Li, Lili Qiu

ICASSP 23 | June 2023

Author's Version

EA-HAS-Bench: Energy-aware Hyperparameter and Architecture Search Benchmark

Shuguang Dou, Xinyang Jiang, Cairong Zhao, Dongsheng Li

ICLR 23 | May 2023

Spotlight

Publication

SIMPLE: Specialized Model-Sample Matching for Domain Generalization

Ziyue Li, Kan Ren, Xinyang Jiang, Yifei Shen, Haipeng Zhang, Dongsheng Li

ICLR 23 | May 2023

Publication

Over-parameterized Model Optimization with Polyak-{\L}ojasiewicz Condition

Yixuan Chen, Yubin Shi, Mingzhi Dong, Xiaochen Yang, Dongsheng Li, Yujiang Wang, Robert Dick, Qin Lv, Yingying Zhao, Fan Yang, Ning Gu, Li Shang

ICLR 23 | May 2023

Publication

Data Continuity Matters: Improving Sequence Modeling with Lipschitz Regularizer

Eric Qu, Xufang Luo, Dongsheng Li

ICLR 23 | May 2023

Spotlight

Publication

AdaptiveNet: Post-deployment Neural Architecture Adaptation for Diverse Edge Environments

Hao Wen, Yuanchun Li, Zunshuai Zhang, Shiqi Jiang, Xiaozhou Ye, Ye Ouyang, Ya-Qin Zhang, Yunxin Liu

The 29th Annual International Conference On Mobile Computing And Networking (MobiCom’23)) | May 2023

Publication

Self-supervised Semi-implicit Graph Variational Auto-encoders with Masking

Xiang Li, Tiandi Ye, Caihua Shan, Dongsheng Li, Ming Gao

WWW 23 | April 2023

Author's Version

Personalized Graph Signal Processing for Collaborative Filtering

Jiahao Liu, Dongsheng Li, Hansu Gu, Tun Lu, Peng Zhang, Li Shang, Ning Gu

WWW 23 | April 2023

Author's Version

Towards Inference Efficient Deep Ensemble Learning

Ziyue Li, Kan Ren, Yifan Yang, Xinyang Jiang, Yuqing Yang, Dongsheng Li

AAAI 23 | February 2023

Author's Version

Similarity Distribution based Membership Inference Attack on Person Re-identification

Junyao Gao, Xinyang Jiang, Huishuai Zhang, Yifan Yang, Shuguang Dou, Dongsheng Li, Duoqian Miao, Cheng Deng, Cairong Zhao

AAAI 2023 | February 2023

Author's Version

Learning Decomposed Spatial Relations for Multi-Variate Time-Series Modeling

Yuchen Fang, Kan Ren, Caihua Shan, Yifei Shen, You Li, Weinan Zhang, Yong Yu, Dongsheng Li

AAAI 2023 | February 2023

Publication

Turbo: Opportunistic Enhancement for Edge Video Analytics

Yan Lu, Shiqi Jiang, Ting Cao, Yuanchao Shu

The 20th ACM Conference on Embedded Networked Sensor Systems (SenSys ’22) | November 2022

Publication

CMMD: Cross-Metric Multi-Dimensional Root Cause Analysis

Shifu Yan, Caihua Shan, Wenyi Yang, Bixiong Xu, Dongsheng Li, Lili Qiu, Jie Tong, Qi Zhang

KDD 2022 | August 2022

Publication

Finding Global Homophily in Graph Neural Networks When Meeting Heterophily

Xiang Li, Renyu Zhu, Yao Cheng, Caihua Shan, Siqiang Luo, Dongsheng Li, Weining Qian

ICML 2022 | July 2022

Publication

Analyzing and Mitigating Interference in Neural Architecture Search

Jin Xu, Xu Tan, Kaitao Song, Renqian Luo, Yichong Leng, Tao Qin, Tie-Yan Liu, Sujian Li

ICML 2022 | July 2022

Publication

Towards Applicable Reinforcement Learning: Improving the Generalization and Sample Efficiency with Policy Ensemble

Zhengyu Yang, Kan Ren, Xufang Luo, Minghuan Liu, Weiqing Liu, Jiang Bian, Weinan Zhang, Dongsheng Li

IJCAI 2022 | July 2022

Publication

Metabolic characterization of hypertrophic cardiomyopathy in human heart

Wenmin Wang, Jizheng Wang, Ke Yao, Shuiyun Wang, Meng Nie, Yizi Zhao, Bohong Wang, Huanhuan Pang, Jingjing Xu, Guixin Wu, Minjie Lu, Nan Tang, Chunmei Qi, Hengzhi Pei, Xufang Luo, Dongsheng Li, Tianshu Yang, Qing Sun, Xiang Wei, Yan Li, ingsheng Jiang, Peng Li, Lei Song, Zeping Hu

Nature Cardiovascular Research | May 2022, Vol 1: pp. 445-461

Publication

Decomposed Meta-Learning for Few-Shot Named Entity Recognition

Tingting Ma, Huiqiang Jiang, Qianhui Wu, Tiejun Zhao, Chin-Yew Lin

60th Annual Meeting of the Association for Computational Linguistics (ACL 2022) | Findings | May 2022

Publication Project

Variational oracle guiding for reinforcement learning

Dongqi Han, Tadashi Kozuno, Xufang Luo, Zhao-Yun Chen, Kenji Doya, Yuqing Yang, Dongsheng Li

ICLR 2022 | April 2022

Publication

Recursive Disentanglement Network

Yixuan Chen, Yubin Shi, Dongsheng Li, Yujiang Wang, Mingzhi Dong, Yingying Zhao, Robert Dick, Qin Lv, Fan Yang, Li Shang

ICLR 2022 | April 2022

Publication

Astraea: towards QoS-aware and resource-efficient multi-stage GPU services

Wei Zhang, Quan Chen, Kaihua Fu, Ningxin Zheng, Zhiyi Huang, Jingwen Leng, Minyi Guo

ASPLOS 2022 | February 2022

Publication

Neural Piecewise-Constant Delay Differential Equations

Qunxi Zhu, Yifei Shen, Dongsheng Li, Wei Lin

AAAI 2022 | February 2022

Publication

Invariant Information Bottleneck for Domain Generalization

Bo Li, Yifei Shen, Yezhen Wang, Wenzhen Zhu, Colorado J Reed, Dongsheng Li, Kurt Keutzer, Han Zhao

AAAI 2022 | February 2022

Publication

Reinforcement Learning Enhanced Explainer for Graph Neural Networks

Caihua Shan, Yifei Shen, Yao Zhang, Xiang Li, Dongsheng Li

NeurIPS 2021 | December 2021

Publication

Predicting the effect of confinement on the COVID-19 spread using machine learning enriched with satellite air pollution observations.

Xiaofan Xing, Yuankang Xiong, Ruipu Yang, Rong Wang, Weibing Wang, Haidong Kan, Tun Lu, Dongsheng Li, Junji Cao, Josep Peñuelas, Philippe Ciais, Nico Bauer, Olivier Boucher, Yves Balkanski, Didier Hauglustaine, Guy Brasseur, Lidia Morawska, Ivan A Janssens, Xiangrong Wang, Jordi Sardans, Yijing Wang, Yifei Deng, Lin Wang, Jianmin Chen, Xu Tang, Renhe Zhang

Proceedings of the National Academy of Sciences of the United States of America | August 2021, Vol 118(33)

DOI Publication Publication Publication Publication Publication Publication Project

CHARM: Collaborative Host and Accelerator Resource Management for GPU Datacenters

Wei Zhang, Kaihua Fu, Ningxin Zheng, Quan Chen, Chao Li, Wenli Zheng, Minyi Guo

ICCD 2021 | July 2021

Publication

Enable simultaneous DNN services based on deterministic operator overlap and precise latency prediction.

Weihao Cui, Han Zhao, Quan Chen, Ningxin Zheng, Jingwen Leng, Jieru Zhao, Zhuo Song, Tao Ma, Yong Yang, Chao Li, Minyi Guo

SC 2021 | July 2021

Publication

nn-Meter: Towards Accurate Latency Prediction of Deep-Learning Model Inference on Diverse Edge Devices

Li Lyna Zhang, Shihao Han, Jianyu Wei, Ningxin Zheng, Ting Cao, Yuqing Yang, Yunxin Liu

The 19th ACM International Conference on Mobile Systems, Applications, and Services (MobiSys’21) | June 2021

Best Paper Award

Publication

MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attention

Huiqiang Jiang, Yucheng Li, Chengruidong Zhang, Qianhui Wu, Xufang Luo, Surin Ahn, Zhenhua Han, Amir H. Abdi, Dongsheng Li, Chin-Yew Lin, Yuqing Yang, Lili Qiu

July 2024

Preprint Github Project

Empowering In-Browser Deep Learning Inference on Edge Devices with Just-in-Time Kernel Optimizations

Fucheng Jia, Shiqi Jiang, Ting Cao, Wei Cui, Tianrui Xia, Xu Cao, Yuanchun Li, Qipeng Wang, Deyu Zhang, Ju Ren, Yunxin Liu, Lili Qiu, Mao Yang

the 22nd Annual International Conference on Mobile Systems, Applications and Services (MobiSys’24) | June 2024

Publication

Autodroid: LLM-Powered Task Automation in Android

Hao Wen, Yuanchun Li, Guohong Liu, Shanhui Zhao, Tao Yu, Toby Jia-Jun Li, Shiqi Jiang, Yunhao Liu, Yaqin Zhang, Yunxin Liu

the 30th Annual International Conference on Mobile Computing and Networking (MobiCom’24) | May 2024

Publication

Large-scale Video Analytics with Cloud–Edge Collaborative Continuous Learning

Ya Nan, Shiqi Jiang, Mo Li

ACM Transactions on Sensor Network | October 2023, Vol 20(1): pp. 1-23

Publication

AdaptiveNet: Post-deployment Neural Architecture Adaptation for Diverse Edge Environments

Hao Wen, Yuanchun Li, Zunshuai Zhang, Shiqi Jiang, Xiaozhou Ye, Ye Ouyang, Ya-Qin Zhang, Yunxin Liu

The 29th Annual International Conference On Mobile Computing And Networking (MobiCom’23)) | May 2023

Publication

Turbo: Opportunistic Enhancement for Edge Video Analytics

Yan Lu, Shiqi Jiang, Ting Cao, Yuanchao Shu

The 20th ACM Conference on Embedded Networked Sensor Systems (SenSys ’22) | November 2022

Publication

PilotFish: Harvesting Free Cycles of Cloud Gaming with Deep Learning Training

Wei Zhang , Binghao Chen, Zhenhua Han, Quan Chen, Peng Cheng, Fan Yang, Ran Shu, Yuqing Yang, Minyi Guo

2022 USENIX Annual Technical Conference | July 2022

PDF

SparTA: Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute

Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Yang Wang, Mao Yang, Lidong Zhou

OSDI 2022 | July 2022

Publication Project Project

Astraea: towards QoS-aware and resource-efficient multi-stage GPU services

Wei Zhang, Quan Chen, Kaihua Fu, Ningxin Zheng, Zhiyi Huang, Jingwen Leng, Minyi Guo

ASPLOS 2022 | February 2022

Publication

CHARM: Collaborative Host and Accelerator Resource Management for GPU Datacenters

Wei Zhang, Kaihua Fu, Ningxin Zheng, Quan Chen, Chao Li, Wenli Zheng, Minyi Guo

ICCD 2021 | July 2021

Publication

nn-Meter: Towards Accurate Latency Prediction of Deep-Learning Model Inference on Diverse Edge Devices

Li Lyna Zhang, Shihao Han, Jianyu Wei, Ningxin Zheng, Ting Cao, Yuqing Yang, Yunxin Liu

The 19th ACM International Conference on Mobile Systems, Applications, and Services (MobiSys’21) | June 2021

Best Paper Award

Publication

Towards QoS-awareness and Improved Utilization of Spatial Multitasking GPUs

Wei Zhang, Quan Chen, Ningxin Zheng, Weihao Cui, Kaihua Fu, Minyi Guo

IEEE Transactions on Computers | March 2021, pp. 1-1

DOI Publication

HiveD: Sharing a GPU Cluster for Deep Learning with Guarantees

Hanyu Zhao, Zhenhua Han, Zhi Yang, Quanlu Zhang, Fan Yang, Lidong Zhou, Mao Yang, Yuqi Wang, Yifan Xiong, Bin Wang

2020 Operating Systems Design and Implementation | November 2020

Publication Project

Retiarii: A Deep Learning Exploratory-Training Framework

Quanlu Zhang, Zhenhua Han, Fan Yang, Yuge Zhang, Zhe Liu, Mao Yang, Lidong Zhou

2020 Operating Systems Design and Implementation | November 2020

Publication Video

MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attention

Huiqiang Jiang, Yucheng Li, Chengruidong Zhang, Qianhui Wu, Xufang Luo, Surin Ahn, Zhenhua Han, Amir H. Abdi, Dongsheng Li, Chin-Yew Lin, Yuqing Yang, Lili Qiu

July 2024

Preprint Github Project

Mitigate Position Bias in Large Language Models via Scaling a Single Dimension

Yijiong Yu, Huiqiang Jiang, Xufang Luo, Qianhui Wu, Chin-Yew Lin, Dongsheng Li, Yuqing Yang, Yongfeng Huang, Lili Qiu

June 2024

Preprint

LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compression

Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Menglin Xia, Xufang Luo, Jue Zhang, Qingwei Lin 林庆维, Victor Ruehle, Yuqing Yang, Chin-Yew Lin, H. Vicky Zhao, Lili Qiu, Dongmei Zhang

The 62nd Annual Meeting of the Association for Computational Linguistics (Findings of ACL 2024) | March 2024

Preprint Project

LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Models

Huiqiang Jiang, Qianhui Wu, Chin-Yew Lin, Yuqing Yang, Lili Qiu

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP 2023) | December 2023

Publication Project

LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression

Huiqiang Jiang, Qianhui Wu, Xufang Luo, Dongsheng Li, Chin-Yew Lin, Yuqing Yang, Lili Qiu

The 62nd Annual Meeting of the Association for Computational Linguistics (ACL 2024) | October 2023

Preprint Project

Accurate and Structured Pruning for Efficient Automatic Speech Recognition

Huiqiang Jiang, Li Lyna Zhang, Yuang Li, Yu Wu, Shijie Cao, Ting Cao, Yuqing Yang, Jinyu Li, Mao Yang, Lili Qiu

INTERSPEECH 2023 | August 2023

Publication

CoLaDa: A Collaborative Label Denoising Framework for Cross-lingual Named Entity Recognition

Tingting Ma, Qianhui Wu, Huiqiang Jiang, Börje F. Karlsson, Tiejun Zhao, Chin-Yew Lin

ACL 2023 | July 2023

Publication Project

Multi-Level Knowledge Distillation for Out-of-Distribution Detection in Text

Qianhui Wu, Huiqiang Jiang, Haonan Yin, Börje F. Karlsson, Chin-Yew Lin

The 61st Annual Meeting of the Association for Computational Linguistics (ACL 2023) | July 2023

Publication

Decomposed Meta-Learning for Few-Shot Named Entity Recognition

Tingting Ma, Huiqiang Jiang, Qianhui Wu, Tiejun Zhao, Chin-Yew Lin

60th Annual Meeting of the Association for Computational Linguistics (ACL 2022) | Findings | May 2022

Publication Project

Unsupervised Video Anomaly Detection for Stereotypical Behaviours in Autism

Jiaqi Gao, Xinyang Jiang, Yuqing Yang, Dongsheng Li, Lili Qiu

ICASSP 23 | June 2023

Author's Version

Improving Hypernasality Estimation with Automatic Speech Recognition in Cleft Palate Speech

Kaitao Song, Teng Wan, Bixia Wang, Huiqiang Jiang, Luna K. Qiu, Jiahang Xu, Yuqing Yang, Liping Jiang, Qun Lou, Dongsheng Li, Xudong Wang, Lili Qiu

INTERSPEECH 2022 | June 2022

Publication

Metabolic characterization of hypertrophic cardiomyopathy in human heart

Wenmin Wang, Jizheng Wang, Ke Yao, Shuiyun Wang, Meng Nie, Yizi Zhao, Bohong Wang, Huanhuan Pang, Jingjing Xu, Guixin Wu, Minjie Lu, Nan Tang, Chunmei Qi, Hengzhi Pei, Xufang Luo, Dongsheng Li, Tianshu Yang, Qing Sun, Xiang Wei, Yan Li, ingsheng Jiang, Peng Li, Lei Song, Zeping Hu

Nature Cardiovascular Research | May 2022, Vol 1: pp. 445-461

Publication

SIMPLE: Specialized Model-Sample Matching for Domain Generalization

Ziyue Li, Kan Ren, Xinyang Jiang, Yifei Shen, Haipeng Zhang, Dongsheng Li

ICLR 23 | May 2023

Publication

Over-parameterized Model Optimization with Polyak-{\L}ojasiewicz Condition

Yixuan Chen, Yubin Shi, Mingzhi Dong, Xiaochen Yang, Dongsheng Li, Yujiang Wang, Robert Dick, Qin Lv, Yingying Zhao, Fan Yang, Ning Gu, Li Shang

ICLR 23 | May 2023

Publication

Data Continuity Matters: Improving Sequence Modeling with Lipschitz Regularizer

Eric Qu, Xufang Luo, Dongsheng Li

ICLR 23 | May 2023

Spotlight

Publication

Self-supervised Semi-implicit Graph Variational Auto-encoders with Masking

Xiang Li, Tiandi Ye, Caihua Shan, Dongsheng Li, Ming Gao

WWW 23 | April 2023

Author's Version

Personalized Graph Signal Processing for Collaborative Filtering

Jiahao Liu, Dongsheng Li, Hansu Gu, Tun Lu, Peng Zhang, Li Shang, Ning Gu

WWW 23 | April 2023

Author's Version

Towards Inference Efficient Deep Ensemble Learning

Ziyue Li, Kan Ren, Yifan Yang, Xinyang Jiang, Yuqing Yang, Dongsheng Li

AAAI 23 | February 2023

Author's Version

CLARE: A Semi-supervised Community Detection Algorithm

Xixi Wu, Yao Zhang, Yun Xiong, Yizhu Jiao, Caihua Shan, Yangyong Zhu, Philip S Yu

KDD 2022 | August 2022

Publication

Towards Generating Real-World Time Series Data

Hengzhi Pei, Kan Ren, Yuqing Yang, Chang Liu, Tao Qin, Dongsheng Li

ICDM 21 | November 2021

Publication Publication Publication

How Powerful is Graph Convolution for Recommendation

Yifei Shen, Yongji Wu, Yao Zhang, Caihua Shan, Jun Zhang, B. Khaled Letaief, Dongsheng Li

2021 Conference on Information and Knowledge Management | October 2021

DOI Publication Publication Publication Publication

Incremental Graph Convolutional Network for Collaborative Filtering

Jiafeng Xia, Dongsheng Li, Hansu Gu, Tun Lu, Peng Zhang, Ning Gu

2021 Conference on Information and Knowledge Management | October 2021

DOI Publication Publication

CoPE: Modeling Continuous Propagation and Evolution on Interaction Graph

Yao Zhang, Yun Xiong, Dongsheng Li, Caihua Shan, Kan Ren, Yangyong Zhu

2021 Conference on Information and Knowledge Management | October 2021

DOI PDF Publication

Scalable and Explainable 1-Bit Matrix Completion via Graph Signal Learning

Chao Chen, Dongsheng Li, Junchi Yan, Hanchi Huang, Xiaokang Yang

Thirty-Fifth AAAI Conference on Artificial Intelligence | May 2021

Publication Publication

A Reinforcement-Learning-based Energy-Efficient Framework for Multi-Task Video Analytics Pipeline

Yingying Zhao, Mingzhi Dong, Yujiang Wang, Da Feng, Qin Lv, Robert P. Dick, Dongsheng Li, Tun Lu, Ning Gu, Li Shang

IEEE Transactions on Multimedia | April 2021

DOI Publication Publication

Modeling Dynamic User Preference via Dictionary Learning for Sequential Recommendation

Chao Chen, Dongsheng Li, Junchi Yan, Xiaokang Yang

IEEE Transactions on Knowledge and Data Engineering | January 2021, (01): pp. 1-1

DOI Publication

EA-HAS-Bench: Energy-aware Hyperparameter and Architecture Search Benchmark

Shuguang Dou, Xinyang Jiang, Cairong Zhao, Dongsheng Li

ICLR 23 | May 2023

Spotlight

Publication

Similarity Distribution based Membership Inference Attack on Person Re-identification

Junyao Gao, Xinyang Jiang, Huishuai Zhang, Yifan Yang, Shuguang Dou, Dongsheng Li, Duoqian Miao, Cheng Deng, Cairong Zhao

AAAI 2023 | February 2023

Author's Version

RendNet: Unified 2D/3D Recognizer With Latent Space Rendering

Ruoxi Shi, Xinyang Jiang, Caihua Shan, Yansen Wang, Dongsheng Li

CVPR 2022 | June 2022

Publication

Privacy-preserving Online AutoML for Domain-Specific Face Detection

Chenqian Yan, Yuge Zhang, Quanlu Zhang, Yaming Yang, Xinyang Jiang, Yuqing Yang, Baoyuan Wang

CVPR 2022 | May 2022

Publication

Recognizing Vector Graphics without Rasterization

Xinyang Jiang, Lu Liu, Caihua Shan, Yifei Shen, Xuanyi Dong, Dongsheng Li

NeurIPS 2021 | December 2021

Publication

Energy-Based Open-World Uncertainty Modeling for Confidence Calibration

Yezhen Wang, Bo Li, Tong Che, Kaiyang Zhou, Ziwei Liu, Dongsheng Li

ICCV 2021 | October 2021

Publication

A Reinforcement-Learning-based Energy-Efficient Framework for Multi-Task Video Analytics Pipeline

Yingying Zhao, Mingzhi Dong, Yujiang Wang, Da Feng, Qin Lv, Robert P. Dick, Dongsheng Li, Tun Lu, Ning Gu, Li Shang

IEEE Transactions on Multimedia | April 2021

DOI Publication Publication

End-to-End Word-Level Pronunciation Assessment with MASK Pre-training

Yukang Liang, Kaitao Song, Shaoguang Mao, Huiqiang Jiang, Luna K. Qiu, Yuqing Yang, Dongsheng Li, Linli Xu, Lili Qiu

INTERSPEECH 2023 | August 2023

Publication

A Hierarchical Regression Chain Framework for Affective Vocal Burst Recognition

Jinchao Li, Xixin Wu, Kaitao Song, Dongsheng Li, Xunying Liu, Helen Meng

ICASSP 2023 | June 2023

Publication

Leveraging Pretrained Representations with Task-related Keywords for Alzheimer’s Disease Detection

Jinchao Li, Kaitao Song, Junan Li, Bo Zheng, Dongsheng Li, Xixin Wu, Xunying Liu, Helen Meng

ICASSP 2023 | June 2023

Publication

Improving Hypernasality Estimation with Automatic Speech Recognition in Cleft Palate Speech

Kaitao Song, Teng Wan, Bixia Wang, Huiqiang Jiang, Luna K. Qiu, Jiahang Xu, Yuqing Yang, Liping Jiang, Qun Lou, Dongsheng Li, Xudong Wang, Lili Qiu

INTERSPEECH 2022 | June 2022

Publication

Mixed-phoneme bert: Improving bert with mixed phoneme and sup-phoneme representations for text to speech

Guangyan Zhang, Kaitao Song, Xu Tan, Daxin Tan, Yuzi Yan, Yanqing Liu, Gang Wang, Wei Zhou, Tao Qin, Tan Lee, Sheng Zhao

INTERSPEECH 2022 | June 2022

Publication

Towards Generating Real-World Time Series Data

Hengzhi Pei, Kan Ren, Yuqing Yang, Chang Liu, Tao Qin, Dongsheng Li

ICDM 21 | November 2021

Publication Publication Publication

Decomposed Meta-Learning for Few-Shot Named Entity Recognition

Tingting Ma, Huiqiang Jiang, Qianhui Wu, Tiejun Zhao, Chin-Yew Lin

60th Annual Meeting of the Association for Computational Linguistics (ACL 2022) | Findings | May 2022

Publication Project

FIRE: Fast Incremental Recommendation with Graph Signal Processing

Jiafeng Xia, Dongsheng Li, Hansu Gu, Jiahao Liu, Tun Lu, Ning Gu

TheWebConf 2022 | April 2022

PDF DOI

MINDSim: User Simulator for News Recommenders

Xufang Luo, Zheng Liu, Shitao Xiao, Xing Xie, Dongsheng Li

TheWebConf 2022 | April 2022

Publication

Cross-Modal Ambiguity Learning for Multimodal Fake News Detection

Yixuan Chen, Dongsheng Li, Peng Zhang, Jie Sui, Qin Lv, Lu Tun, Li Shang

TheWebConf 2022 | April 2022

PDF DOI

Accurate and Explainable Recommendation via Review Rationalization

Sicheng Pan, Dongsheng Li, Hansu Gu, Tun Lu, Xufang Luo, Ning Gu

TheWebConf 2022 | April 2022

PDF DOI

How Powerful is Graph Convolution for Recommendation

Yifei Shen, Yongji Wu, Yao Zhang, Caihua Shan, Jun Zhang, B. Khaled Letaief, Dongsheng Li

2021 Conference on Information and Knowledge Management | October 2021

DOI Publication Publication Publication Publication

Incremental Graph Convolutional Network for Collaborative Filtering

Jiafeng Xia, Dongsheng Li, Hansu Gu, Tun Lu, Peng Zhang, Ning Gu

2021 Conference on Information and Knowledge Management | October 2021

DOI Publication Publication

CoPE: Modeling Continuous Propagation and Evolution on Interaction Graph

Yao Zhang, Yun Xiong, Dongsheng Li, Caihua Shan, Kan Ren, Yangyong Zhu

2021 Conference on Information and Knowledge Management | October 2021

DOI PDF Publication

Scalable and Explainable 1-Bit Matrix Completion via Graph Signal Learning

Chao Chen, Dongsheng Li, Junchi Yan, Hanchi Huang, Xiaokang Yang

Thirty-Fifth AAAI Conference on Artificial Intelligence | May 2021

Publication Publication

Modeling Dynamic User Preference via Dictionary Learning for Sequential Recommendation

Chao Chen, Dongsheng Li, Junchi Yan, Xiaokang Yang

IEEE Transactions on Knowledge and Data Engineering | January 2021, (01): pp. 1-1

DOI Publication

nn-Meter: Towards Accurate Latency Prediction of Deep-Learning Model Inference on Diverse Edge Devices

Li Lyna Zhang, Shihao Han, Jianyu Wei, Ningxin Zheng, Ting Cao, Yuqing Yang, Yunxin Liu

The 19th ACM International Conference on Mobile Systems, Applications, and Services (MobiSys’21) | June 2021

Best Paper Award

Publication

Empowering In-Browser Deep Learning Inference on Edge Devices with Just-in-Time Kernel Optimizations

Fucheng Jia, Shiqi Jiang, Ting Cao, Wei Cui, Tianrui Xia, Xu Cao, Yuanchun Li, Qipeng Wang, Deyu Zhang, Ju Ren, Yunxin Liu, Lili Qiu, Mao Yang

the 22nd Annual International Conference on Mobile Systems, Applications and Services (MobiSys’24) | June 2024

Publication

Autodroid: LLM-Powered Task Automation in Android

Hao Wen, Yuanchun Li, Guohong Liu, Shanhui Zhao, Tao Yu, Toby Jia-Jun Li, Shiqi Jiang, Yunhao Liu, Yaqin Zhang, Yunxin Liu

the 30th Annual International Conference on Mobile Computing and Networking (MobiCom’24) | May 2024

Publication

Advancing Spiking Neural Networks for Sequential Modeling with Central Pattern Generators

Changze Lv, Dongqi Han, Yansen Wang, Xiaoqing Zheng, Xuanjing Huang, Dongsheng Li

May 2024

Publication

LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compression

Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Menglin Xia, Xufang Luo, Jue Zhang, Qingwei Lin 林庆维, Victor Ruehle, Yuqing Yang, Chin-Yew Lin, H. Vicky Zhao, Lili Qiu, Dongmei Zhang

The 62nd Annual Meeting of the Association for Computational Linguistics (Findings of ACL 2024) | March 2024

Preprint Project

LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Models

Huiqiang Jiang, Qianhui Wu, Chin-Yew Lin, Yuqing Yang, Lili Qiu

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP 2023) | December 2023

Publication Project

LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression

Huiqiang Jiang, Qianhui Wu, Xufang Luo, Dongsheng Li, Chin-Yew Lin, Yuqing Yang, Lili Qiu

The 62nd Annual Meeting of the Association for Computational Linguistics (ACL 2024) | October 2023

Preprint Project

Attentive Mask CLIP

Yifan Yang, Houwen Peng, Xinyang Jiang, Huiqiang Jiang, Yuqing Yang, Lili Qiu

2023 International Conference on Computer Vision | October 2023

Publication

ImageBrush: Learning Visual In-Context Instructions for Exemplar-Based Image Manipulation

Yasheng Sun, Yifan Yang, Houwen Peng, Yifei Shen, Yuqing Yang, Han Hu, Lili Qiu, Hideki Koike, Yuqing Yang

NeurIPS 2023 | October 2023

Publication

End-to-End Word-Level Pronunciation Assessment with MASK Pre-training

Yukang Liang, Kaitao Song, Shaoguang Mao, Huiqiang Jiang, Luna K. Qiu, Yuqing Yang, Dongsheng Li, Linli Xu, Lili Qiu

INTERSPEECH 2023 | August 2023

Publication

Accurate and Structured Pruning for Efficient Automatic Speech Recognition

Huiqiang Jiang, Li Lyna Zhang, Yuang Li, Yu Wu, Shijie Cao, Ting Cao, Yuqing Yang, Jinyu Li, Mao Yang, Lili Qiu

INTERSPEECH 2023 | August 2023

Publication

CoLaDa: A Collaborative Label Denoising Framework for Cross-lingual Named Entity Recognition

Tingting Ma, Qianhui Wu, Huiqiang Jiang, Börje F. Karlsson, Tiejun Zhao, Chin-Yew Lin

ACL 2023 | July 2023

Publication Project

Multi-Level Knowledge Distillation for Out-of-Distribution Detection in Text

Qianhui Wu, Huiqiang Jiang, Haonan Yin, Börje F. Karlsson, Chin-Yew Lin

The 61st Annual Meeting of the Association for Computational Linguistics (ACL 2023) | July 2023

Publication

Unsupervised Video Anomaly Detection for Stereotypical Behaviours in Autism

Jiaqi Gao, Xinyang Jiang, Yuqing Yang, Dongsheng Li, Lili Qiu

ICASSP 23 | June 2023

Author's Version

A Hierarchical Regression Chain Framework for Affective Vocal Burst Recognition

Jinchao Li, Xixin Wu, Kaitao Song, Dongsheng Li, Xunying Liu, Helen Meng

ICASSP 2023 | June 2023

Publication

Leveraging Pretrained Representations with Task-related Keywords for Alzheimer’s Disease Detection

Jinchao Li, Kaitao Song, Junan Li, Bo Zheng, Dongsheng Li, Xixin Wu, Xunying Liu, Helen Meng

ICASSP 2023 | June 2023

Publication

EA-HAS-Bench: Energy-aware Hyperparameter and Architecture Search Benchmark

Shuguang Dou, Xinyang Jiang, Cairong Zhao, Dongsheng Li

ICLR 23 | May 2023

Spotlight

Publication

SIMPLE: Specialized Model-Sample Matching for Domain Generalization

Ziyue Li, Kan Ren, Xinyang Jiang, Yifei Shen, Haipeng Zhang, Dongsheng Li

ICLR 23 | May 2023

Publication

Over-parameterized Model Optimization with Polyak-{\L}ojasiewicz Condition

Yixuan Chen, Yubin Shi, Mingzhi Dong, Xiaochen Yang, Dongsheng Li, Yujiang Wang, Robert Dick, Qin Lv, Yingying Zhao, Fan Yang, Ning Gu, Li Shang

ICLR 23 | May 2023

Publication

Data Continuity Matters: Improving Sequence Modeling with Lipschitz Regularizer

Eric Qu, Xufang Luo, Dongsheng Li

ICLR 23 | May 2023

Spotlight

Publication

AdaptiveNet: Post-deployment Neural Architecture Adaptation for Diverse Edge Environments

Hao Wen, Yuanchun Li, Zunshuai Zhang, Shiqi Jiang, Xiaozhou Ye, Ye Ouyang, Ya-Qin Zhang, Yunxin Liu

The 29th Annual International Conference On Mobile Computing And Networking (MobiCom’23)) | May 2023

Publication

Self-supervised Semi-implicit Graph Variational Auto-encoders with Masking

Xiang Li, Tiandi Ye, Caihua Shan, Dongsheng Li, Ming Gao

WWW 23 | April 2023

Author's Version

Personalized Graph Signal Processing for Collaborative Filtering

Jiahao Liu, Dongsheng Li, Hansu Gu, Tun Lu, Peng Zhang, Li Shang, Ning Gu

WWW 23 | April 2023

Author's Version

Towards Inference Efficient Deep Ensemble Learning

Ziyue Li, Kan Ren, Yifan Yang, Xinyang Jiang, Yuqing Yang, Dongsheng Li

AAAI 23 | February 2023

Author's Version

Similarity Distribution based Membership Inference Attack on Person Re-identification

Junyao Gao, Xinyang Jiang, Huishuai Zhang, Yifan Yang, Shuguang Dou, Dongsheng Li, Duoqian Miao, Cheng Deng, Cairong Zhao

AAAI 2023 | February 2023

Author's Version

Learning Decomposed Spatial Relations for Multi-Variate Time-Series Modeling

Yuchen Fang, Kan Ren, Caihua Shan, Yifei Shen, You Li, Weinan Zhang, Yong Yu, Dongsheng Li

AAAI 2023 | February 2023

Publication

Turbo: Opportunistic Enhancement for Edge Video Analytics

Yan Lu, Shiqi Jiang, Ting Cao, Yuanchao Shu

The 20th ACM Conference on Embedded Networked Sensor Systems (SenSys ’22) | November 2022

Publication

CMMD: Cross-Metric Multi-Dimensional Root Cause Analysis

Shifu Yan, Caihua Shan, Wenyi Yang, Bixiong Xu, Dongsheng Li, Lili Qiu, Jie Tong, Qi Zhang

KDD 2022 | August 2022

Publication

CLARE: A Semi-supervised Community Detection Algorithm

Xixi Wu, Yao Zhang, Yun Xiong, Yizhu Jiao, Caihua Shan, Yangyong Zhu, Philip S Yu

KDD 2022 | August 2022

Publication

Finding Global Homophily in Graph Neural Networks When Meeting Heterophily

Xiang Li, Renyu Zhu, Yao Cheng, Caihua Shan, Siqiang Luo, Dongsheng Li, Weining Qian

ICML 2022 | July 2022

Publication

Analyzing and Mitigating Interference in Neural Architecture Search

Jin Xu, Xu Tan, Kaitao Song, Renqian Luo, Yichong Leng, Tao Qin, Tie-Yan Liu, Sujian Li

ICML 2022 | July 2022

Publication

PilotFish: Harvesting Free Cycles of Cloud Gaming with Deep Learning Training

Wei Zhang , Binghao Chen, Zhenhua Han, Quan Chen, Peng Cheng, Fan Yang, Ran Shu, Yuqing Yang, Minyi Guo

2022 USENIX Annual Technical Conference | July 2022

PDF

Towards Applicable Reinforcement Learning: Improving the Generalization and Sample Efficiency with Policy Ensemble

Zhengyu Yang, Kan Ren, Xufang Luo, Minghuan Liu, Weiqing Liu, Jiang Bian, Weinan Zhang, Dongsheng Li

IJCAI 2022 | July 2022

Publication

SparTA: Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute

Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Yang Wang, Mao Yang, Lidong Zhou

OSDI 2022 | July 2022

Publication Project Project

Improving Hypernasality Estimation with Automatic Speech Recognition in Cleft Palate Speech

Kaitao Song, Teng Wan, Bixia Wang, Huiqiang Jiang, Luna K. Qiu, Jiahang Xu, Yuqing Yang, Liping Jiang, Qun Lou, Dongsheng Li, Xudong Wang, Lili Qiu

INTERSPEECH 2022 | June 2022

Publication

Mixed-phoneme bert: Improving bert with mixed phoneme and sup-phoneme representations for text to speech

Guangyan Zhang, Kaitao Song, Xu Tan, Daxin Tan, Yuzi Yan, Yanqing Liu, Gang Wang, Wei Zhou, Tao Qin, Tan Lee, Sheng Zhao

INTERSPEECH 2022 | June 2022

Publication

RendNet: Unified 2D/3D Recognizer With Latent Space Rendering

Ruoxi Shi, Xinyang Jiang, Caihua Shan, Yansen Wang, Dongsheng Li

CVPR 2022 | June 2022

Publication

Privacy-preserving Online AutoML for Domain-Specific Face Detection

Chenqian Yan, Yuge Zhang, Quanlu Zhang, Yaming Yang, Xinyang Jiang, Yuqing Yang, Baoyuan Wang

CVPR 2022 | May 2022

Publication

Decomposed Meta-Learning for Few-Shot Named Entity Recognition

Tingting Ma, Huiqiang Jiang, Qianhui Wu, Tiejun Zhao, Chin-Yew Lin

60th Annual Meeting of the Association for Computational Linguistics (ACL 2022) | Findings | May 2022

Publication Project

FIRE: Fast Incremental Recommendation with Graph Signal Processing

Jiafeng Xia, Dongsheng Li, Hansu Gu, Jiahao Liu, Tun Lu, Ning Gu

TheWebConf 2022 | April 2022

PDF DOI

MINDSim: User Simulator for News Recommenders

Xufang Luo, Zheng Liu, Shitao Xiao, Xing Xie, Dongsheng Li

TheWebConf 2022 | April 2022

Publication

Cross-Modal Ambiguity Learning for Multimodal Fake News Detection

Yixuan Chen, Dongsheng Li, Peng Zhang, Jie Sui, Qin Lv, Lu Tun, Li Shang

TheWebConf 2022 | April 2022

PDF DOI

Accurate and Explainable Recommendation via Review Rationalization

Sicheng Pan, Dongsheng Li, Hansu Gu, Tun Lu, Xufang Luo, Ning Gu

TheWebConf 2022 | April 2022

PDF DOI

Variational oracle guiding for reinforcement learning

Dongqi Han, Tadashi Kozuno, Xufang Luo, Zhao-Yun Chen, Kenji Doya, Yuqing Yang, Dongsheng Li

ICLR 2022 | April 2022

Publication

Recursive Disentanglement Network

Yixuan Chen, Yubin Shi, Dongsheng Li, Yujiang Wang, Mingzhi Dong, Yingying Zhao, Robert Dick, Qin Lv, Fan Yang, Li Shang

ICLR 2022 | April 2022

Publication

Astraea: towards QoS-aware and resource-efficient multi-stage GPU services

Wei Zhang, Quan Chen, Kaihua Fu, Ningxin Zheng, Zhiyi Huang, Jingwen Leng, Minyi Guo

ASPLOS 2022 | February 2022

Publication

Neural Piecewise-Constant Delay Differential Equations

Qunxi Zhu, Yifei Shen, Dongsheng Li, Wei Lin

AAAI 2022 | February 2022

Publication

Invariant Information Bottleneck for Domain Generalization

Bo Li, Yifei Shen, Yezhen Wang, Wenzhen Zhu, Colorado J Reed, Dongsheng Li, Kurt Keutzer, Han Zhao

AAAI 2022 | February 2022

Publication

Reinforcement Learning Enhanced Explainer for Graph Neural Networks

Caihua Shan, Yifei Shen, Yao Zhang, Xiang Li, Dongsheng Li

NeurIPS 2021 | December 2021

Publication

Recognizing Vector Graphics without Rasterization

Xinyang Jiang, Lu Liu, Caihua Shan, Yifei Shen, Xuanyi Dong, Dongsheng Li

NeurIPS 2021 | December 2021

Publication

Towards Generating Real-World Time Series Data

Hengzhi Pei, Kan Ren, Yuqing Yang, Chang Liu, Tao Qin, Dongsheng Li

ICDM 21 | November 2021

Publication Publication Publication

How Powerful is Graph Convolution for Recommendation

Yifei Shen, Yongji Wu, Yao Zhang, Caihua Shan, Jun Zhang, B. Khaled Letaief, Dongsheng Li

2021 Conference on Information and Knowledge Management | October 2021

DOI Publication Publication Publication Publication

Incremental Graph Convolutional Network for Collaborative Filtering

Jiafeng Xia, Dongsheng Li, Hansu Gu, Tun Lu, Peng Zhang, Ning Gu

2021 Conference on Information and Knowledge Management | October 2021

DOI Publication Publication

CoPE: Modeling Continuous Propagation and Evolution on Interaction Graph

Yao Zhang, Yun Xiong, Dongsheng Li, Caihua Shan, Kan Ren, Yangyong Zhu

2021 Conference on Information and Knowledge Management | October 2021

DOI PDF Publication

Energy-Based Open-World Uncertainty Modeling for Confidence Calibration

Yezhen Wang, Bo Li, Tong Che, Kaiyang Zhou, Ziwei Liu, Dongsheng Li

ICCV 2021 | October 2021

Publication

CHARM: Collaborative Host and Accelerator Resource Management for GPU Datacenters

Wei Zhang, Kaihua Fu, Ningxin Zheng, Quan Chen, Chao Li, Wenli Zheng, Minyi Guo

ICCD 2021 | July 2021

Publication

Enable simultaneous DNN services based on deterministic operator overlap and precise latency prediction.

Weihao Cui, Han Zhao, Quan Chen, Ningxin Zheng, Jingwen Leng, Jieru Zhao, Zhuo Song, Tao Ma, Yong Yang, Chao Li, Minyi Guo

SC 2021 | July 2021

Publication

nn-Meter: Towards Accurate Latency Prediction of Deep-Learning Model Inference on Diverse Edge Devices

Li Lyna Zhang, Shihao Han, Jianyu Wei, Ningxin Zheng, Ting Cao, Yuqing Yang, Yunxin Liu

The 19th ACM International Conference on Mobile Systems, Applications, and Services (MobiSys’21) | June 2021

Best Paper Award

Publication

Scalable and Explainable 1-Bit Matrix Completion via Graph Signal Learning

Chao Chen, Dongsheng Li, Junchi Yan, Hanchi Huang, Xiaokang Yang

Thirty-Fifth AAAI Conference on Artificial Intelligence | May 2021

Publication Publication

HiveD: Sharing a GPU Cluster for Deep Learning with Guarantees

Hanyu Zhao, Zhenhua Han, Zhi Yang, Quanlu Zhang, Fan Yang, Lidong Zhou, Mao Yang, Yuqi Wang, Yifan Xiong, Bin Wang

2020 Operating Systems Design and Implementation | November 2020

Publication Project

Retiarii: A Deep Learning Exploratory-Training Framework

Quanlu Zhang, Zhenhua Han, Fan Yang, Yuge Zhang, Zhe Liu, Mao Yang, Lidong Zhou

2020 Operating Systems Design and Implementation | November 2020

Publication Video

Mitigate Position Bias in Large Language Models via Scaling a Single Dimension

Yijiong Yu, Huiqiang Jiang, Xufang Luo, Qianhui Wu, Chin-Yew Lin, Dongsheng Li, Yuqing Yang, Yongfeng Huang, Lili Qiu

June 2024

Preprint

MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attention

Huiqiang Jiang, Yucheng Li, Chengruidong Zhang, Qianhui Wu, Xufang Luo, Surin Ahn, Zhenhua Han, Amir H. Abdi, Dongsheng Li, Chin-Yew Lin, Yuqing Yang, Lili Qiu

July 2024

Preprint Github Project

Large-scale Video Analytics with Cloud–Edge Collaborative Continuous Learning

Ya Nan, Shiqi Jiang, Mo Li

ACM Transactions on Sensor Network | October 2023, Vol 20(1): pp. 1-23

Publication

Metabolic characterization of hypertrophic cardiomyopathy in human heart

Wenmin Wang, Jizheng Wang, Ke Yao, Shuiyun Wang, Meng Nie, Yizi Zhao, Bohong Wang, Huanhuan Pang, Jingjing Xu, Guixin Wu, Minjie Lu, Nan Tang, Chunmei Qi, Hengzhi Pei, Xufang Luo, Dongsheng Li, Tianshu Yang, Qing Sun, Xiang Wei, Yan Li, ingsheng Jiang, Peng Li, Lei Song, Zeping Hu

Nature Cardiovascular Research | May 2022, Vol 1: pp. 445-461

Publication

Predicting the effect of confinement on the COVID-19 spread using machine learning enriched with satellite air pollution observations.

Xiaofan Xing, Yuankang Xiong, Ruipu Yang, Rong Wang, Weibing Wang, Haidong Kan, Tun Lu, Dongsheng Li, Junji Cao, Josep Peñuelas, Philippe Ciais, Nico Bauer, Olivier Boucher, Yves Balkanski, Didier Hauglustaine, Guy Brasseur, Lidia Morawska, Ivan A Janssens, Xiangrong Wang, Jordi Sardans, Yijing Wang, Yifei Deng, Lin Wang, Jianmin Chen, Xu Tang, Renhe Zhang

Proceedings of the National Academy of Sciences of the United States of America | August 2021, Vol 118(33)

DOI Publication Publication Publication Publication Publication Publication Project

A Reinforcement-Learning-based Energy-Efficient Framework for Multi-Task Video Analytics Pipeline

Yingying Zhao, Mingzhi Dong, Yujiang Wang, Da Feng, Qin Lv, Robert P. Dick, Dongsheng Li, Tun Lu, Ning Gu, Li Shang

IEEE Transactions on Multimedia | April 2021

DOI Publication Publication

Towards QoS-awareness and Improved Utilization of Spatial Multitasking GPUs

Wei Zhang, Quan Chen, Ningxin Zheng, Weihao Cui, Kaihua Fu, Minyi Guo

IEEE Transactions on Computers | March 2021, pp. 1-1

DOI Publication

Modeling Dynamic User Preference via Dictionary Learning for Sequential Recommendation

Chao Chen, Dongsheng Li, Junchi Yan, Xiaokang Yang

IEEE Transactions on Knowledge and Data Engineering | January 2021, (01): pp. 1-1

DOI Publication