Lili Qiu

MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attention

Huiqiang Jiang, Yucheng Li, Chengruidong Zhang, Qianhui Wu, Xufang Luo, Surin Ahn, Zhenhua Han, Amir H. Abdi, Dongsheng Li, Chin-Yew Lin, Yuqing Yang, Lili Qiu

July 2024

Preprint Github Project

Empowering In-Browser Deep Learning Inference on Edge Devices with Just-in-Time Kernel Optimizations

Fucheng Jia, Shiqi Jiang, Ting Cao, Wei Cui, Tianrui Xia, Xu Cao, Yuanchun Li, Qipeng Wang, Deyu Zhang, Ju Ren, Yunxin Liu, Lili Qiu, Mao Yang

the 22nd Annual International Conference on Mobile Systems, Applications and Services (MobiSys'24) | June 2024

Publication

Mitigate Position Bias in Large Language Models via Scaling a Single Dimension

Yijiong Yu, Huiqiang Jiang, Xufang Luo, Qianhui Wu, Chin-Yew Lin, Dongsheng Li, Yuqing Yang, Yongfeng Huang, Lili Qiu

June 2024

Preprint

Parrot: Efficient Serving of LLM-based Applications with Semantic Variable

Chaofan Lin, Zhenhua Han, Chengruidong Zhang, Yuqing Yang, Fan Yang, Chen Chen, Lili Qiu

OSDI 2024 | May 2024

Publication Github

Real-Time Neural Video Recovery and Enhancement on Mobile Devices

Yifan Yang, Yuqing Yang, Lili Qiu

CoNEXT 2024 - International Conference on emerging Networking EXperiments and Technologies | April 2024

Preprint

LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compression

Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Menglin Xia, Xufang Luo, Jue Zhang, Qingwei Lin 林庆维, Victor Ruehle, Yuqing Yang, Chin-Yew Lin, H. Vicky Zhao, Lili Qiu, Dongmei Zhang

The 62nd Annual Meeting of the Association for Computational Linguistics (Findings of ACL 2024) | March 2024

Preprint Project

LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Models

Huiqiang Jiang, Qianhui Wu, Chin-Yew Lin, Yuqing Yang, Lili Qiu

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP 2023) | December 2023

Publication Project

Large Multimodal Model for Real-World Radiology Report Generation

Brian Nlong Zhao, Xinyang Jiang, Xufang Luo, Yifan Yang, Bo Li, Zilong Wang, Javier Alvarez-Valle, Matthew P. Lungren, Dongsheng Li, Lili Qiu

December 2023

Publication

PIT: Optimization of Dynamic Sparse Deep Learning Models via Permutation Invariant Transformation

Ningxin Zheng, Huiqiang Jiang, Quanlu Zhang, Zhenhua Han, Lingxiao Ma, Yuqing Yang, Fan Yang, Chengruidong Zhang, Lili Qiu, Mao Yang, Lidong Zhou

The 29th ACM Symposium on Operating Systems Principles | October 2023

Publication

LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression

Huiqiang Jiang, Qianhui Wu, Xufang Luo, Dongsheng Li, Chin-Yew Lin, Yuqing Yang, Lili Qiu

The 62nd Annual Meeting of the Association for Computational Linguistics (ACL 2024) | October 2023

Preprint Project

Attentive Mask CLIP

Yifan Yang, Houwen Peng, Xinyang Jiang, Huiqiang Jiang, Yuqing Yang, Lili Qiu

2023 International Conference on Computer Vision | October 2023

Publication

ImageBrush: Learning Visual In-Context Instructions for Exemplar-Based Image Manipulation

Yasheng Sun, Yifan Yang, Houwen Peng, Yifei Shen, Yuqing Yang, Han Hu, Lili Qiu, Hideki Koike, Yuqing Yang

NeurIPS 2023 | October 2023

Publication

Accurate and Structured Pruning for Efficient Automatic Speech Recognition

Huiqiang Jiang, Li Lyna Zhang, Yuang Li, Yu Wu, Shijie Cao, Ting Cao, Yuqing Yang, Jinyu Li, Mao Yang, Lili Qiu

INTERSPEECH 2023 | August 2023

Publication

Optimizing Dynamic Neural Networks with Brainstorm

Weihao Cui, Zhenhua Han, Lingji Ouyang, Yichuan Wang, Ningxin Zheng, Lingxiao Ma, Yuqing Yang, Fan Yang, Jilong Xue, Lili Qiu, Lidong Zhou, Quan Chen, Haisheng Tan, Minyi Guo

OSDI'23 | July 2023

Publication

Enabling Real-time Neural Recovery for Cloud Gaming on Mobile Devices

Yifan Yang, Lili Qiu, Yuqing Yang

June 2023

Preprint

Unsupervised Video Anomaly Detection for Stereotypical Behaviours in Autism

Jiaqi Gao, Xinyang Jiang, Yuqing Yang, Dongsheng Li, Lili Qiu

ICASSP 23 | June 2023

Author's Version

SiloD: A Co-design of Caching and Scheduling for Deep Learning Clusters

Hanyu Zhao, Zhenhua Han, Zhi Yang, Quanlu Zhang, Mingxia Li, Fan Yang, Qianxi Zhang, Binyang Li, Yuqing Yang, Lili Qiu, Lintao Zhang, Lidong Zhou

EuroSys 2023 | May 2023

Publication

CMMD: Cross-Metric Multi-Dimensional Root Cause Analysis

Shifu Yan, Caihua Shan, Wenyi Yang, Bixiong Xu, Dongsheng Li, Lili Qiu, Jie Tong, Qi Zhang

KDD 2022 | August 2022

Publication

Improving Hypernasality Estimation with Automatic Speech Recognition in Cleft Palate Speech

Kaitao Song, Teng Wan, Bixia Wang, Huiqiang Jiang, Luna K. Qiu, Jiahang Xu, Yuqing Yang, Liping Jiang, Qun Lou, Dongsheng Li, Xudong Wang, Lili Qiu

INTERSPEECH 2022 | June 2022

Publication

MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attention

Huiqiang Jiang, Yucheng Li, Chengruidong Zhang, Qianhui Wu, Xufang Luo, Surin Ahn, Zhenhua Han, Amir H. Abdi, Dongsheng Li, Chin-Yew Lin, Yuqing Yang, Lili Qiu

July 2024

Preprint Github Project

Empowering In-Browser Deep Learning Inference on Edge Devices with Just-in-Time Kernel Optimizations

Fucheng Jia, Shiqi Jiang, Ting Cao, Wei Cui, Tianrui Xia, Xu Cao, Yuanchun Li, Qipeng Wang, Deyu Zhang, Ju Ren, Yunxin Liu, Lili Qiu, Mao Yang

the 22nd Annual International Conference on Mobile Systems, Applications and Services (MobiSys'24) | June 2024

Publication

Mitigate Position Bias in Large Language Models via Scaling a Single Dimension

Yijiong Yu, Huiqiang Jiang, Xufang Luo, Qianhui Wu, Chin-Yew Lin, Dongsheng Li, Yuqing Yang, Yongfeng Huang, Lili Qiu

June 2024

Preprint

Parrot: Efficient Serving of LLM-based Applications with Semantic Variable

Chaofan Lin, Zhenhua Han, Chengruidong Zhang, Yuqing Yang, Fan Yang, Chen Chen, Lili Qiu

OSDI 2024 | May 2024

Publication Github

LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compression

Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Menglin Xia, Xufang Luo, Jue Zhang, Qingwei Lin 林庆维, Victor Ruehle, Yuqing Yang, Chin-Yew Lin, H. Vicky Zhao, Lili Qiu, Dongmei Zhang

The 62nd Annual Meeting of the Association for Computational Linguistics (Findings of ACL 2024) | March 2024

Preprint Project

LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Models

Huiqiang Jiang, Qianhui Wu, Chin-Yew Lin, Yuqing Yang, Lili Qiu

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP 2023) | December 2023

Publication Project

Large Multimodal Model for Real-World Radiology Report Generation

Brian Nlong Zhao, Xinyang Jiang, Xufang Luo, Yifan Yang, Bo Li, Zilong Wang, Javier Alvarez-Valle, Matthew P. Lungren, Dongsheng Li, Lili Qiu

December 2023

Publication

PIT: Optimization of Dynamic Sparse Deep Learning Models via Permutation Invariant Transformation

Ningxin Zheng, Huiqiang Jiang, Quanlu Zhang, Zhenhua Han, Lingxiao Ma, Yuqing Yang, Fan Yang, Chengruidong Zhang, Lili Qiu, Mao Yang, Lidong Zhou

The 29th ACM Symposium on Operating Systems Principles | October 2023

Publication

LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression

Huiqiang Jiang, Qianhui Wu, Xufang Luo, Dongsheng Li, Chin-Yew Lin, Yuqing Yang, Lili Qiu

The 62nd Annual Meeting of the Association for Computational Linguistics (ACL 2024) | October 2023

Preprint Project

Attentive Mask CLIP

Yifan Yang, Houwen Peng, Xinyang Jiang, Huiqiang Jiang, Yuqing Yang, Lili Qiu

2023 International Conference on Computer Vision | October 2023

Publication

ImageBrush: Learning Visual In-Context Instructions for Exemplar-Based Image Manipulation

Yasheng Sun, Yifan Yang, Houwen Peng, Yifei Shen, Yuqing Yang, Han Hu, Lili Qiu, Hideki Koike, Yuqing Yang

NeurIPS 2023 | October 2023

Publication

Accurate and Structured Pruning for Efficient Automatic Speech Recognition

Huiqiang Jiang, Li Lyna Zhang, Yuang Li, Yu Wu, Shijie Cao, Ting Cao, Yuqing Yang, Jinyu Li, Mao Yang, Lili Qiu

INTERSPEECH 2023 | August 2023

Publication

Unsupervised Video Anomaly Detection for Stereotypical Behaviours in Autism

Jiaqi Gao, Xinyang Jiang, Yuqing Yang, Dongsheng Li, Lili Qiu

ICASSP 23 | June 2023

Author's Version

CMMD: Cross-Metric Multi-Dimensional Root Cause Analysis

Shifu Yan, Caihua Shan, Wenyi Yang, Bixiong Xu, Dongsheng Li, Lili Qiu, Jie Tong, Qi Zhang

KDD 2022 | August 2022

Publication

MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attention

Huiqiang Jiang, Yucheng Li, Chengruidong Zhang, Qianhui Wu, Xufang Luo, Surin Ahn, Zhenhua Han, Amir H. Abdi, Dongsheng Li, Chin-Yew Lin, Yuqing Yang, Lili Qiu

July 2024

Preprint Github Project

Empowering In-Browser Deep Learning Inference on Edge Devices with Just-in-Time Kernel Optimizations

Fucheng Jia, Shiqi Jiang, Ting Cao, Wei Cui, Tianrui Xia, Xu Cao, Yuanchun Li, Qipeng Wang, Deyu Zhang, Ju Ren, Yunxin Liu, Lili Qiu, Mao Yang

the 22nd Annual International Conference on Mobile Systems, Applications and Services (MobiSys'24) | June 2024

Publication

Real-Time Neural Video Recovery and Enhancement on Mobile Devices

Yifan Yang, Yuqing Yang, Lili Qiu

CoNEXT 2024 - International Conference on emerging Networking EXperiments and Technologies | April 2024

Preprint

PIT: Optimization of Dynamic Sparse Deep Learning Models via Permutation Invariant Transformation

Ningxin Zheng, Huiqiang Jiang, Quanlu Zhang, Zhenhua Han, Lingxiao Ma, Yuqing Yang, Fan Yang, Chengruidong Zhang, Lili Qiu, Mao Yang, Lidong Zhou

The 29th ACM Symposium on Operating Systems Principles | October 2023

Publication

Optimizing Dynamic Neural Networks with Brainstorm

Weihao Cui, Zhenhua Han, Lingji Ouyang, Yichuan Wang, Ningxin Zheng, Lingxiao Ma, Yuqing Yang, Fan Yang, Jilong Xue, Lili Qiu, Lidong Zhou, Quan Chen, Haisheng Tan, Minyi Guo

OSDI'23 | July 2023

Publication

Enabling Real-time Neural Recovery for Cloud Gaming on Mobile Devices

Yifan Yang, Lili Qiu, Yuqing Yang

June 2023

Preprint

SiloD: A Co-design of Caching and Scheduling for Deep Learning Clusters

Hanyu Zhao, Zhenhua Han, Zhi Yang, Quanlu Zhang, Mingxia Li, Fan Yang, Qianxi Zhang, Binyang Li, Yuqing Yang, Lili Qiu, Lintao Zhang, Lidong Zhou

EuroSys 2023 | May 2023

Publication

MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attention

Huiqiang Jiang, Yucheng Li, Chengruidong Zhang, Qianhui Wu, Xufang Luo, Surin Ahn, Zhenhua Han, Amir H. Abdi, Dongsheng Li, Chin-Yew Lin, Yuqing Yang, Lili Qiu

July 2024

Preprint Github Project

Mitigate Position Bias in Large Language Models via Scaling a Single Dimension

Yijiong Yu, Huiqiang Jiang, Xufang Luo, Qianhui Wu, Chin-Yew Lin, Dongsheng Li, Yuqing Yang, Yongfeng Huang, Lili Qiu

June 2024

Preprint

LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compression

Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Menglin Xia, Xufang Luo, Jue Zhang, Qingwei Lin 林庆维, Victor Ruehle, Yuqing Yang, Chin-Yew Lin, H. Vicky Zhao, Lili Qiu, Dongmei Zhang

The 62nd Annual Meeting of the Association for Computational Linguistics (Findings of ACL 2024) | March 2024

Preprint Project

LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Models

Huiqiang Jiang, Qianhui Wu, Chin-Yew Lin, Yuqing Yang, Lili Qiu

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP 2023) | December 2023

Publication Project

LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression

Huiqiang Jiang, Qianhui Wu, Xufang Luo, Dongsheng Li, Chin-Yew Lin, Yuqing Yang, Lili Qiu

The 62nd Annual Meeting of the Association for Computational Linguistics (ACL 2024) | October 2023

Preprint Project

Accurate and Structured Pruning for Efficient Automatic Speech Recognition

Huiqiang Jiang, Li Lyna Zhang, Yuang Li, Yu Wu, Shijie Cao, Ting Cao, Yuqing Yang, Jinyu Li, Mao Yang, Lili Qiu

INTERSPEECH 2023 | August 2023

Publication

Large Multimodal Model for Real-World Radiology Report Generation

Brian Nlong Zhao, Xinyang Jiang, Xufang Luo, Yifan Yang, Bo Li, Zilong Wang, Javier Alvarez-Valle, Matthew P. Lungren, Dongsheng Li, Lili Qiu

December 2023

Publication

Unsupervised Video Anomaly Detection for Stereotypical Behaviours in Autism

Jiaqi Gao, Xinyang Jiang, Yuqing Yang, Dongsheng Li, Lili Qiu

ICASSP 23 | June 2023

Author's Version

Improving Hypernasality Estimation with Automatic Speech Recognition in Cleft Palate Speech

Kaitao Song, Teng Wan, Bixia Wang, Huiqiang Jiang, Luna K. Qiu, Jiahang Xu, Yuqing Yang, Liping Jiang, Qun Lou, Dongsheng Li, Xudong Wang, Lili Qiu

INTERSPEECH 2022 | June 2022

Publication

Improving Hypernasality Estimation with Automatic Speech Recognition in Cleft Palate Speech

Kaitao Song, Teng Wan, Bixia Wang, Huiqiang Jiang, Luna K. Qiu, Jiahang Xu, Yuqing Yang, Liping Jiang, Qun Lou, Dongsheng Li, Xudong Wang, Lili Qiu

INTERSPEECH 2022 | June 2022

Publication

Empowering In-Browser Deep Learning Inference on Edge Devices with Just-in-Time Kernel Optimizations

Fucheng Jia, Shiqi Jiang, Ting Cao, Wei Cui, Tianrui Xia, Xu Cao, Yuanchun Li, Qipeng Wang, Deyu Zhang, Ju Ren, Yunxin Liu, Lili Qiu, Mao Yang

the 22nd Annual International Conference on Mobile Systems, Applications and Services (MobiSys'24) | June 2024

Publication

Parrot: Efficient Serving of LLM-based Applications with Semantic Variable

Chaofan Lin, Zhenhua Han, Chengruidong Zhang, Yuqing Yang, Fan Yang, Chen Chen, Lili Qiu

OSDI 2024 | May 2024

Publication Github

Real-Time Neural Video Recovery and Enhancement on Mobile Devices

Yifan Yang, Yuqing Yang, Lili Qiu

CoNEXT 2024 - International Conference on emerging Networking EXperiments and Technologies | April 2024

Preprint

LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compression

Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Menglin Xia, Xufang Luo, Jue Zhang, Qingwei Lin 林庆维, Victor Ruehle, Yuqing Yang, Chin-Yew Lin, H. Vicky Zhao, Lili Qiu, Dongmei Zhang

The 62nd Annual Meeting of the Association for Computational Linguistics (Findings of ACL 2024) | March 2024

Preprint Project

LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Models

Huiqiang Jiang, Qianhui Wu, Chin-Yew Lin, Yuqing Yang, Lili Qiu

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP 2023) | December 2023

Publication Project

PIT: Optimization of Dynamic Sparse Deep Learning Models via Permutation Invariant Transformation

Ningxin Zheng, Huiqiang Jiang, Quanlu Zhang, Zhenhua Han, Lingxiao Ma, Yuqing Yang, Fan Yang, Chengruidong Zhang, Lili Qiu, Mao Yang, Lidong Zhou

The 29th ACM Symposium on Operating Systems Principles | October 2023

Publication

LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression

Huiqiang Jiang, Qianhui Wu, Xufang Luo, Dongsheng Li, Chin-Yew Lin, Yuqing Yang, Lili Qiu

The 62nd Annual Meeting of the Association for Computational Linguistics (ACL 2024) | October 2023

Preprint Project

Attentive Mask CLIP

Yifan Yang, Houwen Peng, Xinyang Jiang, Huiqiang Jiang, Yuqing Yang, Lili Qiu

2023 International Conference on Computer Vision | October 2023

Publication

ImageBrush: Learning Visual In-Context Instructions for Exemplar-Based Image Manipulation

Yasheng Sun, Yifan Yang, Houwen Peng, Yifei Shen, Yuqing Yang, Han Hu, Lili Qiu, Hideki Koike, Yuqing Yang

NeurIPS 2023 | October 2023

Publication

Accurate and Structured Pruning for Efficient Automatic Speech Recognition

Huiqiang Jiang, Li Lyna Zhang, Yuang Li, Yu Wu, Shijie Cao, Ting Cao, Yuqing Yang, Jinyu Li, Mao Yang, Lili Qiu

INTERSPEECH 2023 | August 2023

Publication

Optimizing Dynamic Neural Networks with Brainstorm

Weihao Cui, Zhenhua Han, Lingji Ouyang, Yichuan Wang, Ningxin Zheng, Lingxiao Ma, Yuqing Yang, Fan Yang, Jilong Xue, Lili Qiu, Lidong Zhou, Quan Chen, Haisheng Tan, Minyi Guo

OSDI'23 | July 2023

Publication

Unsupervised Video Anomaly Detection for Stereotypical Behaviours in Autism

Jiaqi Gao, Xinyang Jiang, Yuqing Yang, Dongsheng Li, Lili Qiu

ICASSP 23 | June 2023

Author's Version

SiloD: A Co-design of Caching and Scheduling for Deep Learning Clusters

Hanyu Zhao, Zhenhua Han, Zhi Yang, Quanlu Zhang, Mingxia Li, Fan Yang, Qianxi Zhang, Binyang Li, Yuqing Yang, Lili Qiu, Lintao Zhang, Lidong Zhou

EuroSys 2023 | May 2023

Publication

CMMD: Cross-Metric Multi-Dimensional Root Cause Analysis

Shifu Yan, Caihua Shan, Wenyi Yang, Bixiong Xu, Dongsheng Li, Lili Qiu, Jie Tong, Qi Zhang

KDD 2022 | August 2022

Publication

Improving Hypernasality Estimation with Automatic Speech Recognition in Cleft Palate Speech

Kaitao Song, Teng Wan, Bixia Wang, Huiqiang Jiang, Luna K. Qiu, Jiahang Xu, Yuqing Yang, Liping Jiang, Qun Lou, Dongsheng Li, Xudong Wang, Lili Qiu

INTERSPEECH 2022 | June 2022

Publication

Mitigate Position Bias in Large Language Models via Scaling a Single Dimension

Yijiong Yu, Huiqiang Jiang, Xufang Luo, Qianhui Wu, Chin-Yew Lin, Dongsheng Li, Yuqing Yang, Yongfeng Huang, Lili Qiu

June 2024

Preprint

Large Multimodal Model for Real-World Radiology Report Generation

Brian Nlong Zhao, Xinyang Jiang, Xufang Luo, Yifan Yang, Bo Li, Zilong Wang, Javier Alvarez-Valle, Matthew P. Lungren, Dongsheng Li, Lili Qiu

December 2023

Publication

Enabling Real-time Neural Recovery for Cloud Gaming on Mobile Devices

Yifan Yang, Lili Qiu, Yuqing Yang

June 2023

Preprint

MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attention

Huiqiang Jiang, Yucheng Li, Chengruidong Zhang, Qianhui Wu, Xufang Luo, Surin Ahn, Zhenhua Han, Amir H. Abdi, Dongsheng Li, Chin-Yew Lin, Yuqing Yang, Lili Qiu

July 2024

Preprint Github Project