Microsoft at ICML 2023

Bandit Multi-linear DR-Submodular Maximization and Its Applications on Adversarial Submodular Bandits

Zongqi Wan, Jialin Zhang, Wei Chen, Xiaoming Sun, Zhijie Zhang

Proceedings of the 40th International Conference on Machine Learning (ICML) | July 2023

PDF Preprint

Bayesian Estimation of Differential Privacy

Santiago Zanella-Béguelin, Lukas Wutschitz, Shruti Tople, Ahmed Salem, Victor Ruehle, Andrew Paverd, Mohammad Naseri, Boris Köpf, Daniel Jones

2023 International Conference on Machine Learning | July 2023

Editor(s): Barbara Engelhardt, Emma Brunskill, Kyunghyun Cho

Publication Project

BEATs: Audio Pre-Training with Acoustic Tokenizers

Sanyuan Chen, Yu Wu, Chengyi Wang, Shujie Liu, Daniel Tompkins, Zhuo Chen, Furu Wei

ICML 2023 | June 2023

Publication

CircuitNet: A Generic Neural Network to Realize Universal Circuit Motif Modeling

Yansen Wang, Kan Ren, Xinyang Jiang, Caihua Shan, Xufang Luo, Dongqi Han, Kaitao Song, Yifei Shen, Dongsheng Li

ICML 2023 | August 2023

Publication

ClimaX: A foundation model for weather and climate

Tung Nguyen, Johannes Brandstetter, Ashish Kapoor, Jayesh K. Gupta, Aditya Grover

ICML 2023 | July 2023

Preprint

CO-BED: Information-Theoretic Contextual Optimization via Bayesian Experimental Design

Desi R. Ivanova, Joel Jennings, Tom Rainforth, Cheng Zhang, Adam Foster

ICML 2023 | June 2023

Publication Github

Contextual Combinatorial Bandits with Probabilistically Triggered Arms

Xutong Liu, Jinhang Zuo, Siwei Wang, John C.S. Lui, Mohammad Hajiesmaili, Adam Wierman, Wei Chen

Proceedings of the 40th International Conference on Machine Learning (ICML) | July 2023

PDF Preprint

Differentiable Multi-Target Causal Bayesian Experimental Design

Yashas Annadani, Panagiotis Tigas, Desi R. Ivanova, Andrew Jesson, Yarin Gal, Adam Foster, Stefan Bauer

ICML 2023 | June 2023

Publication

Differentiable Tree Operations Promote Compositional Generalization

Paul Soulos, Edward Hu, Kate McCurdy, Yunmo Chen, Roland Fernandez, Paul Smolensky, Jianfeng Gao

ICML 2023 | June 2023

Publication

Differentially Private Episodic Reinforcement Learning with Heavy-tailed Rewards

Yulian Wu, Xingyu Zhou, Sayak Ray Chowdhury, Di Wang

ICML 2023 | June 2023

Publication

Fairness in Streaming Submodular Maximization over a Matroid Constraint

Marwa El Halabi, Federico Fusco, Ashkan Norouzi-Fard, Jakab Tardos, Jakub Tarnawski

ICML 2023 | June 2023

Publication

Forward-backward Gaussian variational inference via JKO in the Bures-Wasserstein Space

Michael Diao, Krishnakumar Balasubramanian, Sinho Chewi, Adil Salim

ICML 2023 | June 2023

Publication

Geometric Clifford Algebra Networks

David Ruhe, Jayesh K. Gupta, Steven de Keninck, Max Welling, Johannes Brandstetter

ICML 2023 | June 2023

Publication

Global Selection of Contrastive Batches via Optimization on Sample Permutations

Vin Sachidananda, Ziyi Yang, Chenguang Zhu

ICML 2023 | July 2023

PDF Publication

Hardness of Independent Learning and Sparse Equilibrium Computation in Markov Games

Dylan Foster, Noah Golowich, Sham M. Kakade

ICML 2023 | June 2023

Publication

Hindsight Learning for MDPs with Exogenous Inputs

Sean R. Sinclair, Felipe Vieira Frujeri, Ching-An Cheng, Luke Marshall, Hugo Barbalho, Jingling Li, Jennifer Neville, Ishai Menache, Adith Swaminathan

2023 International Conference on Machine Learning | July 2023

Preprint Project

HyperTuning: Toward Adapting Large Language Models without Back-propagation

Jason Phang, Yi Mao, Pengcheng He, Weizhu Chen

ICML 2023 | June 2023

Publication

Infinite Action Contextual Bandits with Reusable Data Exhaust

Mark Rucker, Yinglun Zhu, Paul Mineiro

ICML 2023 | June 2023

Publication

InfoOT: Information Maximizing Optimal Transport

Ching-Yao Chuang, Stefanie Jegelka, David Alvarez-Melis

ICML 2023 | May 2023

Publication

Learning Instance-Specific Augmentations by Capturing Local Invariances

Ning Miao, Tom Rainforth, Emile Mathieu, Yann Dubois, Yee Whye Teh, Adam Foster, Hyunjik Kim

ICML 2023 | June 2023

Publication

Less is More: Task-aware Layer-wise Distillation for Language Model Compression

Chen Liang, Simiao Zuo, Qingru Zhang, Pengcheng He, Weizhu Chen, Tuo Zhao

ICML 2023 | June 2023

Publication

LongCoder: A Long-Range Pre-trained Language Model for Code Completion

Daya Guo, Canwen Xu, Nan Duan, Jian Yin, Julian McAuley

ICML 2023 | June 2023

Publication

LoSparse: Structured Compression of Large Language Models based on Low-Rank and Sparse Approximation

Yixiao Li, Yifan Yu, Qingru Zhang, Chen Liang, Pengcheng He, Weizhu Chen, Tuo Zhao

ICLR 2023 | May 2023

Publication

Magneto: A Foundation Transformer

Hongyu Wang, Shuming Ma, Shaohan Huang, Li Dong, Wenhui Wang, Zhiliang Peng, Yu Wu, Payal Bajaj, Saksham Singhal, Alon Benhaim, Barun Patra, Zhun Liu, Vishrav Chaudhary, Xia Song, Furu Wei

ICML 2023 | June 2023

Publication

MAHALO: Unifying Offline Reinforcement Learning and Imitation Learning from Observations

Anqi Li, Byron Boots, Ching-An Cheng

ICML 2023 | June 2023

Publication

Meta Optimal Transport

Brandon Amos, Samuel Cohen, Giulia Luise, Ievgen Redko

ICML 2023 | June 2023

Publication

Mitigating Spurious Correlations in Multi-modal Models during Fine-tuning

Yu Yang, Besmira Nushi, Hamid Palangi, Baharan Mirzasoleiman

ICML 2023 | June 2023

Publication

NeuralStagger: accelerating physics-constrained neural PDE solver with spatial-temporal decomposition

Xinquan Huang, Wenlei Shi, Qi Meng, Yue Wang, Xiaotian Gao, Jia Zhang, Tie-Yan Liu

ICML 2023 | June 2023

Publication

NP-SemiSeg: When Neural Processes meet Semi-Supervised Semantic Segmentation

Jianfeng Wang, Daniela Massiceti, Xiaolin Hu, Vladimir Pavlovic, Thomas Lukasiewicz

2023 International Conference on Machine Learning | June 2023

Author's Version

OMS-DPM: Optimizing the Model Schedule for Diffusion Probabilistic Models

Enshu Liu, Xuefei Ning, Zinan Lin, Huazhong Yang, Yu Wang

ICML 2023 | July 2023

Publication

On Over-Squashing in Message Passing Neural Networks: The Impact of Width, Depth, and Topology

Francesco Di Giovanni, Lorenzo Giusti, Federico Barbero, Giulia Luise, Pietro Lió, Michael Bronstein

ICML 2023 | May 2023

Publication

On the Expressive Power of Geometric Graph Neural Networks

Chaitanya K. Joshi, Cristian Bodnar, Simon V. Mathis, Taco Cohen, Pietro Liò

ICML 2023 | June 2023

Publication

Personalized Federated Learning with Inferred Collaboration Graphs

Rui Ye, Zhenyang Ni, Fangzhao Wu, Siheng Chen, Yan-Feng Wang

ICML 2023 | June 2023

Publication

Provable Reset-free Reinforcement Learning by No-Regret Reduction

Hoai-An Nguyen, Ching-An Cheng

ICML 2023 | February 2023

Publication

Quantum Speedups for Zero-Sum Games via Improved Dynamic Gibbs Sampling

Adam Bouland, Yosheb Getachew, Yujia Jin, Aaron Sidford, Kevin Tian

ICML 2023 | January 2023

Publication

Representation Learning with Multi-Step Inverse Kinematics: An Efficient and Optimal Approach to Rich-Observation RL

Zakaria Mhammedi, Dylan Foster, Alexander Rakhlin

ICML 2023 | April 2023

Publication

Retrosynthetic Planning with Dual Value Networks

Guoqing Liu, Di Xue, Shufang Xie, Yingce Xia, Austin Tripp, Krzysztof Maziarz, Marwin Segler, Tao Qin, Zongzhang Zhang, Tie-Yan Liu

ICML 2023 | June 2023

Publication

Rigid body flows for sampling molecular crystal structures

Jonas Köhler, Michele Invernizzi, Pim de Haan, Frank Noé

ICML 2023 | June 2023

Publication

Semi-Offline Reinforcement Learning for Optimized Text Generation

Changyu Chen, Xiting Wang, Yiqiao Jin, Victor Ye Dong, Li Dong, Jim Cao, Yi Liu, Rui Yan

International Conference on Machine Learning (ICML) | July 2023

Publication

Statistical Learning under Heterogenous Distribution Shift

Max Simchowitz, Anurag Ajay, Pulkit Agrawal, Akshay Krishnamurthy

ICML 2023 | February 2023

Publication

Streaming Active Learning with Deep Neural Networks

Akanksha Saran, Safoora Yousefi, Akshay Krishnamurthy, John Langford, Jordan Ash

ICML 2023 | March 2023

Publication

Survival Instinct in Offline Reinforcement Learning and Implicit Human Bias in Data

Anqi Li, Dipendra Misra, Andrey Kolobov, Ching-An Cheng

ICML 2023 – Interactive Learning with Implicit Human Feedback Workshop | June 2023

ORAL

Publication

Synthetic Prompting: Generating Chain-of-Thought Demonstrations for Large Language Models

Zhihong Shao, Yeyun Gong, Yelong Shen, Minlie Huang, Nan Duan, Weizhu Chen

ICML 2023 | February 2023

Publication

Target-based Surrogates for Stochastic Optimization

Jonathan Wilder Lavington, Sharan Vaswani, Reza Babanezhad, Mark Schmidt, Nicolas Le Roux

ICML 2023 | February 2023

Publication

Text Generation with Diffusion Language Models: A Pre-training Approach with Continuous Paragraph Denoise

Zhenghao Lin, Yeyun Gong, Yelong Shen, Tong Wu, Zhihao Fan, Chen Lin, Nan Duan, Weizhu Chen

ICML 2023 | February 2023

Publication

Understanding Int4 Quantization for Language Models: Latency Speedup, Composability, and Failure Cases

Xiaoxia Wu, Cheng Li, Reza Yazdani Aminabadi, Zhewei Yao, Yuxiong He

ICML 2023 | May 2023

Publication

Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studies

Gati Aher, Rosa I. Arriaga, Adam Tauman Kalai

ICML 2023 | February 2023

Publication

Width and Depth Limits Commute in Residual Networks

Soufiane Hayou, Greg Yang

ICML 2023 | February 2023

Publication

X-Paste: Revisiting Scalable Copy-Paste for Instance Segmentation using CLIP and StableDiffusion

Hanqing Zhao, Dianmo Sheng, Jianmin Bao, Dongdong Chen, Dong Chen, Fang Wen, Lu Yuan, Ce Liu, Wenbo Zhou, Qi Chu, Weiming Zhang, Nenghai Yu

ICML 2023 | May 2023

Publication

Principled Offline RL with Rich Exogenous Information

Riashat Islam, Manan Tomar, Alex Lamb, Yonathan Efroni, Hongyu Zang, Aniket Didolkar, Dipendra Misra, Xin Li, Harm van Seijen, Remi Tachet des Combes, John Langford

ICML 2023 | October 2022

Publication

Bandit Multi-linear DR-Submodular Maximization and Its Applications on Adversarial Submodular Bandits

Zongqi Wan, Jialin Zhang, Wei Chen, Xiaoming Sun, Zhijie Zhang

Proceedings of the 40th International Conference on Machine Learning (ICML) | July 2023

PDF Preprint

Bayesian Estimation of Differential Privacy

Santiago Zanella-Béguelin, Lukas Wutschitz, Shruti Tople, Ahmed Salem, Victor Ruehle, Andrew Paverd, Mohammad Naseri, Boris Köpf, Daniel Jones

2023 International Conference on Machine Learning | July 2023

Editor(s): Barbara Engelhardt, Emma Brunskill, Kyunghyun Cho

Publication Project

BEATs: Audio Pre-Training with Acoustic Tokenizers

Sanyuan Chen, Yu Wu, Chengyi Wang, Shujie Liu, Daniel Tompkins, Zhuo Chen, Furu Wei

ICML 2023 | June 2023

Publication

CircuitNet: A Generic Neural Network to Realize Universal Circuit Motif Modeling

Yansen Wang, Kan Ren, Xinyang Jiang, Caihua Shan, Xufang Luo, Dongqi Han, Kaitao Song, Yifei Shen, Dongsheng Li

ICML 2023 | August 2023

Publication

ClimaX: A foundation model for weather and climate

Tung Nguyen, Johannes Brandstetter, Ashish Kapoor, Jayesh K. Gupta, Aditya Grover

ICML 2023 | July 2023

Preprint

CO-BED: Information-Theoretic Contextual Optimization via Bayesian Experimental Design

Desi R. Ivanova, Joel Jennings, Tom Rainforth, Cheng Zhang, Adam Foster

ICML 2023 | June 2023

Publication Github

Contextual Combinatorial Bandits with Probabilistically Triggered Arms

Xutong Liu, Jinhang Zuo, Siwei Wang, John C.S. Lui, Mohammad Hajiesmaili, Adam Wierman, Wei Chen

Proceedings of the 40th International Conference on Machine Learning (ICML) | July 2023

PDF Preprint

Differentiable Multi-Target Causal Bayesian Experimental Design

Yashas Annadani, Panagiotis Tigas, Desi R. Ivanova, Andrew Jesson, Yarin Gal, Adam Foster, Stefan Bauer

ICML 2023 | June 2023

Publication

Differentiable Tree Operations Promote Compositional Generalization

Paul Soulos, Edward Hu, Kate McCurdy, Yunmo Chen, Roland Fernandez, Paul Smolensky, Jianfeng Gao

ICML 2023 | June 2023

Publication

Differentially Private Episodic Reinforcement Learning with Heavy-tailed Rewards

Yulian Wu, Xingyu Zhou, Sayak Ray Chowdhury, Di Wang

ICML 2023 | June 2023

Publication

Fairness in Streaming Submodular Maximization over a Matroid Constraint

Marwa El Halabi, Federico Fusco, Ashkan Norouzi-Fard, Jakab Tardos, Jakub Tarnawski

ICML 2023 | June 2023

Publication

Forward-backward Gaussian variational inference via JKO in the Bures-Wasserstein Space

Michael Diao, Krishnakumar Balasubramanian, Sinho Chewi, Adil Salim

ICML 2023 | June 2023

Publication

Geometric Clifford Algebra Networks

David Ruhe, Jayesh K. Gupta, Steven de Keninck, Max Welling, Johannes Brandstetter

ICML 2023 | June 2023

Publication

Hardness of Independent Learning and Sparse Equilibrium Computation in Markov Games

Dylan Foster, Noah Golowich, Sham M. Kakade

ICML 2023 | June 2023

Publication

Hindsight Learning for MDPs with Exogenous Inputs

Sean R. Sinclair, Felipe Vieira Frujeri, Ching-An Cheng, Luke Marshall, Hugo Barbalho, Jingling Li, Jennifer Neville, Ishai Menache, Adith Swaminathan

2023 International Conference on Machine Learning | July 2023

Preprint Project

HyperTuning: Toward Adapting Large Language Models without Back-propagation

Jason Phang, Yi Mao, Pengcheng He, Weizhu Chen

ICML 2023 | June 2023

Publication

Infinite Action Contextual Bandits with Reusable Data Exhaust

Mark Rucker, Yinglun Zhu, Paul Mineiro

ICML 2023 | June 2023

Publication

InfoOT: Information Maximizing Optimal Transport

Ching-Yao Chuang, Stefanie Jegelka, David Alvarez-Melis

ICML 2023 | May 2023

Publication

Learning Instance-Specific Augmentations by Capturing Local Invariances

Ning Miao, Tom Rainforth, Emile Mathieu, Yann Dubois, Yee Whye Teh, Adam Foster, Hyunjik Kim

ICML 2023 | June 2023

Publication

Less is More: Task-aware Layer-wise Distillation for Language Model Compression

Chen Liang, Simiao Zuo, Qingru Zhang, Pengcheng He, Weizhu Chen, Tuo Zhao

ICML 2023 | June 2023

Publication

LongCoder: A Long-Range Pre-trained Language Model for Code Completion

Daya Guo, Canwen Xu, Nan Duan, Jian Yin, Julian McAuley

ICML 2023 | June 2023

Publication

LoSparse: Structured Compression of Large Language Models based on Low-Rank and Sparse Approximation

Yixiao Li, Yifan Yu, Qingru Zhang, Chen Liang, Pengcheng He, Weizhu Chen, Tuo Zhao

ICLR 2023 | May 2023

Publication

Magneto: A Foundation Transformer

Hongyu Wang, Shuming Ma, Shaohan Huang, Li Dong, Wenhui Wang, Zhiliang Peng, Yu Wu, Payal Bajaj, Saksham Singhal, Alon Benhaim, Barun Patra, Zhun Liu, Vishrav Chaudhary, Xia Song, Furu Wei

ICML 2023 | June 2023

Publication

MAHALO: Unifying Offline Reinforcement Learning and Imitation Learning from Observations

Anqi Li, Byron Boots, Ching-An Cheng

ICML 2023 | June 2023

Publication

Meta Optimal Transport

Brandon Amos, Samuel Cohen, Giulia Luise, Ievgen Redko

ICML 2023 | June 2023

Publication

Mitigating Spurious Correlations in Multi-modal Models during Fine-tuning

Yu Yang, Besmira Nushi, Hamid Palangi, Baharan Mirzasoleiman

ICML 2023 | June 2023

Publication

NeuralStagger: accelerating physics-constrained neural PDE solver with spatial-temporal decomposition

Xinquan Huang, Wenlei Shi, Qi Meng, Yue Wang, Xiaotian Gao, Jia Zhang, Tie-Yan Liu

ICML 2023 | June 2023

Publication

NP-SemiSeg: When Neural Processes meet Semi-Supervised Semantic Segmentation

Jianfeng Wang, Daniela Massiceti, Xiaolin Hu, Vladimir Pavlovic, Thomas Lukasiewicz

2023 International Conference on Machine Learning | June 2023

Author's Version

OMS-DPM: Optimizing the Model Schedule for Diffusion Probabilistic Models

Enshu Liu, Xuefei Ning, Zinan Lin, Huazhong Yang, Yu Wang

ICML 2023 | July 2023

Publication

On Over-Squashing in Message Passing Neural Networks: The Impact of Width, Depth, and Topology

Francesco Di Giovanni, Lorenzo Giusti, Federico Barbero, Giulia Luise, Pietro Lió, Michael Bronstein

ICML 2023 | May 2023

Publication

On the Expressive Power of Geometric Graph Neural Networks

Chaitanya K. Joshi, Cristian Bodnar, Simon V. Mathis, Taco Cohen, Pietro Liò

ICML 2023 | June 2023

Publication

Personalized Federated Learning with Inferred Collaboration Graphs

Rui Ye, Zhenyang Ni, Fangzhao Wu, Siheng Chen, Yan-Feng Wang

ICML 2023 | June 2023

Publication

Principled Offline RL with Rich Exogenous Information

Riashat Islam, Manan Tomar, Alex Lamb, Yonathan Efroni, Hongyu Zang, Aniket Didolkar, Dipendra Misra, Xin Li, Harm van Seijen, Remi Tachet des Combes, John Langford

ICML 2023 | October 2022

Publication

Provable Reset-free Reinforcement Learning by No-Regret Reduction

Hoai-An Nguyen, Ching-An Cheng

ICML 2023 | February 2023

Publication

Quantum Speedups for Zero-Sum Games via Improved Dynamic Gibbs Sampling

Adam Bouland, Yosheb Getachew, Yujia Jin, Aaron Sidford, Kevin Tian

ICML 2023 | January 2023

Publication

Representation Learning with Multi-Step Inverse Kinematics: An Efficient and Optimal Approach to Rich-Observation RL

Zakaria Mhammedi, Dylan Foster, Alexander Rakhlin

ICML 2023 | April 2023

Publication

Retrosynthetic Planning with Dual Value Networks

Guoqing Liu, Di Xue, Shufang Xie, Yingce Xia, Austin Tripp, Krzysztof Maziarz, Marwin Segler, Tao Qin, Zongzhang Zhang, Tie-Yan Liu

ICML 2023 | June 2023

Publication

Rigid body flows for sampling molecular crystal structures

Jonas Köhler, Michele Invernizzi, Pim de Haan, Frank Noé

ICML 2023 | June 2023

Publication

Semi-Offline Reinforcement Learning for Optimized Text Generation

Changyu Chen, Xiting Wang, Yiqiao Jin, Victor Ye Dong, Li Dong, Jim Cao, Yi Liu, Rui Yan

International Conference on Machine Learning (ICML) | July 2023

Publication

Statistical Learning under Heterogenous Distribution Shift

Max Simchowitz, Anurag Ajay, Pulkit Agrawal, Akshay Krishnamurthy

ICML 2023 | February 2023

Publication

Streaming Active Learning with Deep Neural Networks

Akanksha Saran, Safoora Yousefi, Akshay Krishnamurthy, John Langford, Jordan Ash

ICML 2023 | March 2023

Publication

Survival Instinct in Offline Reinforcement Learning and Implicit Human Bias in Data

Anqi Li, Dipendra Misra, Andrey Kolobov, Ching-An Cheng

ICML 2023 – Interactive Learning with Implicit Human Feedback Workshop | June 2023

ORAL

Publication

Synthetic Prompting: Generating Chain-of-Thought Demonstrations for Large Language Models

Zhihong Shao, Yeyun Gong, Yelong Shen, Minlie Huang, Nan Duan, Weizhu Chen

ICML 2023 | February 2023

Publication

Target-based Surrogates for Stochastic Optimization

Jonathan Wilder Lavington, Sharan Vaswani, Reza Babanezhad, Mark Schmidt, Nicolas Le Roux

ICML 2023 | February 2023

Publication

Text Generation with Diffusion Language Models: A Pre-training Approach with Continuous Paragraph Denoise

Zhenghao Lin, Yeyun Gong, Yelong Shen, Tong Wu, Zhihao Fan, Chen Lin, Nan Duan, Weizhu Chen

ICML 2023 | February 2023

Publication

Understanding Int4 Quantization for Language Models: Latency Speedup, Composability, and Failure Cases

Xiaoxia Wu, Cheng Li, Reza Yazdani Aminabadi, Zhewei Yao, Yuxiong He

ICML 2023 | May 2023

Publication

Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studies

Gati Aher, Rosa I. Arriaga, Adam Tauman Kalai

ICML 2023 | February 2023

Publication

Width and Depth Limits Commute in Residual Networks

Soufiane Hayou, Greg Yang

ICML 2023 | February 2023

Publication

X-Paste: Revisiting Scalable Copy-Paste for Instance Segmentation using CLIP and StableDiffusion

Hanqing Zhao, Dianmo Sheng, Jianmin Bao, Dongdong Chen, Dong Chen, Fang Wen, Lu Yuan, Ce Liu, Wenbo Zhou, Qi Chu, Weiming Zhang, Nenghai Yu

ICML 2023 | May 2023

Publication

BEATs: Audio Pre-Training with Acoustic Tokenizers

Sanyuan Chen, Yu Wu, Chengyi Wang, Shujie Liu, Daniel Tompkins, Zhuo Chen, Furu Wei

ICML 2023 | June 2023

Publication

Geometric Clifford Algebra Networks

David Ruhe, Jayesh K. Gupta, Steven de Keninck, Max Welling, Johannes Brandstetter

ICML 2023 | June 2023

Publication

Magneto: A Foundation Transformer

Hongyu Wang, Shuming Ma, Shaohan Huang, Li Dong, Wenhui Wang, Zhiliang Peng, Yu Wu, Payal Bajaj, Saksham Singhal, Alon Benhaim, Barun Patra, Zhun Liu, Vishrav Chaudhary, Xia Song, Furu Wei

ICML 2023 | June 2023

Publication

OMS-DPM: Optimizing the Model Schedule for Diffusion Probabilistic Models

Enshu Liu, Xuefei Ning, Zinan Lin, Huazhong Yang, Yu Wang

ICML 2023 | July 2023

Publication

X-Paste: Revisiting Scalable Copy-Paste for Instance Segmentation using CLIP and StableDiffusion

Hanqing Zhao, Dianmo Sheng, Jianmin Bao, Dongdong Chen, Dong Chen, Fang Wen, Lu Yuan, Ce Liu, Wenbo Zhou, Qi Chu, Weiming Zhang, Nenghai Yu

ICML 2023 | May 2023

Publication

BEATs: Audio Pre-Training with Acoustic Tokenizers

Sanyuan Chen, Yu Wu, Chengyi Wang, Shujie Liu, Daniel Tompkins, Zhuo Chen, Furu Wei

ICML 2023 | June 2023

Publication

Differentiable Tree Operations Promote Compositional Generalization

Paul Soulos, Edward Hu, Kate McCurdy, Yunmo Chen, Roland Fernandez, Paul Smolensky, Jianfeng Gao

ICML 2023 | June 2023

Publication

Global Selection of Contrastive Batches via Optimization on Sample Permutations

Vin Sachidananda, Ziyi Yang, Chenguang Zhu

ICML 2023 | July 2023

PDF Publication

HyperTuning: Toward Adapting Large Language Models without Back-propagation

Jason Phang, Yi Mao, Pengcheng He, Weizhu Chen

ICML 2023 | June 2023

Publication

Less is More: Task-aware Layer-wise Distillation for Language Model Compression

Chen Liang, Simiao Zuo, Qingru Zhang, Pengcheng He, Weizhu Chen, Tuo Zhao

ICML 2023 | June 2023

Publication

Magneto: A Foundation Transformer

Hongyu Wang, Shuming Ma, Shaohan Huang, Li Dong, Wenhui Wang, Zhiliang Peng, Yu Wu, Payal Bajaj, Saksham Singhal, Alon Benhaim, Barun Patra, Zhun Liu, Vishrav Chaudhary, Xia Song, Furu Wei

ICML 2023 | June 2023

Publication

Forward-backward Gaussian variational inference via JKO in the Bures-Wasserstein Space

Michael Diao, Krishnakumar Balasubramanian, Sinho Chewi, Adil Salim

ICML 2023 | June 2023

Publication

LongCoder: A Long-Range Pre-trained Language Model for Code Completion

Daya Guo, Canwen Xu, Nan Duan, Jian Yin, Julian McAuley

ICML 2023 | June 2023

Publication

Quantum Speedups for Zero-Sum Games via Improved Dynamic Gibbs Sampling

Adam Bouland, Yosheb Getachew, Yujia Jin, Aaron Sidford, Kevin Tian

ICML 2023 | January 2023

Publication

Bayesian Estimation of Differential Privacy

Santiago Zanella-Béguelin, Lukas Wutschitz, Shruti Tople, Ahmed Salem, Victor Ruehle, Andrew Paverd, Mohammad Naseri, Boris Köpf, Daniel Jones

2023 International Conference on Machine Learning | July 2023

Editor(s): Barbara Engelhardt, Emma Brunskill, Kyunghyun Cho

Publication Project

Fairness in Streaming Submodular Maximization over a Matroid Constraint

Marwa El Halabi, Federico Fusco, Ashkan Norouzi-Fard, Jakab Tardos, Jakub Tarnawski

ICML 2023 | June 2023

Publication

Hindsight Learning for MDPs with Exogenous Inputs

Sean R. Sinclair, Felipe Vieira Frujeri, Ching-An Cheng, Luke Marshall, Hugo Barbalho, Jingling Li, Jennifer Neville, Ishai Menache, Adith Swaminathan

2023 International Conference on Machine Learning | July 2023

Preprint Project

LoSparse: Structured Compression of Large Language Models based on Low-Rank and Sparse Approximation

Yixiao Li, Yifan Yu, Qingru Zhang, Chen Liang, Pengcheng He, Weizhu Chen, Tuo Zhao

ICLR 2023 | May 2023

Publication

Bandit Multi-linear DR-Submodular Maximization and Its Applications on Adversarial Submodular Bandits

Zongqi Wan, Jialin Zhang, Wei Chen, Xiaoming Sun, Zhijie Zhang

Proceedings of the 40th International Conference on Machine Learning (ICML) | July 2023

PDF Preprint

Bayesian Estimation of Differential Privacy

Santiago Zanella-Béguelin, Lukas Wutschitz, Shruti Tople, Ahmed Salem, Victor Ruehle, Andrew Paverd, Mohammad Naseri, Boris Köpf, Daniel Jones

2023 International Conference on Machine Learning | July 2023

Editor(s): Barbara Engelhardt, Emma Brunskill, Kyunghyun Cho

Publication Project

BEATs: Audio Pre-Training with Acoustic Tokenizers

Sanyuan Chen, Yu Wu, Chengyi Wang, Shujie Liu, Daniel Tompkins, Zhuo Chen, Furu Wei

ICML 2023 | June 2023

Publication

CircuitNet: A Generic Neural Network to Realize Universal Circuit Motif Modeling

Yansen Wang, Kan Ren, Xinyang Jiang, Caihua Shan, Xufang Luo, Dongqi Han, Kaitao Song, Yifei Shen, Dongsheng Li

ICML 2023 | August 2023

Publication

ClimaX: A foundation model for weather and climate

Tung Nguyen, Johannes Brandstetter, Ashish Kapoor, Jayesh K. Gupta, Aditya Grover

ICML 2023 | July 2023

Preprint

CO-BED: Information-Theoretic Contextual Optimization via Bayesian Experimental Design

Desi R. Ivanova, Joel Jennings, Tom Rainforth, Cheng Zhang, Adam Foster

ICML 2023 | June 2023

Publication Github

Contextual Combinatorial Bandits with Probabilistically Triggered Arms

Xutong Liu, Jinhang Zuo, Siwei Wang, John C.S. Lui, Mohammad Hajiesmaili, Adam Wierman, Wei Chen

Proceedings of the 40th International Conference on Machine Learning (ICML) | July 2023

PDF Preprint

Differentiable Multi-Target Causal Bayesian Experimental Design

Yashas Annadani, Panagiotis Tigas, Desi R. Ivanova, Andrew Jesson, Yarin Gal, Adam Foster, Stefan Bauer

ICML 2023 | June 2023

Publication

Differentiable Tree Operations Promote Compositional Generalization

Paul Soulos, Edward Hu, Kate McCurdy, Yunmo Chen, Roland Fernandez, Paul Smolensky, Jianfeng Gao

ICML 2023 | June 2023

Publication

Differentially Private Episodic Reinforcement Learning with Heavy-tailed Rewards

Yulian Wu, Xingyu Zhou, Sayak Ray Chowdhury, Di Wang

ICML 2023 | June 2023

Publication

Fairness in Streaming Submodular Maximization over a Matroid Constraint

Marwa El Halabi, Federico Fusco, Ashkan Norouzi-Fard, Jakab Tardos, Jakub Tarnawski

ICML 2023 | June 2023

Publication

Forward-backward Gaussian variational inference via JKO in the Bures-Wasserstein Space

Michael Diao, Krishnakumar Balasubramanian, Sinho Chewi, Adil Salim

ICML 2023 | June 2023

Publication

Geometric Clifford Algebra Networks

David Ruhe, Jayesh K. Gupta, Steven de Keninck, Max Welling, Johannes Brandstetter

ICML 2023 | June 2023

Publication

Global Selection of Contrastive Batches via Optimization on Sample Permutations

Vin Sachidananda, Ziyi Yang, Chenguang Zhu

ICML 2023 | July 2023

PDF Publication

Hardness of Independent Learning and Sparse Equilibrium Computation in Markov Games

Dylan Foster, Noah Golowich, Sham M. Kakade

ICML 2023 | June 2023

Publication

Hindsight Learning for MDPs with Exogenous Inputs

Sean R. Sinclair, Felipe Vieira Frujeri, Ching-An Cheng, Luke Marshall, Hugo Barbalho, Jingling Li, Jennifer Neville, Ishai Menache, Adith Swaminathan

2023 International Conference on Machine Learning | July 2023

Preprint Project

HyperTuning: Toward Adapting Large Language Models without Back-propagation

Jason Phang, Yi Mao, Pengcheng He, Weizhu Chen

ICML 2023 | June 2023

Publication

Infinite Action Contextual Bandits with Reusable Data Exhaust

Mark Rucker, Yinglun Zhu, Paul Mineiro

ICML 2023 | June 2023

Publication

InfoOT: Information Maximizing Optimal Transport

Ching-Yao Chuang, Stefanie Jegelka, David Alvarez-Melis

ICML 2023 | May 2023

Publication

Learning Instance-Specific Augmentations by Capturing Local Invariances

Ning Miao, Tom Rainforth, Emile Mathieu, Yann Dubois, Yee Whye Teh, Adam Foster, Hyunjik Kim

ICML 2023 | June 2023

Publication

Less is More: Task-aware Layer-wise Distillation for Language Model Compression

Chen Liang, Simiao Zuo, Qingru Zhang, Pengcheng He, Weizhu Chen, Tuo Zhao

ICML 2023 | June 2023

Publication

LongCoder: A Long-Range Pre-trained Language Model for Code Completion

Daya Guo, Canwen Xu, Nan Duan, Jian Yin, Julian McAuley

ICML 2023 | June 2023

Publication

LoSparse: Structured Compression of Large Language Models based on Low-Rank and Sparse Approximation

Yixiao Li, Yifan Yu, Qingru Zhang, Chen Liang, Pengcheng He, Weizhu Chen, Tuo Zhao

ICLR 2023 | May 2023

Publication

Magneto: A Foundation Transformer

Hongyu Wang, Shuming Ma, Shaohan Huang, Li Dong, Wenhui Wang, Zhiliang Peng, Yu Wu, Payal Bajaj, Saksham Singhal, Alon Benhaim, Barun Patra, Zhun Liu, Vishrav Chaudhary, Xia Song, Furu Wei

ICML 2023 | June 2023

Publication

MAHALO: Unifying Offline Reinforcement Learning and Imitation Learning from Observations

Anqi Li, Byron Boots, Ching-An Cheng

ICML 2023 | June 2023

Publication

Meta Optimal Transport

Brandon Amos, Samuel Cohen, Giulia Luise, Ievgen Redko

ICML 2023 | June 2023

Publication

Mitigating Spurious Correlations in Multi-modal Models during Fine-tuning

Yu Yang, Besmira Nushi, Hamid Palangi, Baharan Mirzasoleiman

ICML 2023 | June 2023

Publication

NeuralStagger: accelerating physics-constrained neural PDE solver with spatial-temporal decomposition

Xinquan Huang, Wenlei Shi, Qi Meng, Yue Wang, Xiaotian Gao, Jia Zhang, Tie-Yan Liu

ICML 2023 | June 2023

Publication

NP-SemiSeg: When Neural Processes meet Semi-Supervised Semantic Segmentation

Jianfeng Wang, Daniela Massiceti, Xiaolin Hu, Vladimir Pavlovic, Thomas Lukasiewicz

2023 International Conference on Machine Learning | June 2023

Author's Version

OMS-DPM: Optimizing the Model Schedule for Diffusion Probabilistic Models

Enshu Liu, Xuefei Ning, Zinan Lin, Huazhong Yang, Yu Wang

ICML 2023 | July 2023

Publication

On Over-Squashing in Message Passing Neural Networks: The Impact of Width, Depth, and Topology

Francesco Di Giovanni, Lorenzo Giusti, Federico Barbero, Giulia Luise, Pietro Lió, Michael Bronstein

ICML 2023 | May 2023

Publication

On the Expressive Power of Geometric Graph Neural Networks

Chaitanya K. Joshi, Cristian Bodnar, Simon V. Mathis, Taco Cohen, Pietro Liò

ICML 2023 | June 2023

Publication

Personalized Federated Learning with Inferred Collaboration Graphs

Rui Ye, Zhenyang Ni, Fangzhao Wu, Siheng Chen, Yan-Feng Wang

ICML 2023 | June 2023

Publication

Principled Offline RL with Rich Exogenous Information

Riashat Islam, Manan Tomar, Alex Lamb, Yonathan Efroni, Hongyu Zang, Aniket Didolkar, Dipendra Misra, Xin Li, Harm van Seijen, Remi Tachet des Combes, John Langford

ICML 2023 | October 2022

Publication

Provable Reset-free Reinforcement Learning by No-Regret Reduction

Hoai-An Nguyen, Ching-An Cheng

ICML 2023 | February 2023

Publication

Quantum Speedups for Zero-Sum Games via Improved Dynamic Gibbs Sampling

Adam Bouland, Yosheb Getachew, Yujia Jin, Aaron Sidford, Kevin Tian

ICML 2023 | January 2023

Publication

Representation Learning with Multi-Step Inverse Kinematics: An Efficient and Optimal Approach to Rich-Observation RL

Zakaria Mhammedi, Dylan Foster, Alexander Rakhlin

ICML 2023 | April 2023

Publication

Retrosynthetic Planning with Dual Value Networks

Guoqing Liu, Di Xue, Shufang Xie, Yingce Xia, Austin Tripp, Krzysztof Maziarz, Marwin Segler, Tao Qin, Zongzhang Zhang, Tie-Yan Liu

ICML 2023 | June 2023

Publication

Rigid body flows for sampling molecular crystal structures

Jonas Köhler, Michele Invernizzi, Pim de Haan, Frank Noé

ICML 2023 | June 2023

Publication

Semi-Offline Reinforcement Learning for Optimized Text Generation

Changyu Chen, Xiting Wang, Yiqiao Jin, Victor Ye Dong, Li Dong, Jim Cao, Yi Liu, Rui Yan

International Conference on Machine Learning (ICML) | July 2023

Publication

Statistical Learning under Heterogenous Distribution Shift

Max Simchowitz, Anurag Ajay, Pulkit Agrawal, Akshay Krishnamurthy

ICML 2023 | February 2023

Publication

Streaming Active Learning with Deep Neural Networks

Akanksha Saran, Safoora Yousefi, Akshay Krishnamurthy, John Langford, Jordan Ash

ICML 2023 | March 2023

Publication

Survival Instinct in Offline Reinforcement Learning and Implicit Human Bias in Data

Anqi Li, Dipendra Misra, Andrey Kolobov, Ching-An Cheng

ICML 2023 – Interactive Learning with Implicit Human Feedback Workshop | June 2023

ORAL

Publication

Synthetic Prompting: Generating Chain-of-Thought Demonstrations for Large Language Models

Zhihong Shao, Yeyun Gong, Yelong Shen, Minlie Huang, Nan Duan, Weizhu Chen

ICML 2023 | February 2023

Publication

Target-based Surrogates for Stochastic Optimization

Jonathan Wilder Lavington, Sharan Vaswani, Reza Babanezhad, Mark Schmidt, Nicolas Le Roux

ICML 2023 | February 2023

Publication

Text Generation with Diffusion Language Models: A Pre-training Approach with Continuous Paragraph Denoise

Zhenghao Lin, Yeyun Gong, Yelong Shen, Tong Wu, Zhihao Fan, Chen Lin, Nan Duan, Weizhu Chen

ICML 2023 | February 2023

Publication

Understanding Int4 Quantization for Language Models: Latency Speedup, Composability, and Failure Cases

Xiaoxia Wu, Cheng Li, Reza Yazdani Aminabadi, Zhewei Yao, Yuxiong He

ICML 2023 | May 2023

Publication

Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studies

Gati Aher, Rosa I. Arriaga, Adam Tauman Kalai

ICML 2023 | February 2023

Publication

Width and Depth Limits Commute in Residual Networks

Soufiane Hayou, Greg Yang

ICML 2023 | February 2023

Publication

X-Paste: Revisiting Scalable Copy-Paste for Instance Segmentation using CLIP and StableDiffusion

Hanqing Zhao, Dianmo Sheng, Jianmin Bao, Dongdong Chen, Dong Chen, Fang Wen, Lu Yuan, Ce Liu, Wenbo Zhou, Qi Chu, Weiming Zhang, Nenghai Yu

ICML 2023 | May 2023

Publication