Microsoft at ICLR 2022

A Piece-wise Polynomial Filtering Approach for Graph Neural Networks

Vijay Lingam, Chanakya Ekbote, Manan Sharma, Rahul Ragesh, Arun Iyer, Sundararajan Sellamanickam

ICLR 2022 Workshop on Geometrical and Topological Representation Learning (GTRL-ICLR) | May 2022

Publication Publication Github

Adversarial Retriever-Ranker for dense text retrieval

Hang Zhang, Yeyun Gong, Yelong Shen, Jiancheng Lv, Nan Duan, Weizhu Chen

ICLR 2022 | April 2022

Publication Publication

Anti-Concentrated Confidence Bonuses for Scalable Exploration

Jordan T. Ash, Cyril Zhang, Surbhi Goel, Akshay Krishnamurthy, Sham M. Kakade

ICLR 2022 | April 2022

Publication Publication

Automatic Loss Function Search for Predict-Then-Optimize Problems with Strong Ranking Property

Boshi Wang, Jialin Yi, Hang Dong, Bo Qiao, Chuan Luo, Qingwei Lin 林庆维

ICLR 2022 | April 2022

Publication 项目

Axiomatic Explanations for Visual Search, Retrieval, and Similarity Learning

Mark Hamilton, Scott Lundberg, Stephanie Fu, Lei Zhang, William T. Freeman

ICLR 2022 | April 2022

Publication

BEiT: BERT Pre-Training of Image Transformers

Hangbo Bao, Li Dong, Songhao Piao, Furu Wei

ICLR 2022 | April 2022

Publication

Boosting the Certified Robustness of L-infinity Distance Nets

Bohang Zhang, Du Jiang, Di He, Liwei Wang

ICLR 2022 | March 2022

Publication

Creating Training Sets via Weak Indirect Supervision

Jieyu Zhang, Bohan Wang, Xiangchen Song, Yujing Wang, Yaming Yang, Jing Bai, Alexander Ratner

ICLR 2022 | April 2022

Publication

Cross-Trajectory Representation Learning for Zero-Shot Generalization in RL

Bogdan Mazoure, Ahmed Ahmed, Patrick MacAlpine, Devon Hjelm, Andrey Kolobov

ICLR 2022 | April 2022

Publication

DEPTS: Deep Expansion Learning for Periodic Time Series Forecasting

Wei Fan, Shun Zheng, Xiaohan Yi, Wei Cao, Yanjie Fu, Jiang Bian, Tie-Yan Liu

ICLR 2022 | April 2022

Publication

Differentially private fine-tuning of language models

Da Yu, Saurabh Naik, Arturs Backurs, Sivakanth Gopi, Huseyin Inan, Gautam Kamath, Janardhan (Jana) Kulkarni, Yin Tat Lee, Andre Manoel, Lukas Wutschitz, Sergey Yekhanin, Huishuai Zhang

ICLR 2022 | April 2022

Publication 项目

Distribution Compression in Near-Linear Time

Abhishek Shetty, Raaz Dwivedi, Lester Mackey

ICLR 2022 | April 2022

Publication

Efficient Computation of Deep Nonlinear Infinite-Width Neural Networks that Learn Features

Greg Yang, Michael Santacroce, Edward J. Hu

ICLR 2022 | April 2022

Publication

Efficient Self-supervised Vision Transformers for Representation Learning

Chunyuan Li, Jianwei Yang, Pengchuan Zhang, Mei Gao, Bin Xiao, Xiyang Dai, Lu Yuan, Jianfeng Gao

ICLR 2022 | April 2022

Publication Publication Github

Evaluating Distributional Distortion in Neural Language Modeling

Benjamin LeBrun, Alessandro Sordoni, Timothy J. O’Donnell

ICLR 2022 | April 2022

Publication

Explaining Point Processes by Learning Interpretable Temporal Logic Rules

Shuang Li, Mingquan Feng, Lu Wang, Abdelmajid Essofi, Yufeng Cao, Junchi Yan, Le Song

ICLR 2022 | April 2022

Publication

Exploiting Class Activation Value for Partial-Label Learning

Fei Zhang, Lei Feng, Bo Han, Tongliang Liu, Gang Niu, Tao Qin, Masashi Sugiyama

ICLR 2022 | April 2022

Publication

Generalized Kernel Thinning

Raaz Dwivedi, Lester Mackey

ICLR 2022 | April 2022

Publication

GNN is a Counter? Revisiting GNN for Question Answering

Kuan Wang, Yuyu Zhang, Diyi Yang, Le Song, Tao Qin

ICLR 2022 | April 2022

Publication

Gradient Information Matters in Policy Optimization by Back-propagating through Model

Chongchong Li, Yue Wang, Wei Chen, Yuting Liu, Zhi-Ming Ma, Tie-Yan Liu

ICLR 2022 | April 2022

Publication

Knowledge Infused Decoding

Ruibo Liu, Guoqing Zheng, Shashank Gupta, Radhika Gaonkar, Chongyang Gao, Soroush Vosoughi, Milad Shokouhi, Ahmed Awadallah

ICLR 2022 | April 2022

Publication Github

Learning Disentangled Representation by Exploiting Pretrained Generative Models: A Contrastive Learning View

Xuanchi Ren, Tao Yang, Yuwang Wang, Wenjun Zeng

ICLR 2022 | April 2022

Publication

Learning Object-Oriented Dynamics for Planning from Text

Guiliang Liu, Ashutosh Adhikari, Amir-massoud Farahmand, Pascal Poupart

ICLR 2022 | April 2022

Publication

Learning to Complete Code with Sketches

Daya Guo, Alexey Svyatkovskiy, Jian Yin, Nan Duan, Marc Brockschmidt, Miltos Allamanis

ICLR 2022 | April 2022

Publication 项目 项目

Learning to Dequantise with Truncated Flows

Shawn Tan, Chin-Wei Huang, Alessandro Sordoni, Aaron Courville

ICLR 2022 | April 2022

Publication

Learning to Downsample for Segmentation of Ultra-High Resolution Images

Chen Jin, Ryutaro Tanno, Thomy Mertzanidou, Eleftheria Panagiotaki, Daniel C. Alexander

ICLR 2022 | April 2022

Publication

Learning to Extend Molecular Scaffolds with Structural Motifs

Krzysztof Maziarz, Henry Jackson-Flux, Pashmina Cameron, Finton Sirockin, Nadine Schneider, Nikolaus Stiefl, Marwin Segler, Marc Brockschmidt

ICLR 2022 | April 2022

Publication Github 项目

LoRA: Low-Rank Adaptation of Large Language Models

Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, Weizhu Chen

ICLR 2022 | April 2022

Publication 视频 Github 项目

Message Passing Neural PDE Solvers

Johannes Brandstetter, Daniel Worrall, Max Welling

ICLR 2022 | April 2022

Publication

Minimax Optimality (Probably) Doesn’t Imply Distribution Learning for GANs

Sitan Chen, Jerry Li, Yuanzhi Li, Raghu Meka

ICLR 2022 | April 2022

Publication

Mirror Descent Policy Optimization

Manan Tomar, Lior Shani, Yonathan Efroni, Mohammad Ghavamzadeh

ICLR 2022 | April 2022

Publication

Missingness Bias in Model Debugging

Saachi Jain, Hadi Salman, Eric Wong, Pengchuan Zhang, Vibhav Vineet, Sai Vemprala, Aleksander Madry

ICLR 2022 | April 2022

Publication

Modular Lifelong Reinforcement Learning via Neural Composition

Jorge A. Mendez, Harm van Seijen, Eric Eaton

ICLR 2022 | April 2022

Publication

No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models

Chen Liang, Haoming Jiang, Simiao Zuo, Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Tuo Zhao

ICLR 2022 | April 2022

Publication Publication

Node-GAM: Neural Generalized Additive Model For Interpretable Deep Learning

Chun-Hao Chang, Rich Caruana, Anna Goldenberg

ICLR 2022 | April 2022

Publication

On the Connection between Local Attention and Dynamic Depth-wise Convolution

Qi Han, Zejia Fan, Qi Dai, Lei Sun, Ming-Ming Cheng, Jiaying Liu, Jingdong Wang

ICLR 2022 | April 2022

Publication

Optimal Transport for Causal Discovery

Ruibo Tu, Hedvig Kjellstrom, Kun Zhang, Cheng Zhang

ICLR 2022 | April 2022

Publication 项目

Pretraining Text Encoders with Adversarial Mixture of Training Signal Generators

Yu Meng, Chenyan Xiong, Payal Bajaj, Saurabh Tiwary, Paul Bennett, Jiawei Han, Xia Song

ICLR 2022 | April 2022

Publication Github

PriorGrad: Improving Conditional Denoising Diffusion Models with Data-Dependent Adaptive Prior

Sang-gil Lee, Heeseung Kim, Chaehun Shin, Xu Tan, Chang Liu, Qi Meng, Tao Qin, Wei Chen, Sungroh Yoon, Tie-Yan Liu

ICLR 2022 | April 2022

Publication

Provably Filtering Exogenous Distractors using Multistep Inverse Dynamics

Yonathan Efroni, Dipendra Misra, Akshay Krishnamurthy, Alekh Agarwal, John Langford

ICLR 2022 | April 2022

Publication

Recursive Disentanglement Network

Yixuan Chen, Yubin Shi, Dongsheng Li, Yujiang Wang, Mingzhi Dong, Yingying Zhao, Robert Dick, Qin Lv, Fan Yang, Li Shang

ICLR 2022 | April 2022

Publication

Representational Continuity for Unsupervised Continual Learning

Divyam Madaan, Jaehong Yoon, Yuanchun Li, Yunxin Liu, Sung Ju Hwang

ICLR 2022 | April 2022

Publication

Retriever: Learning Content-Style Representation as a Token-Level Bipartite Graph

Dacheng Yin, Xuanchi Ren, Chong Luo, Yuwang Wang, Zhiwei Xiong, Wenjun Zeng

ICLR 2022 | April 2022

Publication

Sampling with Mirrored Stein Operators

Jiaxin Shi, Chang Liu, Lester Mackey

ICLR 2022 | April 2022

Publication

Simple GNN Regularisation for 3D Molecular Property Prediction and Beyond

Jonathan Godwin, Michael Schaarschmidt, Alexander Gaunt, Alvaro Sanchez-Gonzalez, Yulia Rubanova, Petar Veličković, James Kirkpatrick, Peter Battaglia

ICLR 2022 | April 2022

Publication

SQuant: On-the-Fly Data-Free Quantization via Diagonal Hessian Approximation

Cong Guo, Yuxian Qiu, Jingwen Leng, Xiaotian Gao, Chen Zhang, Yunxin Liu, Fan Yang, Yuhao Zhu, Minyi Guo

ICLR 2022 | April 2022

Publication

Synchromesh: Reliable code generation from pre-trained language models

Gabriel Poesia, Alex Polozov, Vu Le, Ashish Tiwari, Gustavo Soares, Chris Meek, Sumit Gulwani

ICLR 2022 | April 2022

Publication PDF 项目

Taming Sparsely Activated Transformer with Stochastic Experts

Simiao Zuo, Xiaodong Liu, Jian Jiao, Young Jin Kim, Hany Hassan Awadalla, Ruofei Zhang, Tuo Zhao, Jianfeng Gao

ICLR 2022 | April 2022

Publication 项目

Target-Side Input Augmentation for Sequence to Sequence Generation

Shufang Xie, Ang Lv, Yingce Xia, Lijun Wu, Tao Qin, Tie-Yan Liu, Rui Yan

ICLR 2022 | April 2022

Publication

Towards Building A Group-based Unsupervised Representation Disentanglement Framework

Tao Yang, Xuanchi Ren, Yuwang Wang, Wenjun Zeng, Nanning Zheng

ICLR 2022 | April 2022

Publication

Towards Deployment-Efficient Reinforcement Learning: Lower Bound and Optimality

Jiawei Huang, Jinglin Chen, Li Zhao, Tao Qin, Nan Jiang, Tie-Yan Liu

Tenth International Conference on Learning Representations(ICLR) | April 2022

Publication

Transformer Embeddings of Irregularly Spaced Events and Their Participants

Hongyuan Mei, Chenghao Yang, Jason Eisner

ICLR 2022 | April 2022

Publication

Triangle and Four Cycle Counting with Predictions in Graph Streams

Justin Y. Chen, Talya Eden, Piotr Indyk, Honghao Lin, Shyam Narayanan, Ronitt Rubinfeld, Sandeep Silwal, Tal Wagner, David Woodruff, Michael Zhang

ICLR 2022 | April 2022

Publication

Unsupervised Learning of Full-Waveform Inversion: Connecting CNN and Partial Differential Equation in a Loop

Peng Jin, Xitong Zhang, Yinpeng Chen, Sharon X. Huang, Zicheng Liu, Youzuo Lin

ICLR 2022 | April 2022

Publication

Unsupervised Semantic Segmentation by Distilling Feature Correspondences

Mark Hamilton, Zhoutong Zhang, Bharath Hariharan, Noah Snavely, William T. Freeman

ICLR 2022 | April 2022

Publication

Variational oracle guiding for reinforcement learning

Dongqi Han, Tadashi Kozuno, Xufang Luo, Zhao-Yun Chen, Kenji Doya, Yuqing Yang, Dongsheng Li

ICLR 2022 | April 2022

Publication

Provable RL with Exogenous Distractors via Multistep Inverse Dynamics

Yonathan Efroni, Dipendra Misra, Akshay Krishnamurthy, Alekh Agarwal, John Langford

ICLR 2022 | October 2021

Publication Publication

Automatic Loss Function Search for Predict-Then-Optimize Problems with Strong Ranking Property

Boshi Wang, Jialin Yi, Hang Dong, Bo Qiao, Chuan Luo, Qingwei Lin 林庆维

ICLR 2022 | April 2022

Publication 项目

Differentially private fine-tuning of language models

Da Yu, Saurabh Naik, Arturs Backurs, Sivakanth Gopi, Huseyin Inan, Gautam Kamath, Janardhan (Jana) Kulkarni, Yin Tat Lee, Andre Manoel, Lukas Wutschitz, Sergey Yekhanin, Huishuai Zhang

ICLR 2022 | April 2022

Publication 项目

A Piece-wise Polynomial Filtering Approach for Graph Neural Networks

Vijay Lingam, Chanakya Ekbote, Manan Sharma, Rahul Ragesh, Arun Iyer, Sundararajan Sellamanickam

ICLR 2022 Workshop on Geometrical and Topological Representation Learning (GTRL-ICLR) | May 2022

Publication Publication Github

Adversarial Retriever-Ranker for dense text retrieval

Hang Zhang, Yeyun Gong, Yelong Shen, Jiancheng Lv, Nan Duan, Weizhu Chen

ICLR 2022 | April 2022

Publication Publication

Anti-Concentrated Confidence Bonuses for Scalable Exploration

Jordan T. Ash, Cyril Zhang, Surbhi Goel, Akshay Krishnamurthy, Sham M. Kakade

ICLR 2022 | April 2022

Publication Publication

Automatic Loss Function Search for Predict-Then-Optimize Problems with Strong Ranking Property

Boshi Wang, Jialin Yi, Hang Dong, Bo Qiao, Chuan Luo, Qingwei Lin 林庆维

ICLR 2022 | April 2022

Publication 项目

Axiomatic Explanations for Visual Search, Retrieval, and Similarity Learning

Mark Hamilton, Scott Lundberg, Stephanie Fu, Lei Zhang, William T. Freeman

ICLR 2022 | April 2022

Publication

BEiT: BERT Pre-Training of Image Transformers

Hangbo Bao, Li Dong, Songhao Piao, Furu Wei

ICLR 2022 | April 2022

Publication

Boosting the Certified Robustness of L-infinity Distance Nets

Bohang Zhang, Du Jiang, Di He, Liwei Wang

ICLR 2022 | March 2022

Publication

Creating Training Sets via Weak Indirect Supervision

Jieyu Zhang, Bohan Wang, Xiangchen Song, Yujing Wang, Yaming Yang, Jing Bai, Alexander Ratner

ICLR 2022 | April 2022

Publication

Cross-Trajectory Representation Learning for Zero-Shot Generalization in RL

Bogdan Mazoure, Ahmed Ahmed, Patrick MacAlpine, Devon Hjelm, Andrey Kolobov

ICLR 2022 | April 2022

Publication

DEPTS: Deep Expansion Learning for Periodic Time Series Forecasting

Wei Fan, Shun Zheng, Xiaohan Yi, Wei Cao, Yanjie Fu, Jiang Bian, Tie-Yan Liu

ICLR 2022 | April 2022

Publication

Distribution Compression in Near-Linear Time

Abhishek Shetty, Raaz Dwivedi, Lester Mackey

ICLR 2022 | April 2022

Publication

Efficient Computation of Deep Nonlinear Infinite-Width Neural Networks that Learn Features

Greg Yang, Michael Santacroce, Edward J. Hu

ICLR 2022 | April 2022

Publication

Efficient Self-supervised Vision Transformers for Representation Learning

Chunyuan Li, Jianwei Yang, Pengchuan Zhang, Mei Gao, Bin Xiao, Xiyang Dai, Lu Yuan, Jianfeng Gao

ICLR 2022 | April 2022

Publication Publication Github

Evaluating Distributional Distortion in Neural Language Modeling

Benjamin LeBrun, Alessandro Sordoni, Timothy J. O’Donnell

ICLR 2022 | April 2022

Publication

Explaining Point Processes by Learning Interpretable Temporal Logic Rules

Shuang Li, Mingquan Feng, Lu Wang, Abdelmajid Essofi, Yufeng Cao, Junchi Yan, Le Song

ICLR 2022 | April 2022

Publication

Exploiting Class Activation Value for Partial-Label Learning

Fei Zhang, Lei Feng, Bo Han, Tongliang Liu, Gang Niu, Tao Qin, Masashi Sugiyama

ICLR 2022 | April 2022

Publication

Generalized Kernel Thinning

Raaz Dwivedi, Lester Mackey

ICLR 2022 | April 2022

Publication

GNN is a Counter? Revisiting GNN for Question Answering

Kuan Wang, Yuyu Zhang, Diyi Yang, Le Song, Tao Qin

ICLR 2022 | April 2022

Publication

Gradient Information Matters in Policy Optimization by Back-propagating through Model

Chongchong Li, Yue Wang, Wei Chen, Yuting Liu, Zhi-Ming Ma, Tie-Yan Liu

ICLR 2022 | April 2022

Publication

Knowledge Infused Decoding

Ruibo Liu, Guoqing Zheng, Shashank Gupta, Radhika Gaonkar, Chongyang Gao, Soroush Vosoughi, Milad Shokouhi, Ahmed Awadallah

ICLR 2022 | April 2022

Publication Github

Learning Disentangled Representation by Exploiting Pretrained Generative Models: A Contrastive Learning View

Xuanchi Ren, Tao Yang, Yuwang Wang, Wenjun Zeng

ICLR 2022 | April 2022

Publication

Learning Object-Oriented Dynamics for Planning from Text

Guiliang Liu, Ashutosh Adhikari, Amir-massoud Farahmand, Pascal Poupart

ICLR 2022 | April 2022

Publication

Learning to Complete Code with Sketches

Daya Guo, Alexey Svyatkovskiy, Jian Yin, Nan Duan, Marc Brockschmidt, Miltos Allamanis

ICLR 2022 | April 2022

Publication 项目 项目

Learning to Dequantise with Truncated Flows

Shawn Tan, Chin-Wei Huang, Alessandro Sordoni, Aaron Courville

ICLR 2022 | April 2022

Publication

Learning to Downsample for Segmentation of Ultra-High Resolution Images

Chen Jin, Ryutaro Tanno, Thomy Mertzanidou, Eleftheria Panagiotaki, Daniel C. Alexander

ICLR 2022 | April 2022

Publication

Learning to Extend Molecular Scaffolds with Structural Motifs

Krzysztof Maziarz, Henry Jackson-Flux, Pashmina Cameron, Finton Sirockin, Nadine Schneider, Nikolaus Stiefl, Marwin Segler, Marc Brockschmidt

ICLR 2022 | April 2022

Publication Github 项目

LoRA: Low-Rank Adaptation of Large Language Models

Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, Weizhu Chen

ICLR 2022 | April 2022

Publication 视频 Github 项目

Message Passing Neural PDE Solvers

Johannes Brandstetter, Daniel Worrall, Max Welling

ICLR 2022 | April 2022

Publication

Minimax Optimality (Probably) Doesn’t Imply Distribution Learning for GANs

Sitan Chen, Jerry Li, Yuanzhi Li, Raghu Meka

ICLR 2022 | April 2022

Publication

Mirror Descent Policy Optimization

Manan Tomar, Lior Shani, Yonathan Efroni, Mohammad Ghavamzadeh

ICLR 2022 | April 2022

Publication

Missingness Bias in Model Debugging

Saachi Jain, Hadi Salman, Eric Wong, Pengchuan Zhang, Vibhav Vineet, Sai Vemprala, Aleksander Madry

ICLR 2022 | April 2022

Publication

Modular Lifelong Reinforcement Learning via Neural Composition

Jorge A. Mendez, Harm van Seijen, Eric Eaton

ICLR 2022 | April 2022

Publication

No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models

Chen Liang, Haoming Jiang, Simiao Zuo, Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Tuo Zhao

ICLR 2022 | April 2022

Publication Publication

Node-GAM: Neural Generalized Additive Model For Interpretable Deep Learning

Chun-Hao Chang, Rich Caruana, Anna Goldenberg

ICLR 2022 | April 2022

Publication

On the Connection between Local Attention and Dynamic Depth-wise Convolution

Qi Han, Zejia Fan, Qi Dai, Lei Sun, Ming-Ming Cheng, Jiaying Liu, Jingdong Wang

ICLR 2022 | April 2022

Publication

Optimal Transport for Causal Discovery

Ruibo Tu, Hedvig Kjellstrom, Kun Zhang, Cheng Zhang

ICLR 2022 | April 2022

Publication 项目

Pretraining Text Encoders with Adversarial Mixture of Training Signal Generators

Yu Meng, Chenyan Xiong, Payal Bajaj, Saurabh Tiwary, Paul Bennett, Jiawei Han, Xia Song

ICLR 2022 | April 2022

Publication Github

PriorGrad: Improving Conditional Denoising Diffusion Models with Data-Dependent Adaptive Prior

Sang-gil Lee, Heeseung Kim, Chaehun Shin, Xu Tan, Chang Liu, Qi Meng, Tao Qin, Wei Chen, Sungroh Yoon, Tie-Yan Liu

ICLR 2022 | April 2022

Publication

Provable RL with Exogenous Distractors via Multistep Inverse Dynamics

Yonathan Efroni, Dipendra Misra, Akshay Krishnamurthy, Alekh Agarwal, John Langford

ICLR 2022 | October 2021

Publication Publication

Provably Filtering Exogenous Distractors using Multistep Inverse Dynamics

Yonathan Efroni, Dipendra Misra, Akshay Krishnamurthy, Alekh Agarwal, John Langford

ICLR 2022 | April 2022

Publication

Recursive Disentanglement Network

Yixuan Chen, Yubin Shi, Dongsheng Li, Yujiang Wang, Mingzhi Dong, Yingying Zhao, Robert Dick, Qin Lv, Fan Yang, Li Shang

ICLR 2022 | April 2022

Publication

Representational Continuity for Unsupervised Continual Learning

Divyam Madaan, Jaehong Yoon, Yuanchun Li, Yunxin Liu, Sung Ju Hwang

ICLR 2022 | April 2022

Publication

Retriever: Learning Content-Style Representation as a Token-Level Bipartite Graph

Dacheng Yin, Xuanchi Ren, Chong Luo, Yuwang Wang, Zhiwei Xiong, Wenjun Zeng

ICLR 2022 | April 2022

Publication

Sampling with Mirrored Stein Operators

Jiaxin Shi, Chang Liu, Lester Mackey

ICLR 2022 | April 2022

Publication

Simple GNN Regularisation for 3D Molecular Property Prediction and Beyond

Jonathan Godwin, Michael Schaarschmidt, Alexander Gaunt, Alvaro Sanchez-Gonzalez, Yulia Rubanova, Petar Veličković, James Kirkpatrick, Peter Battaglia

ICLR 2022 | April 2022

Publication

SQuant: On-the-Fly Data-Free Quantization via Diagonal Hessian Approximation

Cong Guo, Yuxian Qiu, Jingwen Leng, Xiaotian Gao, Chen Zhang, Yunxin Liu, Fan Yang, Yuhao Zhu, Minyi Guo

ICLR 2022 | April 2022

Publication

Synchromesh: Reliable code generation from pre-trained language models

Gabriel Poesia, Alex Polozov, Vu Le, Ashish Tiwari, Gustavo Soares, Chris Meek, Sumit Gulwani

ICLR 2022 | April 2022

Publication PDF 项目

Taming Sparsely Activated Transformer with Stochastic Experts

Simiao Zuo, Xiaodong Liu, Jian Jiao, Young Jin Kim, Hany Hassan Awadalla, Ruofei Zhang, Tuo Zhao, Jianfeng Gao

ICLR 2022 | April 2022

Publication 项目

Target-Side Input Augmentation for Sequence to Sequence Generation

Shufang Xie, Ang Lv, Yingce Xia, Lijun Wu, Tao Qin, Tie-Yan Liu, Rui Yan

ICLR 2022 | April 2022

Publication

Towards Building A Group-based Unsupervised Representation Disentanglement Framework

Tao Yang, Xuanchi Ren, Yuwang Wang, Wenjun Zeng, Nanning Zheng

ICLR 2022 | April 2022

Publication

Towards Deployment-Efficient Reinforcement Learning: Lower Bound and Optimality

Jiawei Huang, Jinglin Chen, Li Zhao, Tao Qin, Nan Jiang, Tie-Yan Liu

Tenth International Conference on Learning Representations(ICLR) | April 2022

Publication

Transformer Embeddings of Irregularly Spaced Events and Their Participants

Hongyuan Mei, Chenghao Yang, Jason Eisner

ICLR 2022 | April 2022

Publication

Triangle and Four Cycle Counting with Predictions in Graph Streams

Justin Y. Chen, Talya Eden, Piotr Indyk, Honghao Lin, Shyam Narayanan, Ronitt Rubinfeld, Sandeep Silwal, Tal Wagner, David Woodruff, Michael Zhang

ICLR 2022 | April 2022

Publication

Unsupervised Learning of Full-Waveform Inversion: Connecting CNN and Partial Differential Equation in a Loop

Peng Jin, Xitong Zhang, Yinpeng Chen, Sharon X. Huang, Zicheng Liu, Youzuo Lin

ICLR 2022 | April 2022

Publication

Unsupervised Semantic Segmentation by Distilling Feature Correspondences

Mark Hamilton, Zhoutong Zhang, Bharath Hariharan, Noah Snavely, William T. Freeman

ICLR 2022 | April 2022

Publication

Variational oracle guiding for reinforcement learning

Dongqi Han, Tadashi Kozuno, Xufang Luo, Zhao-Yun Chen, Kenji Doya, Yuqing Yang, Dongsheng Li

ICLR 2022 | April 2022

Publication

Efficient Self-supervised Vision Transformers for Representation Learning

Chunyuan Li, Jianwei Yang, Pengchuan Zhang, Mei Gao, Bin Xiao, Xiyang Dai, Lu Yuan, Jianfeng Gao

ICLR 2022 | April 2022

Publication Publication Github

Automatic Loss Function Search for Predict-Then-Optimize Problems with Strong Ranking Property

Boshi Wang, Jialin Yi, Hang Dong, Bo Qiao, Chuan Luo, Qingwei Lin 林庆维

ICLR 2022 | April 2022

Publication 项目

Adversarial Retriever-Ranker for dense text retrieval

Hang Zhang, Yeyun Gong, Yelong Shen, Jiancheng Lv, Nan Duan, Weizhu Chen

ICLR 2022 | April 2022

Publication Publication

Knowledge Infused Decoding

Ruibo Liu, Guoqing Zheng, Shashank Gupta, Radhika Gaonkar, Chongyang Gao, Soroush Vosoughi, Milad Shokouhi, Ahmed Awadallah

ICLR 2022 | April 2022

Publication Github

LoRA: Low-Rank Adaptation of Large Language Models

Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, Weizhu Chen

ICLR 2022 | April 2022

Publication 视频 Github 项目

Taming Sparsely Activated Transformer with Stochastic Experts

Simiao Zuo, Xiaodong Liu, Jian Jiao, Young Jin Kim, Hany Hassan Awadalla, Ruofei Zhang, Tuo Zhao, Jianfeng Gao

ICLR 2022 | April 2022

Publication 项目

Learning to Complete Code with Sketches

Daya Guo, Alexey Svyatkovskiy, Jian Yin, Nan Duan, Marc Brockschmidt, Miltos Allamanis

ICLR 2022 | April 2022

Publication 项目 项目

Minimax Optimality (Probably) Doesn’t Imply Distribution Learning for GANs

Sitan Chen, Jerry Li, Yuanzhi Li, Raghu Meka

ICLR 2022 | April 2022

Publication

Simple GNN Regularisation for 3D Molecular Property Prediction and Beyond

Jonathan Godwin, Michael Schaarschmidt, Alexander Gaunt, Alvaro Sanchez-Gonzalez, Yulia Rubanova, Petar Veličković, James Kirkpatrick, Peter Battaglia

ICLR 2022 | April 2022

Publication

A Piece-wise Polynomial Filtering Approach for Graph Neural Networks

Vijay Lingam, Chanakya Ekbote, Manan Sharma, Rahul Ragesh, Arun Iyer, Sundararajan Sellamanickam

ICLR 2022 Workshop on Geometrical and Topological Representation Learning (GTRL-ICLR) | May 2022

Publication Publication Github

Adversarial Retriever-Ranker for dense text retrieval

Hang Zhang, Yeyun Gong, Yelong Shen, Jiancheng Lv, Nan Duan, Weizhu Chen

ICLR 2022 | April 2022

Publication Publication

Anti-Concentrated Confidence Bonuses for Scalable Exploration

Jordan T. Ash, Cyril Zhang, Surbhi Goel, Akshay Krishnamurthy, Sham M. Kakade

ICLR 2022 | April 2022

Publication Publication

Automatic Loss Function Search for Predict-Then-Optimize Problems with Strong Ranking Property

Boshi Wang, Jialin Yi, Hang Dong, Bo Qiao, Chuan Luo, Qingwei Lin 林庆维

ICLR 2022 | April 2022

Publication 项目

Axiomatic Explanations for Visual Search, Retrieval, and Similarity Learning

Mark Hamilton, Scott Lundberg, Stephanie Fu, Lei Zhang, William T. Freeman

ICLR 2022 | April 2022

Publication

BEiT: BERT Pre-Training of Image Transformers

Hangbo Bao, Li Dong, Songhao Piao, Furu Wei

ICLR 2022 | April 2022

Publication

Boosting the Certified Robustness of L-infinity Distance Nets

Bohang Zhang, Du Jiang, Di He, Liwei Wang

ICLR 2022 | March 2022

Publication

Creating Training Sets via Weak Indirect Supervision

Jieyu Zhang, Bohan Wang, Xiangchen Song, Yujing Wang, Yaming Yang, Jing Bai, Alexander Ratner

ICLR 2022 | April 2022

Publication

Cross-Trajectory Representation Learning for Zero-Shot Generalization in RL

Bogdan Mazoure, Ahmed Ahmed, Patrick MacAlpine, Devon Hjelm, Andrey Kolobov

ICLR 2022 | April 2022

Publication

DEPTS: Deep Expansion Learning for Periodic Time Series Forecasting

Wei Fan, Shun Zheng, Xiaohan Yi, Wei Cao, Yanjie Fu, Jiang Bian, Tie-Yan Liu

ICLR 2022 | April 2022

Publication

Differentially private fine-tuning of language models

Da Yu, Saurabh Naik, Arturs Backurs, Sivakanth Gopi, Huseyin Inan, Gautam Kamath, Janardhan (Jana) Kulkarni, Yin Tat Lee, Andre Manoel, Lukas Wutschitz, Sergey Yekhanin, Huishuai Zhang

ICLR 2022 | April 2022

Publication 项目

Distribution Compression in Near-Linear Time

Abhishek Shetty, Raaz Dwivedi, Lester Mackey

ICLR 2022 | April 2022

Publication

Efficient Computation of Deep Nonlinear Infinite-Width Neural Networks that Learn Features

Greg Yang, Michael Santacroce, Edward J. Hu

ICLR 2022 | April 2022

Publication

Efficient Self-supervised Vision Transformers for Representation Learning

Chunyuan Li, Jianwei Yang, Pengchuan Zhang, Mei Gao, Bin Xiao, Xiyang Dai, Lu Yuan, Jianfeng Gao

ICLR 2022 | April 2022

Publication Publication Github

Evaluating Distributional Distortion in Neural Language Modeling

Benjamin LeBrun, Alessandro Sordoni, Timothy J. O’Donnell

ICLR 2022 | April 2022

Publication

Explaining Point Processes by Learning Interpretable Temporal Logic Rules

Shuang Li, Mingquan Feng, Lu Wang, Abdelmajid Essofi, Yufeng Cao, Junchi Yan, Le Song

ICLR 2022 | April 2022

Publication

Exploiting Class Activation Value for Partial-Label Learning

Fei Zhang, Lei Feng, Bo Han, Tongliang Liu, Gang Niu, Tao Qin, Masashi Sugiyama

ICLR 2022 | April 2022

Publication

Generalized Kernel Thinning

Raaz Dwivedi, Lester Mackey

ICLR 2022 | April 2022

Publication

GNN is a Counter? Revisiting GNN for Question Answering

Kuan Wang, Yuyu Zhang, Diyi Yang, Le Song, Tao Qin

ICLR 2022 | April 2022

Publication

Gradient Information Matters in Policy Optimization by Back-propagating through Model

Chongchong Li, Yue Wang, Wei Chen, Yuting Liu, Zhi-Ming Ma, Tie-Yan Liu

ICLR 2022 | April 2022

Publication

Knowledge Infused Decoding

Ruibo Liu, Guoqing Zheng, Shashank Gupta, Radhika Gaonkar, Chongyang Gao, Soroush Vosoughi, Milad Shokouhi, Ahmed Awadallah

ICLR 2022 | April 2022

Publication Github

Learning Disentangled Representation by Exploiting Pretrained Generative Models: A Contrastive Learning View

Xuanchi Ren, Tao Yang, Yuwang Wang, Wenjun Zeng

ICLR 2022 | April 2022

Publication

Learning Object-Oriented Dynamics for Planning from Text

Guiliang Liu, Ashutosh Adhikari, Amir-massoud Farahmand, Pascal Poupart

ICLR 2022 | April 2022

Publication

Learning to Complete Code with Sketches

Daya Guo, Alexey Svyatkovskiy, Jian Yin, Nan Duan, Marc Brockschmidt, Miltos Allamanis

ICLR 2022 | April 2022

Publication 项目 项目

Learning to Dequantise with Truncated Flows

Shawn Tan, Chin-Wei Huang, Alessandro Sordoni, Aaron Courville

ICLR 2022 | April 2022

Publication

Learning to Downsample for Segmentation of Ultra-High Resolution Images

Chen Jin, Ryutaro Tanno, Thomy Mertzanidou, Eleftheria Panagiotaki, Daniel C. Alexander

ICLR 2022 | April 2022

Publication

Learning to Extend Molecular Scaffolds with Structural Motifs

Krzysztof Maziarz, Henry Jackson-Flux, Pashmina Cameron, Finton Sirockin, Nadine Schneider, Nikolaus Stiefl, Marwin Segler, Marc Brockschmidt

ICLR 2022 | April 2022

Publication Github 项目

LoRA: Low-Rank Adaptation of Large Language Models

Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, Weizhu Chen

ICLR 2022 | April 2022

Publication 视频 Github 项目

Message Passing Neural PDE Solvers

Johannes Brandstetter, Daniel Worrall, Max Welling

ICLR 2022 | April 2022

Publication

Minimax Optimality (Probably) Doesn’t Imply Distribution Learning for GANs

Sitan Chen, Jerry Li, Yuanzhi Li, Raghu Meka

ICLR 2022 | April 2022

Publication

Mirror Descent Policy Optimization

Manan Tomar, Lior Shani, Yonathan Efroni, Mohammad Ghavamzadeh

ICLR 2022 | April 2022

Publication

Missingness Bias in Model Debugging

Saachi Jain, Hadi Salman, Eric Wong, Pengchuan Zhang, Vibhav Vineet, Sai Vemprala, Aleksander Madry

ICLR 2022 | April 2022

Publication

Modular Lifelong Reinforcement Learning via Neural Composition

Jorge A. Mendez, Harm van Seijen, Eric Eaton

ICLR 2022 | April 2022

Publication

No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models

Chen Liang, Haoming Jiang, Simiao Zuo, Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Tuo Zhao

ICLR 2022 | April 2022

Publication Publication

Node-GAM: Neural Generalized Additive Model For Interpretable Deep Learning

Chun-Hao Chang, Rich Caruana, Anna Goldenberg

ICLR 2022 | April 2022

Publication

On the Connection between Local Attention and Dynamic Depth-wise Convolution

Qi Han, Zejia Fan, Qi Dai, Lei Sun, Ming-Ming Cheng, Jiaying Liu, Jingdong Wang

ICLR 2022 | April 2022

Publication

Optimal Transport for Causal Discovery

Ruibo Tu, Hedvig Kjellstrom, Kun Zhang, Cheng Zhang

ICLR 2022 | April 2022

Publication 项目

Pretraining Text Encoders with Adversarial Mixture of Training Signal Generators

Yu Meng, Chenyan Xiong, Payal Bajaj, Saurabh Tiwary, Paul Bennett, Jiawei Han, Xia Song

ICLR 2022 | April 2022

Publication Github

PriorGrad: Improving Conditional Denoising Diffusion Models with Data-Dependent Adaptive Prior

Sang-gil Lee, Heeseung Kim, Chaehun Shin, Xu Tan, Chang Liu, Qi Meng, Tao Qin, Wei Chen, Sungroh Yoon, Tie-Yan Liu

ICLR 2022 | April 2022

Publication

Provable RL with Exogenous Distractors via Multistep Inverse Dynamics

Yonathan Efroni, Dipendra Misra, Akshay Krishnamurthy, Alekh Agarwal, John Langford

ICLR 2022 | October 2021

Publication Publication

Provably Filtering Exogenous Distractors using Multistep Inverse Dynamics

Yonathan Efroni, Dipendra Misra, Akshay Krishnamurthy, Alekh Agarwal, John Langford

ICLR 2022 | April 2022

Publication

Recursive Disentanglement Network

Yixuan Chen, Yubin Shi, Dongsheng Li, Yujiang Wang, Mingzhi Dong, Yingying Zhao, Robert Dick, Qin Lv, Fan Yang, Li Shang

ICLR 2022 | April 2022

Publication

Representational Continuity for Unsupervised Continual Learning

Divyam Madaan, Jaehong Yoon, Yuanchun Li, Yunxin Liu, Sung Ju Hwang

ICLR 2022 | April 2022

Publication

Retriever: Learning Content-Style Representation as a Token-Level Bipartite Graph

Dacheng Yin, Xuanchi Ren, Chong Luo, Yuwang Wang, Zhiwei Xiong, Wenjun Zeng

ICLR 2022 | April 2022

Publication

Sampling with Mirrored Stein Operators

Jiaxin Shi, Chang Liu, Lester Mackey

ICLR 2022 | April 2022

Publication

Simple GNN Regularisation for 3D Molecular Property Prediction and Beyond

Jonathan Godwin, Michael Schaarschmidt, Alexander Gaunt, Alvaro Sanchez-Gonzalez, Yulia Rubanova, Petar Veličković, James Kirkpatrick, Peter Battaglia

ICLR 2022 | April 2022

Publication

SQuant: On-the-Fly Data-Free Quantization via Diagonal Hessian Approximation

Cong Guo, Yuxian Qiu, Jingwen Leng, Xiaotian Gao, Chen Zhang, Yunxin Liu, Fan Yang, Yuhao Zhu, Minyi Guo

ICLR 2022 | April 2022

Publication

Synchromesh: Reliable code generation from pre-trained language models

Gabriel Poesia, Alex Polozov, Vu Le, Ashish Tiwari, Gustavo Soares, Chris Meek, Sumit Gulwani

ICLR 2022 | April 2022

Publication PDF 项目

Taming Sparsely Activated Transformer with Stochastic Experts

Simiao Zuo, Xiaodong Liu, Jian Jiao, Young Jin Kim, Hany Hassan Awadalla, Ruofei Zhang, Tuo Zhao, Jianfeng Gao

ICLR 2022 | April 2022

Publication 项目

Target-Side Input Augmentation for Sequence to Sequence Generation

Shufang Xie, Ang Lv, Yingce Xia, Lijun Wu, Tao Qin, Tie-Yan Liu, Rui Yan

ICLR 2022 | April 2022

Publication

Towards Building A Group-based Unsupervised Representation Disentanglement Framework

Tao Yang, Xuanchi Ren, Yuwang Wang, Wenjun Zeng, Nanning Zheng

ICLR 2022 | April 2022

Publication

Towards Deployment-Efficient Reinforcement Learning: Lower Bound and Optimality

Jiawei Huang, Jinglin Chen, Li Zhao, Tao Qin, Nan Jiang, Tie-Yan Liu

Tenth International Conference on Learning Representations(ICLR) | April 2022

Publication

Transformer Embeddings of Irregularly Spaced Events and Their Participants

Hongyuan Mei, Chenghao Yang, Jason Eisner

ICLR 2022 | April 2022

Publication

Triangle and Four Cycle Counting with Predictions in Graph Streams

Justin Y. Chen, Talya Eden, Piotr Indyk, Honghao Lin, Shyam Narayanan, Ronitt Rubinfeld, Sandeep Silwal, Tal Wagner, David Woodruff, Michael Zhang

ICLR 2022 | April 2022

Publication

Unsupervised Learning of Full-Waveform Inversion: Connecting CNN and Partial Differential Equation in a Loop

Peng Jin, Xitong Zhang, Yinpeng Chen, Sharon X. Huang, Zicheng Liu, Youzuo Lin

ICLR 2022 | April 2022

Publication

Unsupervised Semantic Segmentation by Distilling Feature Correspondences

Mark Hamilton, Zhoutong Zhang, Bharath Hariharan, Noah Snavely, William T. Freeman

ICLR 2022 | April 2022

Publication

Variational oracle guiding for reinforcement learning

Dongqi Han, Tadashi Kozuno, Xufang Luo, Zhao-Yun Chen, Kenji Doya, Yuqing Yang, Dongsheng Li

ICLR 2022 | April 2022

Publication