{"id":725710,"date":"2021-02-11T15:37:17","date_gmt":"2021-02-11T23:37:17","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-event&p=725710"},"modified":"2021-05-17T12:58:18","modified_gmt":"2021-05-17T19:58:18","slug":"iclr-2021","status":"publish","type":"msr-event","link":"https:\/\/www.microsoft.com\/en-us\/research\/event\/iclr-2021\/","title":{"rendered":"Microsoft at ICLR 2021"},"content":{"rendered":"
Conference URL:<\/strong> ICLR 2021 (opens in new tab)<\/span><\/a><\/p>\n","protected":false},"excerpt":{"rendered":" Microsoft is excited to be a Platinum sponsor of the Ninth International Conference on Learning Representation (ICLR). Stop by our virtual booth to chat with our experts, see demos of our latest research and find out more about career opportunities with Microsoft.<\/p>\n","protected":false},"featured_media":0,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","msr_startdate":"2021-05-04","msr_enddate":"2021-05-07","msr_location":"Virtual","msr_expirationdate":"","msr_event_recording_link":"","msr_event_link":"","msr_event_link_redirect":false,"msr_event_time":"","msr_hide_region":false,"msr_private_event":false,"footnotes":""},"research-area":[13556],"msr-region":[256048],"msr-event-type":[197941],"msr-video-type":[],"msr-locale":[268875],"msr-program-audience":[],"msr-post-option":[],"msr-impact-theme":[],"class_list":["post-725710","msr-event","type-msr-event","status-publish","hentry","msr-research-area-artificial-intelligence","msr-region-global","msr-event-type-conferences","msr-locale-en_us"],"msr_about":"Conference URL:<\/strong> ICLR 2021<\/a>","tab-content":[{"id":0,"name":"About","content":"Microsoft is excited to be a Platinum sponsor of the Ninth International Conference on Learning Representations (ICLR)<\/a>. Stop by our virtual booth to chat with our experts, see demos of our latest research and find out more about career opportunities with Microsoft.\r\n 01:00 \u2013 03:00 AM | Poster<\/p>\r\n What Makes Instance Discrimination Good for Transfer Learning?<\/strong><\/p>\r\nNanxuan Zhao, Zhirong Wu<\/a>, Rynson W. H. Lau, Stephen Lin<\/a>\r\n 09:00 \u2013 11:00 AM | Poster<\/p>\r\n Learning-based Support Estimation in Sublinear Time<\/strong><\/p>\r\n Talya Eden, Piotr Indyk, Shyam Narayanan, Ronitt Rubinfeld, Sandeep Silwal, Tal Wagner<\/strong><\/p>\r\nSpotlight Session: May 4<\/em>\r\n Parameter Efficient Multimodal Transformers for Video Representation Learning<\/strong><\/a><\/p>\r\nSangho Lee, Youngjae Yu, Gunhee Kim, Thomas Breuel, Jan Kautz, Yale Song<\/a>\r\n Shapley Explainability on the Data Manifold<\/strong><\/p>\r\nChristopher Frye, Damien de Mijolla, Tom Begley, Laurence Cowton, Megan Stanley<\/strong>, Ilya Feige\r\n InfoBERT: Improving Robustness of Language Models from An Information Theoretic Perspective<\/strong><\/a><\/p>\r\nBoxin Wang, Shuohang Wang<\/a>, Yu Cheng<\/a>, Zhe Gan<\/a>, Ruoxi Jia, Bo Li, Jingjing Liu<\/a>\r\n 12:35 \u2013 12:45 PM | Spotlight<\/p>\r\n Systematic Generalisation with Group Invariant Predictions<\/strong><\/p>\r\n Faruk Ahmed, Yoshua Bengio, Harm van Seijen<\/a>, Aaron Courville<\/p>\r\nPoster Session: May 4<\/em>\r\n 05:00 \u2013 07:00 PM | Poster<\/p>\r\n VA-RED$^2$: Video Adaptive Redundancy Reduction<\/strong><\/p>\r\nBowen Pan, Rameswar Panda, Camilo Luciano Fosco, Chung-Ching Lin<\/a>, Alex J Andonian, Yue Meng, Kate Saenko, Aude Oliva, Rogerio Feris\r\n SCoRe: Pre-Training for Context Representation in Conversational Semantic Parsing<\/strong><\/a><\/p>\r\nTao Yu, Rui Zhang, Alex Polozov<\/a>, Christopher Meek<\/a>, Ahmed Hassan Awadallah<\/a>\r\n DEBERTA: Decoding-Enhanced BERT with Disentangled Attention<\/strong><\/a><\/p>\r\nPengcheng He<\/a>, Xiaodong Liu<\/a>, Jianfeng Gao<\/a>, Weizhu Chen<\/a>\r\n Learning a Latent Simplex in Input Sparsity Time<\/strong><\/p>\r\n Ainesh Bakshi, Chiranjib Bhattacharyya, Ravi Kannan<\/a>, David Woodruff, Samson Zhou<\/p>\r\nSpotlight Session: May 6<\/em>\r\n Taking Notes on the Fly Helps Language Pre-Training<\/strong><\/p>\r\nQiyu Wu, Chen Xing, Yatao Li<\/a>, Guolin Ke<\/a>, Di He<\/a>, Tie-Yan Liu<\/a>\r\n MixKD: Towards Efficient Distillation of Large-scale Language Models<\/strong><\/p>\r\nKevin J Liang, Weituo Hao, Dinghan Shen<\/strong>, Yufan Zhou, Weizhu Chen<\/a>, Changyou Chen, Lawrence Carin\r\n Rethinking Positional Encoding in Language Pre-training<\/strong><\/p>\r\nGuolin Ke<\/a>, Di He<\/a>, Tie-Yan Liu<\/a>\r\n\r\n 01:00 \u2013 03:00 AM | Poster<\/p>\r\n GraphCodeBERT: Pre-training Code Representations with Data Flow<\/strong><\/a><\/p>\r\nDaya Guo, Shuo Ren, Shuai Lu, Zhangyin Feng, Duyu Tang<\/a>, Shujie Liu<\/a>, Long Zhou<\/a>, Nan Duan<\/a>, Alexey Svyatkovskiy<\/strong>, Shengyu Fu<\/strong>, Michele Tufano<\/strong>, Shao Kun Deng<\/strong>, Colin Clement<\/strong>, Dawn Drain<\/strong>, Neel Sundaresan<\/strong>, Jian Yin, Daxin Jiang<\/a>, Ming Zhou\r\n 09:00 \u2013 11:00 AM | Poster<\/p>\r\n Self-Supervised Learning of Compressed Video Representations<\/strong><\/a><\/p>\r\nYoungjae Yu, Sangho Lee, Gunhee Kim, Yale Song<\/a>\r\n Data-Efficient Reinforcement Learning with Self-Predictive Representations<\/strong><\/p>\r\n Max Schwarzer, Ankesh Anand<\/strong>, Rishab Goel, R Devon Hjelm<\/a>, Aaron Courville, Philip Bachman<\/a><\/p>\r\nSpotlight Session: May 6<\/em>\r\n Provable Rich Observation Reinforcement Learning with Combinatorial Latent States<\/strong><\/p>\r\nDipendra Misra<\/a>, Qinghua Liu, Chi Jin, John Langford<\/a>\r\n Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval<\/strong><\/a><\/p>\r\nLee Xiong<\/strong>, Chenyan Xiong<\/a>, Ye Li<\/strong>, Kwok-Fung Tang<\/strong>, Jialin Liu<\/strong>, Paul N. Bennett<\/a>, Junaid Ahmed<\/strong>, Arnold Overwikj<\/strong>\r\n Systematic Generalisation with Group Invariant Predictions<\/strong><\/p>\r\n Faruk Ahmed, Yoshua Bengio, Harm van Seijen<\/a>, Aaron Courville<\/p>\r\nSpotlight Session: May 3<\/em>\r\n 01:28 \u2013 01:38 PM | Spotlight<\/p>\r\n Learning-based Support Estimation in Sublinear Time<\/strong><\/p>\r\n Talya Eden, Piotr Indyk, Shyam Narayanan, Ronitt Rubinfeld, Sandeep Silwal, Tal Wagner<\/strong><\/p>\r\nPoster Session: May 3<\/em>\r\n 05:00 \u2013 07:00 PM | Poster<\/p>\r\n CoDA: Contrast-enhanced and Diversity-promoting Data Augmentation for Natural Language Understanding<\/strong><\/p>\r\nYanru Qu, Dinghan Shen<\/strong>, Yelong Shen<\/strong>, Sandra Sajeev<\/strong>, Weizhu Chen<\/a>, Jiawei Han\r\n Knowledge Distillation as Semiparametric Inference<\/strong><\/p>\r\nTri Dao, Govinda M Kamath<\/strong>, Vasilis Syrgkanis<\/a>, Lester Mackey<\/a>\r\n Debiasing Concept-based Explanations with Causal Analysis<\/strong><\/p>\r\nMohammad Taha Bahadori, David Heckerman<\/a>\r\n Aligning AI with Shared Human Values<\/strong><\/p>\r\nDan Hendrycks, Collin Burns, Steven Basart, Andrew Critch, Jerry Li<\/a>, Dawn Song, Jacob Steinhardt\r\n\r\n 01:00 \u2013 03:00 AM | Poster<\/p>\r\n Active Contrastive Learning of Audio-Visual Video Representations<\/strong><\/a><\/p>\r\nShuang Ma<\/strong>, Zhaoyang Zeng, Daniel McDuff<\/a>, Yale Song<\/a>\r\n Dance Revolution: Long-Term Dance Generation with Music via Curriculum Learning<\/strong><\/p>\r\nRuozi Huang, Huang Hu<\/strong>, Wei Wu, Kei Sawada, Mi Zhang, Daxin Jiang<\/a>\r\n Return-Based Contrastive Representation Learning for Reinforcement Learning<\/strong><\/a><\/p>\r\nGuoqing Liu, Chuheng Zhang, Li Zhao<\/a>, Tao Qin<\/a>, Jinhua Zhu, Li Jian, Nenghai Yu, Tie-Yan Liu<\/a>\r\n Byzantine-Resilient Non-Convex Stochastic Gradient Descent<\/strong><\/p>\r\nZeyuan AllenZhu<\/a>, Faeze Ebrahimianghazani, Jerry Li<\/a>, Dan Alistarh\r\n 09:00 \u2013 11:00 AM | Poster<\/p>\r\n Learning to Represent Action Values as a Hypergraph on the Action Vertices<\/strong><\/p>\r\nArash Tavakoli, Mehdi Fatemi<\/a>, Petar Kormushev\r\n Optimism in Reinforcement Learning with Generalized Linear Function Approximation<\/strong><\/p>\r\nYining Wang, Ruosong Wang, Simon Shaolei Du, Akshay Krishnamurthy<\/a>\r\n SEED: Self-supervised Distillation For Visual Representation<\/strong><\/p>\r\nZhiyuan Fang, Jianfeng Wang<\/strong>, Lijuan Wang<\/a>, Lei Zhang<\/a>, Yezhou Yang, Zicheng Liu<\/a>\r\n 05:00 \u2013 07:00 PM | Poster<\/p>\r\n Filtered Inner Product Projection for Crosslingual Embedding Alignment<\/strong><\/a><\/p>\r\nVin Sachidananda, Ziyi Yang, Chenguang Zhu<\/a>\r\n Economic Hyperparameter Optimization With Blended Search Strategy<\/strong><\/p>\r\nChi Wang<\/a>, Qingyun Wu<\/a>, Silu Huang<\/a>, Amin Saied<\/strong>\r\n ALFWorld: Aligning Text and Embodied Environments for Interactive Learning<\/strong><\/a><\/p>\r\nMohit Shridhar, Xingdi Yuan<\/a>, Marc-Alexandre Cote<\/a>, Yonatan Bisk, Adam Trischler<\/a>, Matthew Hausknecht<\/a>\r\n AdaFuse: Adaptive Temporal Fusion Network for Efficient Action Recognition<\/strong><\/p>\r\nYue Meng, Rameswar Panda, Chung-Ching Lin<\/a>, Prasanna Sattigeri, Leonid Karlinsky, Kate Saenko, Aude Oliva, Rogerio Feris\r\n AdaSpeech: Adaptive Text to Speech for Custom Voice<\/strong><\/p>\r\nMingjian Chen, Xu Tan<\/a>, Bohan Li, Yanqing Liu, Tao Qin<\/a>, Sheng Zhao, Tie-Yan Liu<\/a>\r\n Revisiting Dynamic Convolution via Matrix Decomposition<\/strong><\/p>\r\nYunsheng Li, Yinpeng Chen<\/a>, Xiyang Dai<\/strong>, Mengchen Liu<\/strong>, Dongdong Chen<\/strong>, Ye Yu<\/strong>, Lu Yuan<\/a>, Zicheng Liu<\/a>, Mei Chen<\/a>, Nuno Vasconcelos\r\n 07:25 \u2013 07:35 PM | Spotlight<\/p>\r\n Large Scale Image Completion via Co-Modulated Generative Adversarial Networks<\/strong><\/p>\r\n Shengyu Zhao<\/strong>, Jonathan Cui, Yilun Sheng<\/strong>, Yue Dong<\/a>, Xiao Liang, Eric I-Chao Chang<\/a>, Yan Xu<\/p>\r\nPoster Session: May 6<\/em>\r\n 07:55 \u2013 08:10 PM | Oral<\/p>\r\n Deformable DETR: Deformable Transformers for End-to-End Object Detection<\/strong><\/p>\r\n Xizhou Zhu<\/strong>, Weijie Su<\/strong>, Lewei Lu<\/strong>, Bin Li<\/a>, Xiaogang Wang<\/strong>, Jifeng Dai<\/strong><\/p>\r\nPoster Session: May 6<\/em>\r\n\r\n 01:00 \u2013 03:00 AM | Poster<\/p>\r\n Do not Let Privacy Overbill Utility: Gradient Embedding Perturbation for Private Learning<\/strong><\/a><\/p>\r\nDa Yu<\/strong>, Huishuai Zhang<\/a>, Wei Chen<\/a>, Tie-Yan Liu<\/a>\r\n IOT: Instance-wise Layer Reordering for Transformer Structures<\/strong><\/p>\r\nJinhua Zhu, Lijun Wu<\/a>, Yingce Xia<\/a>, Shufang Xie<\/a>, Tao Qin<\/a>, Wengang Zhou, Houqiang Li, Tie-Yan Liu<\/a>\r\n Deformable DETR: Deformable Transformers for End-to-End Object Detection<\/strong><\/p>\r\n Xizhou Zhu<\/strong>, Weijie Su<\/strong>, Lewei Lu<\/strong>, Bin Li<\/a>, Xiaogang Wang<\/strong>, Jifeng Dai<\/strong><\/p>\r\nOral Session: May 5<\/em>\r\n 09:00 \u2013 11:00 AM | Poster<\/p>\r\n Initialization and Regularization of Factorized Neural Layers<\/strong><\/p>\r\nMikhail Khodak, Neil A. Tenenholtz<\/a>, Lester Mackey<\/a>, Nicolo Fusi<\/a>\r\n Learning to Recombine and Resample Data For Compositional Generalization<\/strong><\/p>\r\nEkin Aky\u00fcrek, Afra Feyza Aky\u00fcrek, Jacob Andreas<\/a>\r\n Adversarial score matching and improved sampling for image generation<\/strong><\/a><\/p>\r\nAlexia Jolicoeur-Martineau, R\u00e9mi Pich\u00e9-Taillefer, Ioannis Mitliagkas, Remi Tachet des Combes<\/a>\r\n Improving Zero-Shot Voice Style Transfer via Disentangled Representation Learning<\/strong><\/p>\r\nSiyang Yuan, Pengyu Cheng, Ruiyi Zhang, Weituo Hao, Zhe Gan<\/a>, Lawrence Carin\r\n 12:40 \u2013 12:50 PM | Spotlight<\/p>\r\n Data-Efficient Reinforcement Learning with Self-Predictive Representations<\/strong><\/p>\r\n Max Schwarzer, Ankesh Anand<\/strong>, Rishab Goel, R Devon Hjelm<\/a>, Aaron Courville, Philip Bachman<\/a><\/p>\r\nPoster Session: May 4<\/em>\r\n 05:00 \u2013 07:00 PM | Poster<\/p>\r\n Representing Partial Programs with Blended Abstract Semantics<\/strong><\/p>\r\nMaxwell Nye, Yewen Pu, Matthew Bowers, Jacob Andreas<\/a>, Joshua B. Tenenbaum, Armando Solar-Lezama\r\n FastSpeech 2: Fast and High-Quality End-to-End Text to Speech<\/strong><\/p>\r\nYi Ren, Chenxu Hu, Xu Tan<\/a>, Tao Qin<\/a>, Sheng Zhao<\/strong>, Zhou Zhao, Tie-Yan Liu<\/a>\r\n Large Scale Image Completion via Co-Modulated Generative Adversarial Networks<\/strong><\/p>\r\n Shengyu Zhao<\/strong>, Jonathan Cui, Yilun Sheng<\/strong>, Yue Dong<\/a>, Xiao Liang, Eric I-Chao Chang<\/a>, Yan Xu<\/p>\r\nSpotlight Session: May 5<\/em>\r\n\r\nDynaTune: Dynamic Tensor Program Optimization in Deep Neural Network Compilation<\/strong>\r\nMinjia Zhang<\/a>, Menghao Li<\/strong>, Chi Wang<\/a>, Mingqin Li<\/strong>\r\n 08:58 \u2013 09:08 PM | Spotlight<\/p>\r\nChat with us!<\/h2>\r\nJoin us at our virtual booth<\/a> during the following PST times:\r\n
\r\n \t
Organizing Committee<\/h2>\r\nSenior Program Chair:<\/strong> Katja Hofmann<\/a>"},{"id":1,"name":"Accepted papers","content":"
Accepted papers<\/h2>\r\n*All times are displayed in PDT<\/em>\r\n
Monday, May 3<\/h3>\r\n
\r\n\r\nTuesday, May 4<\/h3>\r\n
\r\n\r\nWednesday, May 5<\/h3>\r\n
\r\n\r\nThursday, May 6<\/h3>\r\n