Generalization in Deep Learning

  • Bohan Wang, Qi Meng, Wei Chen, Tie-Yan Liu, On the Implicit Regularization for Adaptive Optimization Algorithms on Homogeneous Neural Networks.  In the Thirty-eighth International Conference on Machine Learning (ICML), 2021 
  • Shuxin Zheng, Qi Meng, Huishuai Zhang, Wei Chen, and Tie-Yan Liu, Capacity Control of ReLU Neural Networks by Basis-path Norm, In Proceedings of the 33rd International Association for the Advancement of Artificial Intelligence Conference (AAAI), 2019.
  • Qi Meng, Shiqi Gong, Weitao Du, Huishuai Zhang, Wei Chen, Zhiming Ma, Tie-Yan Liu, Dynamic of Stochastic Gradient Descent with State-dependent Noise. arXiv:2006.13719 (opens in new tab)