About Myself
Hi, I am a Ph.D. student of the joint Ph.D. Program of USTC and Microsoft Research (Asia). I am very fortunate to be advised by Professor Wei Chen and Professor Zhi-Ming Ma. I also work closely with Dr. Qi Meng, Dr. Huishuai Zhang, and Prof. Ruoyu Sun.
Research Interests
I am broadly interested in the linear span of optimization, generalization and representation in deep learning.
Prepints
- Provable Adaptivity in Adam
Bohan Wang, Yushun Zhang, Huishuai Zhang, Qi Meng, Zhi-Ming Ma, Tie-Yan Liu, Wei Chen
Remark: This is a very exciting paper on why Adam outperforms SGD from the perspective of global convergence analysis. A brief introduction (in Chinese) can be found here.
Publication (* denotes equal contribution)
- $\mathcal{O}$-GNN: incorporating ring priors into molecular modeling
Jinhua Zhu, Kehan Wu, Bohan Wang, Yingce Xia, Shufang Xie, Qi Meng, Lijun Wu, Tao Qin, Wengang Zhou, Houqiang Li, Tie-Yan Liu
ICLR 2023.
- Does Momentum Change the Implicit Regularization on Separable Data?
Bohan Wang, Qi Meng, Huishuai Zhang, Ruoyu Sun, Wei Chen, Zhi-Ming Ma, Tie-Yan Liu
Neurips 2022 (Spotlight).
- Creating Training Sets via Weak Indirect Supervision
Jieyu Zhang, Bohan Wang, Xiangchen Song, Yujing Wang, Yaming Yang, Jing Bai, Alexander Ratner.
ICLR 2022.
- Machine-Learning Non-Conservative Dynamics for New-Physics Detection
Ziming Liu, Bohan Wang, Qi Meng, Wei Chen, Max Tegmark, Tie-Yan Liu.
Physics Review E.
- Optimizing Information-theoretical Generalization Bound via Anisotropic Noise in SGLD.
Bohan Wang, Huishuai Zhang, Jieyu Zhang, Qi Meng, Wei Chen, Tie-Yan Liu.
NeurIPS 2021.
- The Implicit Bias for Adaptive Optimization Algorithms on Homogeneous Neural Networks
Bohan Wang, Qi Meng, Wei Chen, Tie-Yan Liu.
ICML 2021 (Long Presentation).
- Tighter generalization bounds for iterative differentially private learning algorithms
*Bohan Wang ,*Fengxiang He, Dacheng Tao.
UAI 2021.
- Piecewise linear activations substantially shape the loss surfaces of neural networks
*Bohan Wang, *Fengxiang He, Dacheng Tao.
ICLR 2020.
Education
- University of Science and Technology of China - Joint Ph.D. Program of USTC & MSR (Asia) (2021 - Present).
Supervised by Prof. Wei Chen and Prof. Zhi-Ming Ma.
- University of Science and Technology of China - Sc.B in Computational Mathematics.
Supervised by Prof. Jie Wang.
Internship
- Research Assistant - University of Sydney (2019.06-2019.09).
Supervised by Prof. Dacheng Tao
- Star Bridge Research Assistant - Microsoft Research (Asia) (2020.09-2021.08)
Supervised by Prof. Wei Chen.
Awards
- Travel Award, Neurips 2021.
Professional Service
Miscellaneous
The photo is taken by my girl friend Xianyi Tao. We have met since we were high school classmates.
Email: bhwangfy@gmail.com