About Myself

Hi, I am a Ph.D. student of the joint Ph.D. Program of USTC and Microsoft Research (Asia). I am very fortunate to be advised by Professor Wei Chen and Professor Zhi-Ming Ma. I also work closely with Dr. Qi Meng, Dr. Huishuai Zhang, and Prof. Ruoyu Sun.

Research Interests

I am broadly interested in the linear span of optimization, generalization and representation in deep learning.

Prepints

• Provable Adaptivity in Adam
  Bohan Wang, Yushun Zhang, Huishuai Zhang, Qi Meng, Zhi-Ming Ma, Tie-Yan Liu, Wei Chen
  Remark: This is a very exciting paper on why Adam outperforms SGD from the perspective of global convergence analysis. A brief introduction (in Chinese) can be found here.

Publication (* denotes equal contribution)

• $\mathcal{O}$-GNN: incorporating ring priors into molecular modeling
  Jinhua Zhu, Kehan Wu, Bohan Wang, Yingce Xia, Shufang Xie, Qi Meng, Lijun Wu, Tao Qin, Wengang Zhou, Houqiang Li, Tie-Yan Liu
  ICLR 2023.
• Does Momentum Change the Implicit Regularization on Separable Data?
  Bohan Wang, Qi Meng, Huishuai Zhang, Ruoyu Sun, Wei Chen, Zhi-Ming Ma, Tie-Yan Liu
  Neurips 2022 (Spotlight).
• Creating Training Sets via Weak Indirect Supervision
  Jieyu Zhang, Bohan Wang, Xiangchen Song, Yujing Wang, Yaming Yang, Jing Bai, Alexander Ratner.
  ICLR 2022.
• Machine-Learning Non-Conservative Dynamics for New-Physics Detection
  Ziming Liu, Bohan Wang, Qi Meng, Wei Chen, Max Tegmark, Tie-Yan Liu.
  Physics Review E.
• Optimizing Information-theoretical Generalization Bound via Anisotropic Noise in SGLD.
  Bohan Wang, Huishuai Zhang, Jieyu Zhang, Qi Meng, Wei Chen, Tie-Yan Liu.
  NeurIPS 2021.
• The Implicit Bias for Adaptive Optimization Algorithms on Homogeneous Neural Networks
  Bohan Wang, Qi Meng, Wei Chen, Tie-Yan Liu.
  ICML 2021 (Long Presentation).
• Tighter generalization bounds for iterative differentially private learning algorithms
  *Bohan Wang ,*Fengxiang He, Dacheng Tao.
  UAI 2021.
• Piecewise linear activations substantially shape the loss surfaces of neural networks
  *Bohan Wang, *Fengxiang He, Dacheng Tao.
  ICLR 2020.

Education

• University of Science and Technology of China - Joint Ph.D. Program of USTC & MSR (Asia) (2021 - Present).
  Supervised by Prof. Wei Chen and Prof. Zhi-Ming Ma.
• University of Science and Technology of China - Sc.B in Computational Mathematics.
  Supervised by Prof. Jie Wang.

Internship

• Research Assistant - University of Sydney (2019.06-2019.09).
  Supervised by Prof. Dacheng Tao
• Star Bridge Research Assistant - Microsoft Research (Asia) (2020.09-2021.08)
  Supervised by Prof. Wei Chen.

Awards

• Travel Award, Neurips 2021.

Professional Service

• Reviewer for AISTATS 2022, ICML 2022, Neurips 2022, ACML 2022.
• I cofound the Theory Lecture Series of Microsoft Research Asia Theory Center, featuring the latest theoretical advances in big data, artificial intelligence, and related areas.

Miscellaneous

The photo is taken by my girl friend Xianyi Tao. We have met since we were high school classmates.

Contact

Email: bhwangfy@gmail.com