News

Mar 2026 Publications

Seven works at ICLR 2026

We will be presenting the following work at ICLR 2026 in Brazil.

  • Yudong Wei, Liang Zhang, Bingcong Li, Niao He. On the Benefits of Weight Normalization for Overparameterized Matrix Sensing. ICLR 2026.
  • Andrey Kharitenko, Zebang Shen, Riccardo De Santi, Niao He, Florian Doerfler. Landing with the Score: Riemannian Optimization through Denoising. ICLR 2026.
  • Louis Claeys, Artur Goldman, Zebang Shen, Niao He. A Schrodinger Eigenfunction Method for Long-Horizon Stochastic Optimal Control. ICLR 2026.
  • Xiang Li, Zebang Shen, Ya-Ping Hsieh, Niao He. When Scores Learn Geometry: Rate Separations under the Manifold Hypothesis. ICLR 2026.
  • Zebang Shen, Ya-Ping Hsieh, Niao He. Manifold Generalization Provably Proceeds Memorization in Diffusion Models. ICLR Workshop on Deep Generative Model in Machine Learning: Theory, Principle and Efficacy, 2026. (Oral talk)
  • Minhak Song, Liang Zhang, Bingcong Li, Niao He, Michael Muehlebach, Sewoong Oh. Zeroth-Order Optimization at the Edge of Stability. ICLR Workshop on Scientific Methods for Understanding Deep Learning, 2026. (Contributed talk)
  • Yilang Zhang, Bingcong Li, Niao He, Georgios B. Giannakis. ANCRe: Adaptive Neural Connection Reassignment for Efficient Depth Scaling. ICLR Workshop on Deep Generative Model in Machine Learning: Theory, Principle and Efficacy, 2026.
Feb 2026 Publications

Hessian-aware SDE for SGD accepted to Mathematical Programming

Our paper on A Hessian-aware stochastic differential equation for modelling SGD is accepted to Mathematical Programming, 2026.

Feb 2026 Group

Batu Yardim and Jiawei Huang defend their PhDs

Congratulations to Batu Yardim and Jiawei Huang for successfully defending their PhD. Best wishes for your next journey in industry!

Dec 2025 Publications

Six papers presented at NeurIPS 2025

We present the following papers at NeurIPS 2025.

  • Kai Lion, Liang Zhang, Bingcong Li, Niao He. PoLAR: Polar-Decomposed Low-Rank Adapter Representation. NeurIPS 2025.
  • Liang Zhang, Bingcong Li, Kiran Thekumparampil, Sewoong Oh, Michael Muehlebach, Niao He. Zeroth-Order Optimization Finds Flat Minima. NeurIPS 2025.
  • Haotian Sun, Yitong Li, Yuchen Zhuang, Niao He, Hanjun Dai, Bo Dai. AmorLIP: Efficient Language-Image Pretraining via Amortization. NeurIPS 2025.
  • Riccardo De Santi, Marin Vlastelica, Ya-Ping Hsieh, Zebang Shen, Niao He, Andreas Krause. Flow Density Control: Generative Optimization Beyond Entropy-Regularized Fine-Tuning. NeurIPS 2025.
  • Nathan Corecco, Batuhan Yardim, Vinzenz Thoma, Zebang Shen, Niao He. Scalable Neural Incentive Design with Parameterized Mean-Field Approximation. NeurIPS 2025.
  • Fangyuan Sun, Ilyas Fatkhullin, Niao He. Natural Gradient VI in Non-Conjugate Models. NeurIPS 2025.
Nov 2025 Events

INI program on Bridging Stochastic Control and Reinforcement Learning

We co-organized the INI program on Bridging Stochastic Control and Reinforcement Learning at the Alan Turing Institute, London, UK.

Oct 2025 Events

Symposium on Mathematical Foundations of Trustworthy Learning

We co-organized the Symposium on Mathematical Foundations of Trustworthy Learning in Ascona, Switzerland.

Jun 2025 Award

Best Paper Finalist at L4DC 2025

Our paper on Exploiting Approximate Symmetry for Efficient Multi-Agent Reinforcement Learning made it to the Best Paper Finalists at the 7th Annual Learning for Dynamics & Control Conference (L4DC), 2025. Congratulations to Batu!

May 2024 Publications

Three papers accepted at ICML 2024

Several papers accepted to ICML 2024. Congrats to all!

  • Private Fine-Tuning of Language Models without Backpropagation. L. Zhang, B. Li, K. Thekumparampil, S. Oh, N. He. ICML 2024.
  • Truly No-Regret Learning in Constrained MDPs. A. Muller, P. Alatur, V. Cevher, G. Ramponi, N. He. ICML 2024.
  • Model-Based RL for Mean-Field Games is not Statistically Harder than Single-agent RL. J. Huang, N. He, A. Krause. ICML 2024.
Jan 2024 Publications

Five papers accepted at AISTATS 2024

Several papers accepted to AISTATS 2024. Congrats to all!

  • Parameter-Agnostic Optimization under Relaxed Smoothness. F. Hubler, J. Yang, X. Li, N. He. AISTATS 2024.
  • Generalization Bounds of Nonconvex-(Strongly)-Concave Stochastic Minimax Optimization. S. Zhang, Y. Hu, L. Zhang, N. He. AISTATS 2024.
  • On the Statistical Efficiency of Mean Field RL with General Function Approximation. J. Huang, B. Yardim, N. He. AISTATS 2024.
  • Taming Nonconvex Stochastic Mirror Descent with General Bregman Divergence. I. Fatkhullin, N. He. AISTATS 2024.
  • Independent Learning in Constrained Markov Potential Games. P. Jordan, A. Barakat, N. He. AISTATS 2024.
Dec 2023 Group

Junchi Yang and Giorgia Ramponi move on

Congrats to Dr. Junchi Yang for his next postdoc position at Argonne National Laboratory and Dr. Giorgia Ramponi for her next position as Assistant Professor at University of Zurich. Wish you great success in your new journey!

Dec 2023 Publications

Papers accepted at AAAI 2024 and AAMAS 2024

Our paper on Automated Design of Affine Maximizer Mechanisms in Dynamic Settings is accepted to AAAI 2024, and two papers are accepted to the 23rd International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2024. Congrats to Vinzenz, Pragnya, Giorgia, and Batu!

Nov 2023 Award

SNSF Starting Grant 2023

We have been awarded the SNSF Starting Grant 2023! Thanks SNSF for the unprecedented support of our research!

Oct 2023 Publications

Nine papers at NeurIPS 2023 and its workshops

Several papers are accepted to NeurIPS 2023 main conference and workshops. Stay tuned and see you at New Orleans in December!

  • Optimal Guarantees for Algorithmic Reproducibility and Gradient Complexity in Convex Optimization. L. Zhang, J. Yang, A. Karbasi, N. He. NeurIPS 2023. (Spotlight)
  • Two Sides of One Coin: the Limits of Untuned SGD and the Power of Adaptive Methods. J. Yang, X. Li, I. Fatkhullin, N. He. NeurIPS 2023.
  • Robust Knowledge Transfer in Tiered Reinforcement Learning. J. Huang, N. He. NeurIPS 2023.
  • On Imitation in Mean-field Games. G. Ramponi, P. Kolev, O. Pietquin, N. He, M. Lauriere, M. Geist. NeurIPS 2023.
  • Momentum Provably Improves Error Feedback! I. Fatkhullin, A. Tyurin, P. Richtarik. NeurIPS 2023.
  • Entropy-dissipation Informed Neural Network for McKean-Vlasov Type PDEs. Zebang Shen, Z. Wang. NeurIPS 2023.
  • Stochastic Optimization under Hidden Convexity. I. Fatkhullin, N. He, Y. Hu. NeurIPS Workshop OPT 2023.
  • Parameter-Agnostic Optimization under Relaxed Smoothness. F. Hubler, J. Yang, X. Li, N. He. NeurIPS Workshop OPT 2023.
  • DPZero: Dimension-Independent and Differentially Private Zeroth-Order Optimization. L. Zhang, K. Thekumparampil, S. Oh, N. He. NeurIPS Workshop on Federated Learning 2023.
Jul 2023 Award

ABB Research Prize for Tanmay Goyal

Congrats to Tanmay Goyal for receiving the ABB Research Prize for a top-class Master’s thesis from our group.

Apr 2023 Publications

Three papers accepted at ICML 2023

Three papers accepted to ICML 2023. Congrats to Batu, Anas, and Ilyas.

Feb 2023 Award

ETH medal for Xiang Li

Congratulations to Xiang Li for receiving the ETH medal for his outstanding Master’s thesis. See the news item.

Feb 2023 Publications

Papers accepted at AISTATS 2023 and ICLR 2023

Two papers accepted to AISTATS 2023. Our paper on TiAda: A Time-scale Adaptive Algorithm for Nonconvex Minimax Optimization is accepted to ICLR 2023.

Jan 2023 Publications

Two journal papers accepted

Two journal papers accepted: our paper on Sample Complexity and Overparameterization Bounds for Temporal Difference Learning with Neural Network Approximation is accepted to IEEE Transactions on Automatic Control; our paper on A discrete-time switching system analysis of Q-learning is accepted to SIAM Journal on Control and Optimization.

Oct 2022 Group

Four ODI members rated top reviewers at NeurIPS 2022

Congratulations to ODI members Junchi, Jiawei, Giorgia, and Siqi for being rated as top reviewers for NeurIPS 2022.

Oct 2022 Events

Talk at The Mathematics of Machine Learning Workshop

Niao gave a talk on Nonconvex min-max optimization: fundamental limits, acceleration, and adaptivity at The Mathematics of Machine Learning Workshop in Bilbao, Spain.

Sep 2022 Publications

Six papers accepted at NeurIPS 2022

Several papers from the group members are accepted for NeurIPS 2022.

  • Nest Your Adaptive Algorithm for Parameter-Agnostic Nonconvex Minimax Optimization. J. Yang, X. Li, N. He.
  • Sharp Analysis of Stochastic Optimization under Global Kurdyka-Lojasiewicz Inequality. I. Fatkhullin, J. Etesami, N. He, N. Kiyavash.
  • Bring Your Own Algorithm for Optimal Differentially Private Stochastic Minimax Optimization. L. Zhang, K. Thekumparampil, S. Oh, N. He.
  • Trust Region Policy Optimization with Optimal Transport Discrepancies: Duality and Algorithm for Continuous Actions. A. Terpin, N. Lanzetti, A. B. Yardim, G. Ramponi, F. Dorfler.
  • Tiered Reinforcement Learning: Pessimism in the Face of Uncertainty and Constant Regret. J. Huang et al.
  • Stochastic Second-Order Methods Provably Beat SGD For Gradient-Dominated Functions. M. Masiha, S. Salehkaleybar, N. He, N. Kiyavash, P. Thiran.
Aug 2022 Group

Yifan, Siqi and Semih start their next positions

Congratulations to Yifan, Siqi, and Semih for their new journeys. Yifan is starting a postdoc position at EPFL, Switzerland, Siqi will be a Rufus Isaacs Postdoctoral Fellow at Johns Hopkins University, USA, and Semih Cayci will start a faculty position in the Department of Mathematics at RWTH Aachen, Germany.

Jul 2022 Events

Talks and sessions at ICCOPT 2022

Several group members, Yifan, Anas, and Niao gave talks and organized sessions at the seventh International Conference on Continuous Optimization (ICCOPT) at Lehigh University, USA.

Jun 2022 Events

Talk and poster at the ELLIS Theory Workshop

Niao gave a talk on nonconvex minimax optimization and Junchi presented a poster at the ELLIS Theory Workshop in Arenzano, Italy.

May 2022 Events

NCCR symposium on Systems Theory of Algorithms

Together with Florian Dorfler, Niao co-organized the NCCR symposium on Systems Theory of Algorithms at ETH Zurich and also gave a talk on Q-learning through the Lens of Dynamical Systems: from asymptotics to non-asymptotics.

Feb 2022 Events

Six-week visit to the Simons Institute at UC Berkeley

Niao visited Simons Institute at UC Berkeley for six weeks and participated in the Learning and Games program. During the visit, Niao gave a talk on Universal Acceleration for Minimax Optimization at the visitor seminar series and another talk on single-loop algorithms for unbalanced minimax optimization at the workshop on Adversarial Approaches in Machine Learning.

Nov 2021 Events

Seminar talks at MaLGa Genoa and Oxford

Niao gave a seminar talk on Three common RL tricks: why and when do they work? at the Machine Learning Genoa Center (MaLGa) in Italy and a virtual talk at the Control Seminar series at University of Oxford, UK.

Jan 2021 Group

The group has moved to ETH Zurich

Our group has moved to ETH Zurich, Switzerland.

Dec 2020 Publications

Six papers accepted at NeurIPS 2020

Our group got six papers accepted to NeurIPS 2020. Check the papers here.

Aug 2020 Group

Part of the USDA-NIFA AI Institute on Next Generation Food Systems

We are excited to be a part of the USDA-NIFA AI Institute on Next Generation Food Systems (AIFS, a joint effort led by UC Davis, UC Berkeley, Cornell, and UIUC). Check the news here.

Jul 2020 Group

Yingxiang Yang graduates

Yingxiang graduated and started his next position as a research scientist at ByteDance in Seattle.

Jun 2020 Events

Talk at the Virtual Seminar on Theory of RL

Niao gave a talk at the Virtual Seminar on Theory of RL on Understanding the Convergence of Reinforcement Learning Algorithms from Dynamical Systems Perspectives. Check the slides and video.

Mar 2020 Group

Donghwan Lee starts a faculty position at KAIST

Donghwan Lee started a faculty position at KAIST.

Jan 2020 Award

Beckman CAS Fellow 2020-21

Niao is elected as the 2020-21 Beckman CAS Fellow by the Center for Advanced Studies at UIUC.