I am Ziheng Cheng, a senior-year undergraduate student in School of Mathematical Sciences, Peking University. My research interests span broadly in statistics, optimization and machine learning. If you are interested in my research, please feel free to contact me. Here is my CV.

News

• May, 2024 Glad to serve as a reviewer of NeurIPS 2024 for the first time!
• May, 2024 Our paper “The Limits and Potentials of Local SGD for Distributed Heterogeneous Learning with Intermittent Communication” accepted at COLT 2024!
• May, 2024 Our paper “Kernel Semi-Implicit Variational Inference”, “Reflected Flow Matching” accepted at ICML 2024!
• April, 2024 Glad to be an incoming PhD student at UC Berkely IEOR!
• Jan, 2024 Our paper “Momentum Benefits Non-IID Federated Learning Simply and Provably” accepted at ICLR 2024!
• Oct, 2023 Join Microsoft Research Asia as an intern!
• Sep, 2023 Our paper “Particle-based Variational Inference with Generalized Wasserstein Gradient Flow” accepted at NeurIPS 2023!
• June, 2023 Visit Tengyu Ma at Stanford!
• June, 2023 A new paper “Momentum Benefits Non-IID Federated Learning Simply and Provably” on Arxiv!
• May, 2023 A new paper “Joint Graph Learning and Model Fitting in Laplacian Regularized Stratified Models” on Arxiv!

Publications

• (COLT 2024) The Limits and Potentials of Local SGD for Distributed Heterogeneous Learning with Intermittent Communication
  Kumar Kshitij Patel, Margalit Glasgow, Ali Zindari, Lingxiao Wang, Sebastian U Stich, Ziheng Cheng, Nirmit Joshi, Nathan Srebro
  [Arxiv]

• (ICML 2024) Kernel Semi-Implicit Variational Inference
  Ziheng Cheng*, Longlin Yu*, Tianyu Xie, Shiyue Zhang, Cheng Zhang
  [Arxiv]

• (ICML 2024) Reflected Flow Matching
  Tianyu Xie*, Yu Zhu*, Longlin Yu*, Tong Yang, Ziheng Cheng, Shiyue Zhang, Xiangyu Zhang, Cheng Zhang
  [Arxiv]

• (ICLR 2024) Momentum Benefits Non-IID Federated Learning Simply and Provably
  Ziheng Cheng*, Xinmeng Huang*, Pengfei Wu, Kun Yuan
  [Arxiv]

• (NeurIPS 2023) Particle-based Variational Inference with Generalized Wasserstein Gradient Flow
  Ziheng Cheng*, Shiyue Zhang*, Longlin Yu, Cheng Zhang
  [Arxiv]

• (Under Review) Joint Graph Learning and Model Fitting in Laplacian Regularized Stratified Models
  Ziheng Cheng*, Junzi Zhang*, Akshay Agrawal, Stephen Boyd
  [Arxiv]

Experiences

• Peking University
  Undergrad Research (advisor: Prof. Cheng Zhang, School of Mathematical Sciences)
  May. 2022 – Present

• Stanford University
  Summer Research (advisor: Prof. Tengyu Ma, Department of Computer Science)
  Jun. 2023 – Oct. 2023

• Peking University
  Undergrad Research (advisor: Prof. Kun Yuan, Center for Machine Learning Research)
  Mar. 2023 – Sept. 2023

• Stanford University
  Remote Research (advisor: Prof. Stephen Boyd, Department of Electrical Engineering)
  Oct. 2022 – May. 2023