Yilun Xu

Yilun Xu

Superintelligence@Meta

I'm a Research Scientist at Meta (TBD Lab). Previously I was a Research Scientist on the Google DeepMind Gemini team, building some awesome generative models (Gemini Omni and Nano Banana Pro). Before that, I co-led the diffusion-distillation efforts at NVIDIA.

I received my PhD @ MIT EECS, advised by Tommi Jaakkola, and my BS from the Turing Class in EECS @ Peking University, working with Yizhou Wang (PKU) and Stefano Ermon (Stanford). During my time at GDM I worked with Tim Brooks; at NVIDIA I worked with Arash Vahdat and Ming-Yu Liu.

Email: aaronyilun.xu@gmail.com

Models

Research (≤ PhD)

My research centers on deep generative modeling — designing new model families, improving training, accelerating sampling, and pushing discrete diffusion and distillation.

New models PFGMPFGM++Hamiltonian Score Matchingt-EDM
Training Stable Target FieldDisCo-DiffStyle Control
Sampling Restart SamplingParticle GuidanceAnytime AR
Discrete diffusion DDPDEDLM
Distillation Truncated Consistency Modelsf-distillCOSMOS-DistilledFastGen
ML & information theory V-informationMax-MIGL_DMI

Publications (≤ PhD)

(*) denotes equal contribution.

2025

FastGen

An open, plug-and-play offering for accelerating diffusion models — NVIDIA.

2025

COSMOS-Distilled

Distilled version of the COSMOS video foundation models. Featured in Jensen Huang's CES / GTC 2025 keynote — NVIDIA.

2025

One-step Diffusion Models with f-Divergence Distribution Matching

Yilun Xu, Weili Nie, Arash Vahdat

Preprint, 2025 · code released as part of FastGen

2025

Truncated Consistency Models

Sangyun Lee, Yilun Xu, Tomas Geffner, Giulia Fanti, Karsten Kreis, Arash Vahdat, Weili Nie

International Conference on Learning Representations (ICLR), 2025

2025

Heavy-Tailed Diffusion Models

Kushagra Pandey, Jaideep Pathak, Yilun Xu, Stephan Mandt, Michael Pritchard, Arash Vahdat, Morteza Mardani

International Conference on Learning Representations (ICLR), 2025

2025

Energy-Based Diffusion Language Models for Text Generation

Minkai Xu, Tomas Geffner, Karsten Kreis, Weili Nie, Yilun Xu, Jure Leskovec, Stefano Ermon, Arash Vahdat

International Conference on Learning Representations (ICLR), 2025

2025

Think While You Generate: Discrete Diffusion with Planned Denoising

Sulin Liu, Juno Nam, Andrew Campbell, Hannes Stärk, Yilun Xu, Tommi Jaakkola, Rafael Gómez-Bombarelli

International Conference on Learning Representations (ICLR), 2025

2024

Hamiltonian Score Matching and Generative Flows

Peter Holderrieth, Yilun Xu, Tommi Jaakkola

Neural Information Processing Systems (NeurIPS), 2024

2024

On Physics-Inspired Generative Models

Yilun Xu

PhD Thesis 🎓, Massachusetts Institute of Technology

2024

DisCo-Diff: Enhancing Continuous Diffusion Models with Discrete Latents

Yilun Xu, Gabriele Corso, Tommi Jaakkola, Arash Vahdat, Karsten Kreis

International Conference on Machine Learning (ICML), 2024

2024

Particle Guidance: non-I.I.D. Diverse Sampling with Diffusion Models

Gabriele Corso, Yilun Xu, Valentin De Bortoli, Regina Barzilay, Tommi Jaakkola

International Conference on Learning Representations (ICLR), 2024; Deep Inverse & Diffusion Workshops, NeurIPS 2023 (Oral)

2023

Restart Sampling for Improving Generative Processes

Yilun Xu*, Mingyang Deng*, Xiang Cheng*, Yonglong Tian, Ziming Liu, Tommi Jaakkola

Neural Information Processing Systems (NeurIPS), 2023

2023

PFGM++: Unlocking the Potential of Physics-Inspired Generative Models

Yilun Xu, Ziming Liu, Yonglong Tian, Shangyuan Tong, Max Tegmark, Tommi Jaakkola

International Conference on Machine Learning (ICML), 2023

2023

GenPhys: From Physical Processes to Generative Models

Ziming Liu, Di Luo, Yilun Xu, Tommi Jaakkola, Max Tegmark

Preprint, 2023

2023

Stable Target Field for Reduced Variance Score Estimation in Diffusion Models

Yilun Xu*, Shangyuan Tong*, Tommi Jaakkola

International Conference on Learning Representations (ICLR), 2023

2022

Poisson Flow Generative Models

Yilun Xu*, Ziming Liu*, Max Tegmark, Tommi Jaakkola

Neural Information Processing Systems (NeurIPS), 2022 (Spotlight)

2022

Controlling Directions Orthogonal to a Classifier

Yilun Xu, Hao He, Tianxiao Shen, Tommi Jaakkola

International Conference on Learning Representations (ICLR), 2022 (Spotlight)

2023

A Survey on Generative Diffusion Models

Hanqun Cao, Cheng Tan, Zhangyang Gao, Yilun Xu, Guangyong Chen, Pheng-Ann Heng, Stan Z. Li

IEEE Transactions on Knowledge and Data Engineering (TKDE), 2023

2022

Learning Representations that Support Robust Transfer of Predictors

Yilun Xu, Tommi Jaakkola

Preprint, 2022

2021

Can Subnetwork Structure Be the Key to Out-of-Distribution Generalization?

Dinghuai Zhang, Kartik Ahuja, Yilun Xu, Yisen Wang, Aaron Courville

International Conference on Machine Learning (ICML), 2021 (Long Talk)

2021

Anytime Sampling for Autoregressive Models via Ordered Autoencoding

Yilun Xu, Yang Song, Sahaj Garg, Linyuan Gong, Rui Shu, Aditya Grover, Stefano Ermon

International Conference on Learning Representations (ICLR), 2021

2020

A Theory of Usable Information under Computational Constraints

Yilun Xu, Shengjia Zhao, Jiaming Song, Russell Stewart, Stefano Ermon

International Conference on Learning Representations (ICLR), 2020 (Oral)

2020

TCGM: An Information-Theoretic Framework for Semi-Supervised Multi-Modality Learning

Xinwei Sun*, Yilun Xu*, Peng Cao, Yuqing Kong, Lingjing Hu, Shanghang Zhang, Yizhou Wang

European Conference on Computer Vision (ECCV), 2020 (Oral)

2019

LDMI: A Novel Information-theoretic Loss Function for Training Deep Nets Robust to Label Noise

Yilun Xu*, Peng Cao*, Yuqing Kong, Yizhou Wang

Neural Information Processing Systems (NeurIPS), 2019

2019

Max-MIG: An Information-Theoretic Approach for Joint Learning from Crowds

Peng Cao*, Yilun Xu*, Yuqing Kong, Yizhou Wang

International Conference on Learning Representations (ICLR), 2019

Education

MIT

Massachusetts Institute of Technology

Sep 2020 – May 2024

Ph.D. in Computer Science · Advisor: Tommi Jaakkola

Peking University

Peking University

Sep 2016 – Jul 2020

B.S. in Turing Class, Computer Science (summa cum laude) · Advisor: Yizhou Wang

Stanford University

Stanford University

Jun 2019 – Sep 2019

Visiting Researcher · Advisor: Stefano Ermon

Miscellaneous

I'm a national second-class table tennis player in China and the men's singles champion of the PKU Freshman's Cup (2016). I also played for the MIT table tennis team, taking 3rd place (group) at the 2022 NCTTA Upper New England Championship. 🏓