Arnaud Doucet
@arnauddoucet.bsky.social
Senior Staff Research Scientist @Google DeepMind
https://arnauddoucet.github.io/
https://arnauddoucet.github.io/
Reposted by Arnaud Doucet
DiffusionGemma Team, Adrien Ali Ta\"iga, James Assiene, Daniele Calandriello, Rahma Chaabouni, Jo\~ao Gante, Tamara von Glehn, Nate Keating, Chris Knutsen, Martin Kukla, Tianlin Liu, Ivan Lobov, Ofir Nabati, ...
DiffusionGemma Technical Report
https://arxiv.org/abs/2608.00146
DiffusionGemma Technical Report
https://arxiv.org/abs/2608.00146
August 4, 2026 at 10:31 PM
DiffusionGemma Team, Adrien Ali Ta\"iga, James Assiene, Daniele Calandriello, Rahma Chaabouni, Jo\~ao Gante, Tamara von Glehn, Nate Keating, Chris Knutsen, Martin Kukla, Tianlin Liu, Ivan Lobov, Ofir Nabati, ...
DiffusionGemma Technical Report
https://arxiv.org/abs/2608.00146
DiffusionGemma Technical Report
https://arxiv.org/abs/2608.00146
Reposted by Arnaud Doucet
Google DeepMind's DiffusionGemma Technical Report
They feel text diffusion models open up a radically different part of the latency–quality Pareto frontier and hope the report makes it easier for researchers and engineers to understand the model, build on it, and create things we haven’t thought of
They feel text diffusion models open up a radically different part of the latency–quality Pareto frontier and hope the report makes it easier for researchers and engineers to understand the model, build on it, and create things we haven’t thought of
August 4, 2026 at 2:39 PM
Google DeepMind's DiffusionGemma Technical Report
They feel text diffusion models open up a radically different part of the latency–quality Pareto frontier and hope the report makes it easier for researchers and engineers to understand the model, build on it, and create things we haven’t thought of
They feel text diffusion models open up a radically different part of the latency–quality Pareto frontier and hope the report makes it easier for researchers and engineers to understand the model, build on it, and create things we haven’t thought of
Reposted by Arnaud Doucet
Co-organising a workshop:
Non-Equilibrium Sampling: Diffusions · Flows · Particles
September, Newcastle
Come join the fun!
Non-Equilibrium Sampling: Diffusions · Flows · Particles
September, Newcastle
Come join the fun!
Newcastle Non-Equilibrium Sampling Workshop
Group photo from last year's Newcastle Sampling workshop.
sites.google.com
May 28, 2026 at 5:12 PM
Co-organising a workshop:
Non-Equilibrium Sampling: Diffusions · Flows · Particles
September, Newcastle
Come join the fun!
Non-Equilibrium Sampling: Diffusions · Flows · Particles
September, Newcastle
Come join the fun!
Reposted by Arnaud Doucet
May 28, 2026 at 3:29 PM
Reposted by Arnaud Doucet
🚨🧪 Announcing our #ICLR2026 Workshop, Generative AI in Genomics (Gen2): Barriers and Frontiers! @iclr-conf.bsky.social
📣Call for: Full workshop papers (5-8 pages) and Tiny papers (2-4 pages)
📅Submission deadline: 7 February 2026 AoE
🌐Learn more: genai-in-genomics.github.io
(1/7)
📣Call for: Full workshop papers (5-8 pages) and Tiny papers (2-4 pages)
📅Submission deadline: 7 February 2026 AoE
🌐Learn more: genai-in-genomics.github.io
(1/7)
January 12, 2026 at 3:15 AM
🚨🧪 Announcing our #ICLR2026 Workshop, Generative AI in Genomics (Gen2): Barriers and Frontiers! @iclr-conf.bsky.social
📣Call for: Full workshop papers (5-8 pages) and Tiny papers (2-4 pages)
📅Submission deadline: 7 February 2026 AoE
🌐Learn more: genai-in-genomics.github.io
(1/7)
📣Call for: Full workshop papers (5-8 pages) and Tiny papers (2-4 pages)
📅Submission deadline: 7 February 2026 AoE
🌐Learn more: genai-in-genomics.github.io
(1/7)
Really interesting paper indeed.
great stuff, right up my alley:
arxiv.org/abs/2511.11497
'A Recursive Theory of Variational State Estimation: The Dynamic Programming Approach'
- Filip Tronarp
arxiv.org/abs/2511.11497
'A Recursive Theory of Variational State Estimation: The Dynamic Programming Approach'
- Filip Tronarp
November 20, 2025 at 10:15 AM
Really interesting paper indeed.
🔥 WANTED: Student Researcher to join me, @vdebortoli.bsky.social, Jiaxin Shi, Kevin Li and @arthurgretton.bsky.social in DeepMind London.
You'll be working on Multimodal Diffusions for science. Apply here google.com/about/career...
You'll be working on Multimodal Diffusions for science. Apply here google.com/about/career...
Student Researcher, 2026 — Google Careers
google.com
November 15, 2025 at 5:23 PM
🔥 WANTED: Student Researcher to join me, @vdebortoli.bsky.social, Jiaxin Shi, Kevin Li and @arthurgretton.bsky.social in DeepMind London.
You'll be working on Multimodal Diffusions for science. Apply here google.com/about/career...
You'll be working on Multimodal Diffusions for science. Apply here google.com/about/career...
Reposted by Arnaud Doucet
We figured out flow matching over states that change dimension. With "Branching Flows", the model decides how big things must be! This works wherever flow matching works, with discrete, continuous, and manifold states. We think this will unlock some genuinely new capabilities.
November 10, 2025 at 9:10 AM
We figured out flow matching over states that change dimension. With "Branching Flows", the model decides how big things must be! This works wherever flow matching works, with discrete, continuous, and manifold states. We think this will unlock some genuinely new capabilities.
Really nice.
A little self promotion: Hai-Dang Dau (NUS) and I recently released this pre-print, which I'm not half proud of.
arxiv.org/abs/2510.07559
The main problem we solve in it is to construct importance weights for Markov chain Monte Carlo. We achieve it via a method we call harmonization by coupling.
arxiv.org/abs/2510.07559
The main problem we solve in it is to construct importance weights for Markov chain Monte Carlo. We achieve it via a method we call harmonization by coupling.
November 5, 2025 at 9:44 AM
Really nice.
Reposted by Arnaud Doucet
Very excited to share our preprint: Self-Speculative Masked Diffusions
We speed up sampling of masked diffusion models by ~2x by using speculative sampling and a hybrid non-causal / causal transformer
arxiv.org/abs/2510.03929
w/ @vdebortoli.bsky.social, Jiaxin Shi, @arnauddoucet.bsky.social
We speed up sampling of masked diffusion models by ~2x by using speculative sampling and a hybrid non-causal / causal transformer
arxiv.org/abs/2510.03929
w/ @vdebortoli.bsky.social, Jiaxin Shi, @arnauddoucet.bsky.social
October 7, 2025 at 10:09 PM
Very excited to share our preprint: Self-Speculative Masked Diffusions
We speed up sampling of masked diffusion models by ~2x by using speculative sampling and a hybrid non-causal / causal transformer
arxiv.org/abs/2510.03929
w/ @vdebortoli.bsky.social, Jiaxin Shi, @arnauddoucet.bsky.social
We speed up sampling of masked diffusion models by ~2x by using speculative sampling and a hybrid non-causal / causal transformer
arxiv.org/abs/2510.03929
w/ @vdebortoli.bsky.social, Jiaxin Shi, @arnauddoucet.bsky.social
Reposted by Arnaud Doucet
(1/n)🚨Train a model solving DFT for any geometry with almost no training data
Introducing Self-Refining Training for Amortized DFT: a variational method that predicts ground-state solutions across geometries and generates its own training data!
📜 arxiv.org/abs/2506.01225
💻 github.com/majhas/self-...
Introducing Self-Refining Training for Amortized DFT: a variational method that predicts ground-state solutions across geometries and generates its own training data!
📜 arxiv.org/abs/2506.01225
💻 github.com/majhas/self-...
June 10, 2025 at 7:49 PM
(1/n)🚨Train a model solving DFT for any geometry with almost no training data
Introducing Self-Refining Training for Amortized DFT: a variational method that predicts ground-state solutions across geometries and generates its own training data!
📜 arxiv.org/abs/2506.01225
💻 github.com/majhas/self-...
Introducing Self-Refining Training for Amortized DFT: a variational method that predicts ground-state solutions across geometries and generates its own training data!
📜 arxiv.org/abs/2506.01225
💻 github.com/majhas/self-...
Reposted by Arnaud Doucet
Shunichi Amari has been awarded the 40th (2025) Kyoto Prize in recognition of his pioneering research in the fields of artificial neural networks, machine learning, and information geometry
www.riken.jp/pr/news/2025...
www.riken.jp/pr/news/2025...
甘利 俊一 栄誉研究員が「京都賞」を受賞
甘利 俊一栄誉研究員（本務：帝京大学 先端総合研究機構 特任教授）は、人工ニューラルネットワーク、機械学習、情報幾何学分野での先駆的な研究が評価され、第40回（2025）京都賞（先端技術部門 受賞対象分野：情報科学）を受賞しました。
www.riken.jp
June 20, 2025 at 1:26 PM
Shunichi Amari has been awarded the 40th (2025) Kyoto Prize in recognition of his pioneering research in the fields of artificial neural networks, machine learning, and information geometry
www.riken.jp/pr/news/2025...
www.riken.jp/pr/news/2025...
Reposted by Arnaud Doucet
🌟Applications open- LOGML 2025🌟
👥Mentor-led projects, expert talks, tutorials, socials, and a networking night
✍️Application form: logml.ai
🔬Projects: www.logml.ai/projects.html
📅Apply by 6th April 2025
✉️Questions? [email protected]
#MachineLearning #SummerSchool #LOGML #Geometry
👥Mentor-led projects, expert talks, tutorials, socials, and a networking night
✍️Application form: logml.ai
🔬Projects: www.logml.ai/projects.html
📅Apply by 6th April 2025
✉️Questions? [email protected]
#MachineLearning #SummerSchool #LOGML #Geometry
LOGML 2025
London Geometry and Machine Learning Summer School, July 7-11 2025
logml.ai
March 11, 2025 at 3:25 PM
🌟Applications open- LOGML 2025🌟
👥Mentor-led projects, expert talks, tutorials, socials, and a networking night
✍️Application form: logml.ai
🔬Projects: www.logml.ai/projects.html
📅Apply by 6th April 2025
✉️Questions? [email protected]
#MachineLearning #SummerSchool #LOGML #Geometry
👥Mentor-led projects, expert talks, tutorials, socials, and a networking night
✍️Application form: logml.ai
🔬Projects: www.logml.ai/projects.html
📅Apply by 6th April 2025
✉️Questions? [email protected]
#MachineLearning #SummerSchool #LOGML #Geometry
Reposted by Arnaud Doucet
SuperDiff goes super big!
- Spotlight at #ICLR2025!🥳
- Stable Diffusion XL pipeline on HuggingFace huggingface.co/superdiff/su... made by Viktor Ohanesian
- New results for molecules in the camera-ready arxiv.org/abs/2412.17762
Let's celebrate with a prompt guessing game in the thread👇
- Spotlight at #ICLR2025!🥳
- Stable Diffusion XL pipeline on HuggingFace huggingface.co/superdiff/su... made by Viktor Ohanesian
- New results for molecules in the camera-ready arxiv.org/abs/2412.17762
Let's celebrate with a prompt guessing game in the thread👇
March 6, 2025 at 9:06 PM
SuperDiff goes super big!
- Spotlight at #ICLR2025!🥳
- Stable Diffusion XL pipeline on HuggingFace huggingface.co/superdiff/su... made by Viktor Ohanesian
- New results for molecules in the camera-ready arxiv.org/abs/2412.17762
Let's celebrate with a prompt guessing game in the thread👇
- Spotlight at #ICLR2025!🥳
- Stable Diffusion XL pipeline on HuggingFace huggingface.co/superdiff/su... made by Viktor Ohanesian
- New results for molecules in the camera-ready arxiv.org/abs/2412.17762
Let's celebrate with a prompt guessing game in the thread👇
Reposted by Arnaud Doucet
Why academia is sleepwalking into self-destruction. My editorial @brain1878.bsky.social If you agree with the sentiments please repost. It's important for all our sakes to stop the madness
academic.oup.com/brain/articl...
academic.oup.com/brain/articl...
March 6, 2025 at 7:16 PM
Why academia is sleepwalking into self-destruction. My editorial @brain1878.bsky.social If you agree with the sentiments please repost. It's important for all our sakes to stop the madness
academic.oup.com/brain/articl...
academic.oup.com/brain/articl...
Reposted by Arnaud Doucet
Excited to see our paper “Computing Nonequilibrium Responses with Score-Shifted Stochastic Differential Equations” in Physical Review Letters this morning as an Editor’s Suggestion! We uses ideas from generative modeling to unravel a rather technical problem. 🧵 journals.aps.org/prl/abstract...
March 4, 2025 at 6:45 PM
Excited to see our paper “Computing Nonequilibrium Responses with Score-Shifted Stochastic Differential Equations” in Physical Review Letters this morning as an Editor’s Suggestion! We uses ideas from generative modeling to unravel a rather technical problem. 🧵 journals.aps.org/prl/abstract...
Great intro to PAC-Bayes bounds. Highly recommended!
I already advertised for this document when I posted it on arXiv, and later when it was published.
This week, with the agreement of the publisher, I uploaded the published version on arXiv.
Less typos, more references and additional sections including PAC-Bayes Bernstein.
arxiv.org/abs/2110.11216
This week, with the agreement of the publisher, I uploaded the published version on arXiv.
Less typos, more references and additional sections including PAC-Bayes Bernstein.
arxiv.org/abs/2110.11216
March 5, 2025 at 9:55 AM
Great intro to PAC-Bayes bounds. Highly recommended!
Reposted by Arnaud Doucet
Better diffusions with scoring rules!
Fewer, larger denoising steps using distributional losses; learn the posterior distribution of clean samples given the noisy versions.
arxiv.org/pdf/2502.02483
@vdebortoli.bsky.social Galashov Guntupalli Zhou @sirbayes.bsky.social @arnauddoucet.bsky.social
Fewer, larger denoising steps using distributional losses; learn the posterior distribution of clean samples given the noisy versions.
arxiv.org/pdf/2502.02483
@vdebortoli.bsky.social Galashov Guntupalli Zhou @sirbayes.bsky.social @arnauddoucet.bsky.social
arxiv.org
February 5, 2025 at 2:23 PM
Better diffusions with scoring rules!
Fewer, larger denoising steps using distributional losses; learn the posterior distribution of clean samples given the noisy versions.
arxiv.org/pdf/2502.02483
@vdebortoli.bsky.social Galashov Guntupalli Zhou @sirbayes.bsky.social @arnauddoucet.bsky.social
Fewer, larger denoising steps using distributional losses; learn the posterior distribution of clean samples given the noisy versions.
arxiv.org/pdf/2502.02483
@vdebortoli.bsky.social Galashov Guntupalli Zhou @sirbayes.bsky.social @arnauddoucet.bsky.social
A standard ML approach for parameter estimation in latent variable models is to maximize the expectation of the logarithm of an importance sampling estimate of the intractable likelihood. We provide consistency/efficiency results for the resulting estimate: arxiv.org/abs/2501.08477
On the Asymptotics of Importance Weighted Variational Inference
For complex latent variable models, the likelihood function is not available in closed form. In this context, a popular method to perform parameter estimation is Importance Weighted Variational Infere...
arxiv.org
January 16, 2025 at 5:43 PM
A standard ML approach for parameter estimation in latent variable models is to maximize the expectation of the logarithm of an importance sampling estimate of the intractable likelihood. We provide consistency/efficiency results for the resulting estimate: arxiv.org/abs/2501.08477
Speculative sampling accelerates inference in LLMs by drafting future tokens which are verified in parallel. With @vdebortoli.bsky.social , A. Galashov & @arthurgretton.bsky.social , we extend this approach to (continuous-space) diffusion models: arxiv.org/abs/2501.05370
January 10, 2025 at 4:30 PM
Speculative sampling accelerates inference in LLMs by drafting future tokens which are verified in parallel. With @vdebortoli.bsky.social , A. Galashov & @arthurgretton.bsky.social , we extend this approach to (continuous-space) diffusion models: arxiv.org/abs/2501.05370
Reposted by Arnaud Doucet
🔊 Super excited to announce the first ever Frontiers of Probabilistic Inference: Learning meets Sampling workshop at #ICLR2025 @iclr-conf.bsky.social!
🔗 website: sites.google.com/view/fpiwork...
🔥 Call for papers: sites.google.com/view/fpiwork...
more details in thread below👇 🧵
🔗 website: sites.google.com/view/fpiwork...
🔥 Call for papers: sites.google.com/view/fpiwork...
more details in thread below👇 🧵
December 18, 2024 at 7:09 PM
🔊 Super excited to announce the first ever Frontiers of Probabilistic Inference: Learning meets Sampling workshop at #ICLR2025 @iclr-conf.bsky.social!
🔗 website: sites.google.com/view/fpiwork...
🔥 Call for papers: sites.google.com/view/fpiwork...
more details in thread below👇 🧵
🔗 website: sites.google.com/view/fpiwork...
🔥 Call for papers: sites.google.com/view/fpiwork...
more details in thread below👇 🧵
Reposted by Arnaud Doucet
Schrödinger Bridge Flow for Unpaired Data Translation (by @vdebortoli.bsky.social et al.)
It will take me some time to digest this article fully, but it's important to follow the authors' advice and read the appendices, as the examples are helpful and well-illustrated.
📄 arxiv.org/abs/2409.09347
It will take me some time to digest this article fully, but it's important to follow the authors' advice and read the appendices, as the examples are helpful and well-illustrated.
📄 arxiv.org/abs/2409.09347
December 17, 2024 at 4:53 PM
Schrödinger Bridge Flow for Unpaired Data Translation (by @vdebortoli.bsky.social et al.)
It will take me some time to digest this article fully, but it's important to follow the authors' advice and read the appendices, as the examples are helpful and well-illustrated.
📄 arxiv.org/abs/2409.09347
It will take me some time to digest this article fully, but it's important to follow the authors' advice and read the appendices, as the examples are helpful and well-illustrated.
📄 arxiv.org/abs/2409.09347
The slides of my NeurIPS lecture "From Diffusion Models to Schrödinger Bridges - Generative Modeling meets Optimal Transport" can be found here
drive.google.com/file/d/1eLa3...
drive.google.com/file/d/1eLa3...
BreimanLectureNeurIPS2024_Doucet.pdf
drive.google.com
December 15, 2024 at 6:40 PM
The slides of my NeurIPS lecture "From Diffusion Models to Schrödinger Bridges - Generative Modeling meets Optimal Transport" can be found here
drive.google.com/file/d/1eLa3...
drive.google.com/file/d/1eLa3...
Reposted by Arnaud Doucet
One #postdoc position is still available at the National University of Singapore (NUS) to work on sampling, high-dimensional data-assimilation, and diffusion/flow models. Applications are open until the end of January. Details:
alexxthiery.github.io/jobs/2024_di...
alexxthiery.github.io/jobs/2024_di...
December 15, 2024 at 2:46 PM
One #postdoc position is still available at the National University of Singapore (NUS) to work on sampling, high-dimensional data-assimilation, and diffusion/flow models. Applications are open until the end of January. Details:
alexxthiery.github.io/jobs/2024_di...
alexxthiery.github.io/jobs/2024_di...
Reposted by Arnaud Doucet
I have updated my course notes on Optimal Transport with a new Chapter 9 on Wasserstein flows. It includes 3 illustrative applications: training a 2-layer MLP, deep transformers, and flow-matching generative models. You can access it here: mathematical-tours.github.io/book-sources...
December 4, 2024 at 8:11 AM
I have updated my course notes on Optimal Transport with a new Chapter 9 on Wasserstein flows. It includes 3 illustrative applications: training a 2-layer MLP, deep transformers, and flow-matching generative models. You can access it here: mathematical-tours.github.io/book-sources...