Implicit Diffusion: Efficient Optimization through Stochastic Sampling
We present a new algorithm to optimize distributions defined implicitly by
parameterized stochastic diffusions. Doing so allows us to modify the outcome
distribution of sampling processes by optimizing over their parameters. We
introduce a general framework for first-order optimization of these processes,
that performs jointly, in a single loop, optimization and sampling steps. This
approach is inspired by recent advances in bilevel optimization and automatic
implicit differentiation, leveraging the point of view of sampling as
optimization over the space of probability distributions. We provide
theoretical guarantees on the performance of our method, as well as
experimental results demonstrating its effectiveness in real-world settings.
65c5a299b4fa1caf9655e53d
Pierre Marion
extracted_confirmed
2024-04-08T18:35:32.365Z
661430e59959fcaf7f2bb8a3
/avatars/e9698cbb54c8ee04e7b604e461cdb3ad.svg
Pierre Marion
user
PierreMarion
65c5a299b4fa1caf9655e53e
Anna Korba
65c5a299b4fa1caf9655e53f
Peter Bartlett
65c5a299b4fa1caf9655e540
Mathieu Blondel
claimed_verified
2025-02-10T13:13:32.547Z
66d093b681e0683bca48bed6
/avatars/cc1fbccb0b6aa93d648bcbdf9c3a35e1.svg
Mathieu Blondel
user
mblondel
65c5a299b4fa1caf9655e541
Valentin De Bortoli
admin_assigned
2024-02-09T10:09:12.135Z
658f2c0e16227c7a2dfc47ab
/avatars/65ab2562691a3f698363ebbd1a14a5de.svg
Valentin De Bortoli
user
vdeborto
65c5a299b4fa1caf9655e542
Arnaud Doucet
65c5a299b4fa1caf9655e543
Felipe Llinares-López
65c5a299b4fa1caf9655e544
Courtney Paquette
65c5a299b4fa1caf9655e545
Quentin Berthet
Implicit Diffusion: Efficient Optimization through Stochastic Sampling
We present a new algorithm to optimize distributions defined implicitly by
parameterized stochastic diffusions. Doing so allows us to modify the outcome
distribution of sampling processes by optimizing over their parameters. We
introduce a general framework for first-order optimization of these processes,
that performs jointly, in a single loop, optimization and sampling steps. This
approach is inspired by recent advances in bilevel optimization and automatic
implicit differentiation, leveraging the point of view of sampling as
optimization over the space of probability distributions. We provide
theoretical guarantees on the performance of our method, as well as
experimental results demonstrating its effectiveness in real-world settings.
A novel algorithm optimizes implicit distributions defined by parameterized stochastic diffusions, enabling joint optimization and sampling in a single loop.
parameterized stochastic diffusions first-order optimization bilevel optimization automatic implicit differentiation