UNBALANCED OPTIMAL TRANSPORT L ena c Chizat joint work with F-X. - - PowerPoint PPT Presentation

unbalanced optimal transport
SMART_READER_LITE
LIVE PREVIEW

UNBALANCED OPTIMAL TRANSPORT L ena c Chizat joint work with F-X. - - PowerPoint PPT Presentation

UNBALANCED OPTIMAL TRANSPORT L ena c Chizat joint work with F-X. Vialard, G. Peyr e & B. Schmitzer CEREMADE Universit e Paris Dauphine Mokalien 2015 Introduction Static Dynamic Examples & Numerics Conclusion


slide-1
SLIDE 1

UNBALANCED OPTIMAL TRANSPORT

L´ ena¨ ıc Chizat joint work with F-X. Vialard, G. Peyr´ e & B. Schmitzer

CEREMADE Universit´ e Paris Dauphine

Mokalien 2015

slide-2
SLIDE 2

Introduction Static Dynamic Examples & Numerics Conclusion

Introduction

Motivations

Image matching, Machine learning, Economics, Gradient flows...

2 / 20

slide-3
SLIDE 3

Introduction Static Dynamic Examples & Numerics Conclusion

Introduction

Motivations

Image matching, Machine learning, Economics, Gradient flows...

Previous work

Static relaxed marginal constraints ([Hanin, 1992], [Benamou, 2003]) Dynamic source term ([Piccoli and Rossi, 2013], [Mass et al., 2015], [Lombardi and Maitre, 2013]);

2 / 20

slide-4
SLIDE 4

Introduction Static Dynamic Examples & Numerics Conclusion

Introduction

Motivations

Image matching, Machine learning, Economics, Gradient flows...

Previous work

Static relaxed marginal constraints ([Hanin, 1992], [Benamou, 2003]) Dynamic source term ([Piccoli and Rossi, 2013], [Mass et al., 2015], [Lombardi and Maitre, 2013]);

Two points of view:

  • Standard optimal transport & relaxed marginal constraints ;
  • Transport + variation of mass & exact marginal constraints .

2 / 20

slide-5
SLIDE 5

Introduction Static Dynamic Examples & Numerics Conclusion

Introduction

Motivations

Image matching, Machine learning, Economics, Gradient flows...

Previous work

Static relaxed marginal constraints ([Hanin, 1992], [Benamou, 2003]) Dynamic source term ([Piccoli and Rossi, 2013], [Mass et al., 2015], [Lombardi and Maitre, 2013]);

Two points of view:

  • Standard optimal transport & relaxed marginal constraints ;
  • Transport + variation of mass & exact marginal constraints .

Setting : Ω convex compact in Rn.

2 / 20

slide-6
SLIDE 6

Introduction Static Dynamic Examples & Numerics Conclusion

Outline

Static Formulation Dynamic Formulation Examples & Numerics

3 / 20

slide-7
SLIDE 7

Introduction Static Dynamic Examples & Numerics Conclusion

Outline

Static Formulation Dynamic Formulation Examples & Numerics

4 / 20

slide-8
SLIDE 8

Introduction Static Dynamic Examples & Numerics Conclusion

From standard OT...

  • ×

δx

c ( x , y )

  • ×δy

5 / 20

slide-9
SLIDE 9

Introduction Static Dynamic Examples & Numerics Conclusion

From standard OT...

  • ×

δx

c ( x , y )

  • ×δy

Assumptions on the cost:

  • lower bounded;
  • l.s.c.

5 / 20

slide-10
SLIDE 10

Introduction Static Dynamic Examples & Numerics Conclusion

From standard OT...

  • ×

δx

c ( x , y )

  • ×δy

Assumptions on the cost:

  • lower bounded;
  • l.s.c.

Static formulation of OT:

minimize

  • Ω2 c(x, y)dγ(x, y)

subject to (projx)#γ = ρ0 (projy)#γ = ρ1

5 / 20

slide-11
SLIDE 11

Introduction Static Dynamic Examples & Numerics Conclusion

From standard OT...

  • ×

mδx

m . c ( x , y )

  • ×mδy

Assumptions on the cost:

  • lower bounded;
  • l.s.c.

also linear in m.

Static formulation of OT:

minimize

  • Ω2 c(dγ

dλ, x, y)dλ(x, y) (γ ≪ λ) subject to (projx)#γ = ρ0 (projy)#γ = ρ1

5 / 20

slide-12
SLIDE 12

Introduction Static Dynamic Examples & Numerics Conclusion

...to Unbalanced OT

  • ×

mxδx

c ( ( x , m

x

) , ( y , m

y

) )

  • ×myδy

6 / 20

slide-13
SLIDE 13

Introduction Static Dynamic Examples & Numerics Conclusion

...to Unbalanced OT

  • ×

mxδx

c ( ( x , m

x

) , ( y , m

y

) )

  • ×myδy

The cost function is

  • pos. homogeneous in

(mx, my);

6 / 20

slide-14
SLIDE 14

Introduction Static Dynamic Examples & Numerics Conclusion

...to Unbalanced OT

  • ×

mxδx

c ( ( x , m

x

) , ( y , m

y

) )

  • ×myδy

The cost function is

  • pos. homogeneous in

(mx, my);

  • subadditive in (mx, my);

6 / 20

slide-15
SLIDE 15

Introduction Static Dynamic Examples & Numerics Conclusion

...to Unbalanced OT

  • ×

mxδx

c ( ( x , m

x

) , ( y , m

y

) )

  • ×myδy

The cost function is

  • pos. homogeneous in

(mx, my);

  • subadditive in (mx, my);
  • nonnegative;

6 / 20

slide-16
SLIDE 16

Introduction Static Dynamic Examples & Numerics Conclusion

...to Unbalanced OT

  • ×

mxδx

c ( ( x , m

x

) , ( y , m

y

) )

  • ×myδy

The cost function is

  • pos. homogeneous in

(mx, my);

  • subadditive in (mx, my);
  • nonnegative;
  • mx or my negative

⇒ c = +∞ ;

6 / 20

slide-17
SLIDE 17

Introduction Static Dynamic Examples & Numerics Conclusion

...to Unbalanced OT

  • ×

mxδx

c ( ( x , m

x

) , ( y , m

y

) )

  • ×myδy

The cost function is

  • pos. homogeneous in

(mx, my);

  • subadditive in (mx, my);
  • nonnegative;
  • mx or my negative

⇒ c = +∞ ;

  • lower semicontinuous

6 / 20

slide-18
SLIDE 18

Introduction Static Dynamic Examples & Numerics Conclusion

...to Unbalanced OT

  • ×

mxδx

c ( ( x , m

x

) , ( y , m

y

) )

  • ×myδy

The cost function is

  • pos. homogeneous in

(mx, my);

  • subadditive in (mx, my);
  • nonnegative;
  • mx or my negative

⇒ c = +∞ ;

  • lower semicontinuous

Static formulation of Unbalanced OT

C(ρ0, ρ1) := minimize

  • Ω2 c((x, dγ0

dγ ), (y, dγ1 dγ ))dγ(x, y) subject to (πx)#γ0 = ρ0 (πy)#γ1 = ρ1

6 / 20

slide-19
SLIDE 19

Introduction Static Dynamic Examples & Numerics Conclusion

Properties

Ω R+

  • ×

mxδx

c1/p

  • ×myδy

Cone(Ω) := (Ω × R+)/(Ω × {0})

7 / 20

slide-20
SLIDE 20

Introduction Static Dynamic Examples & Numerics Conclusion

Properties

Ω R+

  • ×

mxδx

c1/p

  • ×myδy

Cone(Ω) := (Ω × R+)/(Ω × {0})

Theorem (Metric property)

If c1/p is a metric on Cone(Ω) then C 1/p is a metric on M+(Ω).

7 / 20

slide-21
SLIDE 21

Introduction Static Dynamic Examples & Numerics Conclusion

Properties

Ω R+

  • ×

mxδx

c1/p

  • ×myδy

Cone(Ω) := (Ω × R+)/(Ω × {0})

Theorem (Metric property)

If c1/p is a metric on Cone(Ω) then C 1/p is a metric on M+(Ω).

Theorem (Duality)

For all (x, y) ∈ Ω2, c(x, ·, y, ·) is the support function of a closed convex nonempty set Q(x, y) ⊂ R2.

7 / 20

slide-22
SLIDE 22

Introduction Static Dynamic Examples & Numerics Conclusion

Properties

Ω R+

  • ×

mxδx

c1/p

  • ×myδy

Cone(Ω) := (Ω × R+)/(Ω × {0})

Theorem (Metric property)

If c1/p is a metric on Cone(Ω) then C 1/p is a metric on M+(Ω).

Theorem (Duality)

For all (x, y) ∈ Ω2, c(x, ·, y, ·) is the support function of a closed convex nonempty set Q(x, y) ⊂ R2. If Q is l.s.c. in the sense of multifunctions, then C(ρ0, ρ1) = sup

φ,ψ∈C(Ω)

φ(x)dρ0(x) +

ψ(y)dρ1(y) subject to (φ(x), ψ(y)) ∈ Q(x, y) for all (x, y) ∈ Ω2 .

7 / 20

slide-23
SLIDE 23

Introduction Static Dynamic Examples & Numerics Conclusion

Outline

Static Formulation Dynamic Formulation Examples & Numerics

8 / 20

slide-24
SLIDE 24

Introduction Static Dynamic Examples & Numerics Conclusion

A dynamic approach: standard OT

  • ×
  • ×
  • ×

ρtδx(t)

vt

9 / 20

slide-25
SLIDE 25

Introduction Static Dynamic Examples & Numerics Conclusion

A dynamic approach: standard OT

  • ×
  • ×
  • ×

ρtδx(t)

vt Change of variables: ω = ρv Infinitesimal cost : f (x, ρ, ω)

9 / 20

slide-26
SLIDE 26

Introduction Static Dynamic Examples & Numerics Conclusion

A dynamic approach: standard OT

  • ×
  • ×
  • ×

ρtδx(t)

vt Change of variables: ω = ρv Infinitesimal cost : f (x, ρ, ω)

  • homogeneous in (ρ, ω);

9 / 20

slide-27
SLIDE 27

Introduction Static Dynamic Examples & Numerics Conclusion

A dynamic approach: standard OT

  • ×
  • ×
  • ×

ρtδx(t)

vt Change of variables: ω = ρv Infinitesimal cost : f (x, ρ, ω)

  • homogeneous in (ρ, ω);
  • subadditive in (ρ, ω);

9 / 20

slide-28
SLIDE 28

Introduction Static Dynamic Examples & Numerics Conclusion

A dynamic approach: standard OT

  • ×
  • ×
  • ×

ρtδx(t)

vt Change of variables: ω = ρv Infinitesimal cost : f (x, ρ, ω)

  • homogeneous in (ρ, ω);
  • subadditive in (ρ, ω);

Standard dynamic formulation

minimize 1

f (x, dρ dµ, dω dµ)dµ (ρ, |ω| ≪ µ) subject to ∂tρ + ∇ · ω = 0 (weakly) (projt=0)#ρ = ρ0 , (projt=1)#ρ = ρ1 .

9 / 20

slide-29
SLIDE 29

Introduction Static Dynamic Examples & Numerics Conclusion

A dynamic approach : unbalanced OT

  • ×
  • ×
  • ×

ρtδx(t)

vt

αt = ∂t ρt

ρt

10 / 20

slide-30
SLIDE 30

Introduction Static Dynamic Examples & Numerics Conclusion

A dynamic approach : unbalanced OT

  • ×
  • ×
  • ×

ρtδx(t)

vt

αt = ∂t ρt

ρt

Variables: ω = ρv, ζ = ρα Infinitesimal cost : f (x, ρ, ω, ζ)

10 / 20

slide-31
SLIDE 31

Introduction Static Dynamic Examples & Numerics Conclusion

A dynamic approach : unbalanced OT

  • ×
  • ×
  • ×

ρtδx(t)

vt

αt = ∂t ρt

ρt

Variables: ω = ρv, ζ = ρα Infinitesimal cost : f (x, ρ, ω, ζ)

  • homogeneous in (ρ, ω, ζ);

10 / 20

slide-32
SLIDE 32

Introduction Static Dynamic Examples & Numerics Conclusion

A dynamic approach : unbalanced OT

  • ×
  • ×
  • ×

ρtδx(t)

vt

αt = ∂t ρt

ρt

Variables: ω = ρv, ζ = ρα Infinitesimal cost : f (x, ρ, ω, ζ)

  • homogeneous in (ρ, ω, ζ);
  • subadditive in (ρ, ω, ζ);

10 / 20

slide-33
SLIDE 33

Introduction Static Dynamic Examples & Numerics Conclusion

A dynamic approach : unbalanced OT

  • ×
  • ×
  • ×

ρtδx(t)

vt

αt = ∂t ρt

ρt

Variables: ω = ρv, ζ = ρα Infinitesimal cost : f (x, ρ, ω, ζ)

  • homogeneous in (ρ, ω, ζ);
  • subadditive in (ρ, ω, ζ);
  • ρ < 0 ⇒ f = +∞;

10 / 20

slide-34
SLIDE 34

Introduction Static Dynamic Examples & Numerics Conclusion

A dynamic approach : unbalanced OT

  • ×
  • ×
  • ×

ρtδx(t)

vt

αt = ∂t ρt

ρt

Variables: ω = ρv, ζ = ρα Infinitesimal cost : f (x, ρ, ω, ζ)

  • homogeneous in (ρ, ω, ζ);
  • subadditive in (ρ, ω, ζ);
  • ρ < 0 ⇒ f = +∞;
  • sign (f ) = sign (|ω| + |ζ|)

10 / 20

slide-35
SLIDE 35

Introduction Static Dynamic Examples & Numerics Conclusion

A dynamic approach : unbalanced OT

  • ×
  • ×
  • ×

ρtδx(t)

vt

αt = ∂t ρt

ρt

Variables: ω = ρv, ζ = ρα Infinitesimal cost : f (x, ρ, ω, ζ)

  • homogeneous in (ρ, ω, ζ);
  • subadditive in (ρ, ω, ζ);
  • ρ < 0 ⇒ f = +∞;
  • sign (f ) = sign (|ω| + |ζ|)
  • mult. dependancy in x, l.s.c.

10 / 20

slide-36
SLIDE 36

Introduction Static Dynamic Examples & Numerics Conclusion

A dynamic approach : unbalanced OT

  • ×
  • ×
  • ×

ρtδx(t)

vt

αt = ∂t ρt

ρt

Variables: ω = ρv, ζ = ρα Infinitesimal cost : f (x, ρ, ω, ζ)

  • homogeneous in (ρ, ω, ζ);
  • subadditive in (ρ, ω, ζ);
  • ρ < 0 ⇒ f = +∞;
  • sign (f ) = sign (|ω| + |ζ|)
  • mult. dependancy in x, l.s.c.

Unbalanced dynamic formulation

CD(ρ0, ρ1) := minimize 1

f (x, dρ dµ, dω dµ, dζ dµ)dµ(t, x) subject to ∂tρ + ∇ · ω = ζ (weakly) (projt=0)#ρ = ρ0 , (projt=1)#ρ = ρ1 .

10 / 20

slide-37
SLIDE 37

Introduction Static Dynamic Examples & Numerics Conclusion

Existence of minimizers & duality

For all x ∈ Ω, f (x, ·) is the support function of Q(x), a closed, convex, non-empty set.

11 / 20

slide-38
SLIDE 38

Introduction Static Dynamic Examples & Numerics Conclusion

Existence of minimizers & duality

For all x ∈ Ω, f (x, ·) is the support function of Q(x), a closed, convex, non-empty set.

Theorem

Assume that Q is a l.s.c. multifunction. Then the minimum defining CD is attained and CD(ρ0, ρ1) = sup

ϕ∈C 1([0,1]×Ω)

ϕ(1, x)dρ1(x) −

ϕ(0, x)dρ0(x) subject to (∂tϕ, ∇ϕ, ϕ)(t, x) ∈ Q(x) .

11 / 20

slide-39
SLIDE 39

Introduction Static Dynamic Examples & Numerics Conclusion

Dynamic to Static : “Benamou-Brenier” formula

Costs between points in Cone(Ω): Dirac-based cost cd : CD(m0δx0, m1δx1) Path-based cost cp : infimum of the dynamic functional restricted to smooth, stable Dirac trajectories m(t)δx(t).

12 / 20

slide-40
SLIDE 40

Introduction Static Dynamic Examples & Numerics Conclusion

Dynamic to Static : “Benamou-Brenier” formula

Costs between points in Cone(Ω): Dirac-based cost cd : CD(m0δx0, m1δx1) Path-based cost cp : infimum of the dynamic functional restricted to smooth, stable Dirac trajectories m(t)δx(t).

Theorem (C. et al., 2015)

Let c be a cost function satisfying cd ≤ c ≤ cp. If the associated problem C is weakly* continuous, then C = CD (and c = cd).

Note : cd is hard to compute directly in general.

12 / 20

slide-41
SLIDE 41

Introduction Static Dynamic Examples & Numerics Conclusion

Dynamic to Static : “Benamou-Brenier” formula

Costs between points in Cone(Ω): Dirac-based cost cd : CD(m0δx0, m1δx1) Path-based cost cp : infimum of the dynamic functional restricted to smooth, stable Dirac trajectories m(t)δx(t).

Theorem (C. et al., 2015)

Let c be a cost function satisfying cd ≤ c ≤ cp. If the associated problem C is weakly* continuous, then C = CD (and c = cd).

Note : cd is hard to compute directly in general.

Example

A good candidate is the convex regularization of cp: inf

ma

0+mb 0=m0

ma

1+mb 1=m1

cp((x0, ma

0), (x1, ma 1)) + cp((x0, mb 0), (x1, mb 1))

12 / 20

slide-42
SLIDE 42

Introduction Static Dynamic Examples & Numerics Conclusion

Outline

Static Formulation Dynamic Formulation Examples & Numerics

13 / 20

slide-43
SLIDE 43

Introduction Static Dynamic Examples & Numerics Conclusion

Partial OT / Wasserstein-TV

Extend the results in [Piccoli and Rossi, 2013]

14 / 20

slide-44
SLIDE 44

Introduction Static Dynamic Examples & Numerics Conclusion

Partial OT / Wasserstein-TV

Extend the results in [Piccoli and Rossi, 2013]

Static

C := min

˜ ρ0, ˜ ρ1

1 p W p

p (˜

ρ0, ˜ ρ1) + δ (|ρ0 − ˜ ρ0|TV + |ρ1 − ˜ ρ1|TV )

14 / 20

slide-45
SLIDE 45

Introduction Static Dynamic Examples & Numerics Conclusion

Partial OT / Wasserstein-TV

Extend the results in [Piccoli and Rossi, 2013]

Static

C := min

˜ ρ0, ˜ ρ1

1 p W p

p (˜

ρ0, ˜ ρ1) + δ (|ρ0 − ˜ ρ0|TV + |ρ1 − ˜ ρ1|TV )

Dynamic

min 1

1 p ωp ρp−1 + δ|ζ| s.t. ∂tρ + ∇ · ω = ζ

14 / 20

slide-46
SLIDE 46

Introduction Static Dynamic Examples & Numerics Conclusion

Partial OT / Wasserstein-TV

Extend the results in [Piccoli and Rossi, 2013]

Static

C := min

˜ ρ0, ˜ ρ1

1 p W p

p (˜

ρ0, ˜ ρ1) + δ (|ρ0 − ˜ ρ0|TV + |ρ1 − ˜ ρ1|TV )

Dynamic

min 1

1 p ωp ρp−1 + δ|ζ| s.t. ∂tρ + ∇ · ω = ζ

  • equivalent to the “Lagrangian” formulation of partial OT: m ↔ δ;

14 / 20

slide-47
SLIDE 47

Introduction Static Dynamic Examples & Numerics Conclusion

Partial OT / Wasserstein-TV

Extend the results in [Piccoli and Rossi, 2013]

Static

C := min

˜ ρ0, ˜ ρ1

1 p W p

p (˜

ρ0, ˜ ρ1) + δ (|ρ0 − ˜ ρ0|TV + |ρ1 − ˜ ρ1|TV )

Dynamic

min 1

1 p ωp ρp−1 + δ|ζ| s.t. ∂tρ + ∇ · ω = ζ

  • equivalent to the “Lagrangian” formulation of partial OT: m ↔ δ;
  • C 1/p defines a metric on M+(Ω);

14 / 20

slide-48
SLIDE 48

Introduction Static Dynamic Examples & Numerics Conclusion

Partial OT / Wasserstein-TV

Extend the results in [Piccoli and Rossi, 2013]

Static

C := min

˜ ρ0, ˜ ρ1

1 p W p

p (˜

ρ0, ˜ ρ1) + δ (|ρ0 − ˜ ρ0|TV + |ρ1 − ˜ ρ1|TV )

Dynamic

min 1

1 p ωp ρp−1 + δ|ζ| s.t. ∂tρ + ∇ · ω = ζ

  • equivalent to the “Lagrangian” formulation of partial OT: m ↔ δ;
  • C 1/p defines a metric on M+(Ω);
  • geodesics are not absolutely continuous;

14 / 20

slide-49
SLIDE 49

Introduction Static Dynamic Examples & Numerics Conclusion

Partial OT / Wasserstein-TV

Extend the results in [Piccoli and Rossi, 2013]

Static

C := min

˜ ρ0, ˜ ρ1

1 p W p

p (˜

ρ0, ˜ ρ1) + δ (|ρ0 − ˜ ρ0|TV + |ρ1 − ˜ ρ1|TV )

Dynamic

min 1

1 p ωp ρp−1 + δ|ζ| s.t. ∂tρ + ∇ · ω = ζ

  • equivalent to the “Lagrangian” formulation of partial OT: m ↔ δ;
  • C 1/p defines a metric on M+(Ω);
  • geodesics are not absolutely continuous;
  • dual formula : add the contraint “bounded by δ”.

14 / 20

slide-50
SLIDE 50

Introduction Static Dynamic Examples & Numerics Conclusion

Wasserstein-Fisher-Rao : WF

Static

WF 2 := min

  • |ρ0|TV + |ρ1|TV

−2

  • Ω2 cos

|y − x| 2 ∧ π 2

  • d√γ0γ1(x, y)
  • s.t. projxγ0 = ρ0 , projyγ1 = ρ1

15 / 20

slide-51
SLIDE 51

Introduction Static Dynamic Examples & Numerics Conclusion

Wasserstein-Fisher-Rao : WF

Static

WF 2 := min

  • |ρ0|TV + |ρ1|TV

−2

  • Ω2 cos

|y − x| 2 ∧ π 2

  • d√γ0γ1(x, y)
  • s.t. projxγ0 = ρ0 , projyγ1 = ρ1

Dynamic

min 1 4 1

|ω|2 ρ + ζ2 ρ s.t. ∂tρ + ∇ · ω = ζ

15 / 20

slide-52
SLIDE 52

Introduction Static Dynamic Examples & Numerics Conclusion

Wasserstein-Fisher-Rao : WF

Static

WF 2 := min

  • |ρ0|TV + |ρ1|TV

−2

  • Ω2 cos

|y − x| 2 ∧ π 2

  • d√γ0γ1(x, y)
  • s.t. projxγ0 = ρ0 , projyγ1 = ρ1

Dynamic

min 1 4 1

|ω|2 ρ + ζ2 ρ s.t. ∂tρ + ∇ · ω = ζ

  • WF defines a Riemannian-like metric on M+(Ω) (curvature);

15 / 20

slide-53
SLIDE 53

Introduction Static Dynamic Examples & Numerics Conclusion

Wasserstein-Fisher-Rao : WF

Static

WF 2 := min

  • |ρ0|TV + |ρ1|TV

−2

  • Ω2 cos

|y − x| 2 ∧ π 2

  • d√γ0γ1(x, y)
  • s.t. projxγ0 = ρ0 , projyγ1 = ρ1

Dynamic

min 1 4 1

|ω|2 ρ + ζ2 ρ s.t. ∂tρ + ∇ · ω = ζ

  • WF defines a Riemannian-like metric on M+(Ω) (curvature);
  • static cost in 1D : |√m0eix0 − √m1eix1|2;

15 / 20

slide-54
SLIDE 54

Introduction Static Dynamic Examples & Numerics Conclusion

Wasserstein-Fisher-Rao : WF

Static

WF 2 := min

  • |ρ0|TV + |ρ1|TV

−2

  • Ω2 cos

|y − x| 2 ∧ π 2

  • d√γ0γ1(x, y)
  • s.t. projxγ0 = ρ0 , projyγ1 = ρ1

Dynamic

min 1 4 1

|ω|2 ρ + ζ2 ρ s.t. ∂tρ + ∇ · ω = ζ

  • WF defines a Riemannian-like metric on M+(Ω) (curvature);
  • static cost in 1D : |√m0eix0 − √m1eix1|2;
  • relaxed constraints formulation : Kullback-Leibler penalization with

the cost − log(cos(|y − x| ∧ π

2 ));

15 / 20

slide-55
SLIDE 55

Introduction Static Dynamic Examples & Numerics Conclusion

Wasserstein-Fisher-Rao : WF

Static

WF 2 := min

  • |ρ0|TV + |ρ1|TV

−2

  • Ω2 cos

|y − x| 2 ∧ π 2

  • d√γ0γ1(x, y)
  • s.t. projxγ0 = ρ0 , projyγ1 = ρ1

Dynamic

min 1 4 1

|ω|2 ρ + ζ2 ρ s.t. ∂tρ + ∇ · ω = ζ

  • WF defines a Riemannian-like metric on M+(Ω) (curvature);
  • static cost in 1D : |√m0eix0 − √m1eix1|2;
  • relaxed constraints formulation : Kullback-Leibler penalization with

the cost − log(cos(|y − x| ∧ π

2 ));

  • [Liero et al., 2015, Kondratyev et al., 2015, Chizat et al., 2015b] .

15 / 20

slide-56
SLIDE 56

Introduction Static Dynamic Examples & Numerics Conclusion

Numerics

Proximal splitting algorithms on the dynamic formulation : https://github.com/lchizat/optimal-transport

Figure: FR Figure: W2 Figure: W2 − TV Figure: W2 − FR

17 / 20

slide-57
SLIDE 57

Introduction Static Dynamic Examples & Numerics Conclusion

Conclusion

In progress

  • Numerics on the relaxed marginal formulation

18 / 20

slide-58
SLIDE 58

Introduction Static Dynamic Examples & Numerics Conclusion

Conclusion

In progress

  • Numerics on the relaxed marginal formulation
  • More applications

18 / 20

slide-59
SLIDE 59

Introduction Static Dynamic Examples & Numerics Conclusion

Conclusion

In progress

  • Numerics on the relaxed marginal formulation
  • More applications

Take home message

A unified framework for unbalanced OT allowing dynamic, static and dual formulations.

18 / 20

slide-60
SLIDE 60

Introduction Static Dynamic Examples & Numerics Conclusion

For Further Reading I

Chizat, L., Peyr´ e, G., Schmitzer, B., and Vialard, F.-X. (2015a). Unbalanced optimal transport: geometry and Kantorovich formulation. arXiv preprint arXiv:1508.05216. Chizat, L., Schmitzer, B., Peyr´ e, G., and Vialard, F.-X. (2015b). An interpolating distance between optimal transport and Fisher-Rao. http://arxiv.org/abs/1506.06430. Kondratyev, S., Monsaingeon, L., and Vorotnikov, D. (2015). A new optimal transport distance on the space of finite Radon measures. Technical report, Pre-print.

19 / 20

slide-61
SLIDE 61

Introduction Static Dynamic Examples & Numerics Conclusion

For Further Reading II

Liero, M., Mielke, A., and Savar´ e, G. (2015). Optimal Entropy-Transport problems and a new Hellinger-Kantorovich distance between positive measures. ArXiv e-prints. Piccoli, B. and Rossi, F. (2013). On properties of the Generalized Wasserstein distance. arXiv:1304.7014. d

20 / 20