UTA-poly and UTADIS-poly: using polynomial marginal utility - - PowerPoint PPT Presentation

uta poly and utadis poly using polynomial marginal
SMART_READER_LITE
LIVE PREVIEW

UTA-poly and UTADIS-poly: using polynomial marginal utility - - PowerPoint PPT Presentation

UTA-poly and UTADIS-poly: using polynomial marginal utility functions in UTA and UTADIS Olivier Sobrie 1 , 2 - Nicolas Gillis 2 - Vincent Mousseau 1 - Marc Pirlot 2 1 cole Centrale de Paris - Laboratoire de Gnie Industriel 2 University of Mons


slide-1
SLIDE 1

UTA-poly and UTADIS-poly: using polynomial marginal utility functions in UTA and UTADIS

Olivier Sobrie1,2 - Nicolas Gillis2 - Vincent Mousseau1 - Marc Pirlot2

1École Centrale de Paris - Laboratoire de Génie Industriel 2University of Mons - Faculty of engineering

July 15, 2015

University of Mons

  • O. Sobrie - N. Gillis - V. Mousseau - M. Pirlot - July 15, 2015

1 / 26

slide-2
SLIDE 2

1 UTA methods 2 Motivations for UTA-poly and UTADIS-poly 3 UTA-poly and UTADIS-poly 4 Experiments 5 Conclusion

University of Mons

  • O. Sobrie - N. Gillis - V. Mousseau - M. Pirlot - July 15, 2015

2 / 26

slide-3
SLIDE 3

UTA methods

Additive utility function model

◮ A marginal utility function uj is associated to each criterion j ◮ Marginal utility functions are monotonic ◮ Marginal utility functions are normalized between 0 and 1, s.t.

uj(gj) = 0 and uj(gj) = 1

◮ A weight wj is associated to each criterion j, s.t. j wj = 1

uj j

+

0gj 1 gj uj(aj) aj

◮ Utility of an alternative a :

U(a) =

n

  • j=1

wj · uj(aj)

University of Mons

  • O. Sobrie - N. Gillis - V. Mousseau - M. Pirlot - July 15, 2015

3 / 26

slide-4
SLIDE 4

UTA methods

Additive utility function model

◮ A marginal utility function uj is associated to each criterion j ◮ Marginal utility functions are monotonic ◮ Marginal utility functions are normalized between 0 and 1, s.t.

uj(gj) = 0 and uj(gj) = 1

◮ A weight wj is associated to each criterion j, s.t. j wj = 1

u∗

j

j

+

0gj wj gj u∗

j(aj)

aj

◮ We also have :

u∗

j (a) = wj · uj(aj) and u∗ j (gj) = wj ◮ Utility of an alternative a :

U(a) =

n

  • j=1

wj · uj(aj) =

n

  • j=1

u∗

j (aj)

University of Mons

  • O. Sobrie - N. Gillis - V. Mousseau - M. Pirlot - July 15, 2015

3 / 26

slide-5
SLIDE 5

UTA methods

UTA : Presentation

◮ Not easy to elicit directly the marginal utility functions ◮ Disaggregation procedure proposed by

[Jacquet-Lagrèze and Siskos, 1982]

◮ Utility functions are computed on basis of a ranking given in input ◮ Linear programming

University of Mons

  • O. Sobrie - N. Gillis - V. Mousseau - M. Pirlot - July 15, 2015

4 / 26

slide-6
SLIDE 6

UTA methods

UTA - Constraints I

◮ Two type of information (pairwise comparison) :

  • 1. a is preferred to b, i.e. U(a) > U(b) ⇒ (a, b) ∈ P
  • 2. a is indifferent to b, i.e. U(a) = U(b) ⇒ (a, b) ∈ I

◮ A potential error is introduced for each alternative utility U(a), s.t.

U′(a) = U(a) + σ+(a) − σ−(a)

◮ Constraints of the linear program :

                         U(a) − U(b) + σ+(a) − σ−(a) −σ+(b) + σ−(b) > ∀(a, b) ∈ P, U(a) − U(b) + σ+(a) − σ−(a) −σ+(b) + σ−(b) = ∀(a, b) ∈ I, n

j=1 u∗ j (gj)

= 1, n

j=1 u∗ j (gj)

= 0, σ+(a), σ−(a) ≥ ∀a ∈ A∗, u∗

j

monotonic ∀j ∈ N.

University of Mons

  • O. Sobrie - N. Gillis - V. Mousseau - M. Pirlot - July 15, 2015

5 / 26

slide-7
SLIDE 7

UTA methods

UTA - Constraints II

◮ Monotonicity is ensured by using piecewise linear functions for the

marginal utility functions

u∗

j

j

+

0gj

+

u∗1

j

+

g1

j

+

u∗2

j

+

g2

j

+

u∗3

j

+

g3

j

+

wj

+

gj u∗

j(aj)

aj

◮ Domain of the criterion split in k equal

parts

◮ Position of the g l

j , for l = 0, . . . , k fixed a

priori (equidistant)

◮ Marginal utility value of an alternative a :

u∗

j (a) = u∗L−1 j

+

  • aj − g L−1

j

g L

j − g L−1 j

u∗L

j

− u∗L−1

j

  • with g L

j the first breakpoint s.t. aj ≤ g L j

University of Mons

  • O. Sobrie - N. Gillis - V. Mousseau - M. Pirlot - July 15, 2015

6 / 26

slide-8
SLIDE 8

UTA methods

UTADIS

◮ Sorting problems ◮ Comparison of alternatives to thresholds delimiting the categories ◮ Disaggregation though linear programming ◮ Similar approach as for UTA : utility functions are modelled through

piecewise linear functions

University of Mons

  • O. Sobrie - N. Gillis - V. Mousseau - M. Pirlot - July 15, 2015

7 / 26

slide-9
SLIDE 9

Motivations for UTA-poly and UTADIS-poly

Motivations for UTA-poly and UTADIS-poly I

Drawbacks of UTA methods

◮ Marginal utility functions are not natural close to the breakpoints of

the piecewise linear functions

◮ Breakpoints at pre-defined position : limit the flexibility of the model

Existing works

◮ Bugera, V., Konno, H., and Uryasev, S. (2002). Credit cards scoring with

quadratic utility functions. Journal of Multi-Criteria Decision Analysis, 11(4-5):197–211

◮ Słowínski, R., Greco, S., and Mousseau, V. (2005). Multi-criteria ranking of

a finite set of alternatives using ordinal regression and additive utility functions - a new UTA-GMS method. In Practical Approaches to Multi-Objective Optimization

University of Mons

  • O. Sobrie - N. Gillis - V. Mousseau - M. Pirlot - July 15, 2015

8 / 26

slide-10
SLIDE 10

Motivations for UTA-poly and UTADIS-poly

Motivations for UTA-poly and UTADIS-poly II

UTA-poly and UTADIS-poly

◮ We propose to replace piecewise linear functions by polynomial ones

by using semi-definite programming (SDP)

◮ Degree of the polynomial chosen a priori

u∗

j

j

+

0gj

+

u∗1

j

+

g1

j

+

u∗2

j

+

g2

j

+

u∗3

j

+

g3

j

+

wj

+

gj u∗

j(aj)

aj

u∗

j (a) = u∗ j (g1 j )+

  • aj − g1

j

g2

j − g1 j

u∗2

j

− u∗1

j

u∗

j

j

+

0gj wj gj u∗

j(aj)

aj

u∗

j (a) = p0+p1·aj +p2·a2 j +. . .+pD·aD j

University of Mons

  • O. Sobrie - N. Gillis - V. Mousseau - M. Pirlot - July 15, 2015

9 / 26

slide-11
SLIDE 11

UTA-poly and UTADIS-poly

Semi-Definite Programming (SDP) I

Theorem A polynomial F(z), with z ∈ Rn is nonnegative if it is possible to decompose it as a sum of squares (SOS) : F(z) =

  • s

f 2

s (z)

with fs(z) ∈ Rn. Not every non-negative polynomial is a Sum Of Squares (SOS), but : Theorem (Hilbert) A non-negative polynomial in one variable is always a SOS.

University of Mons

  • O. Sobrie - N. Gillis - V. Mousseau - M. Pirlot - July 15, 2015

10 / 26

slide-12
SLIDE 12

UTA-poly and UTADIS-poly

Semi-Definite Programming (SDP) II

◮ Consider the following polynomial of degree D :

p(x) = p0 + p1x + p2x2 + ... + pDxD =

D

  • i=0

pixi. p(x) non-negative ⇐ ⇒ it can be decomposed as a SOS.

◮ Let d =

D

2

  • , bT

s = [b0 s , b1 s , ..., bd s ] and xT = [1, x, ..., xd], the

polynomial reads : p(x) =

  • s

q2

s (x) =

  • s

d

  • i=0

bi

sxi j

  • =
  • s
  • bT

s x

2 =

  • s

xTbsbT

s x = xT

  • s

bsbT

s

  • x = xTQx

University of Mons

  • O. Sobrie - N. Gillis - V. Mousseau - M. Pirlot - July 15, 2015

11 / 26

slide-13
SLIDE 13

UTA-poly and UTADIS-poly

Semi-Definite Programming (SDP) III

p(x) = p0 + p1x + p2x2 + . . . + pDxD = xTQx =        1 x x2 . . . xd       

T 

      q0,0 q0,1 q0,2 · · · q0,d q1,0 q1,1 q1,2 · · · q1,d q2,0 q2,1 q2,2 · · · q2,d . . . . . . . . . ... . . . qd,0 qd,1 qd,2 · · · qd,d               1 x x2 . . . xd        .

◮ p0, p1, . . . , pD are obtained by summing the off-diagonal entries of Q :

                     p0 = q0,0, p1 = q1,0 + q0,1, p2 = q2,0 + q1,1 + q0,2, . . . p2d−1 = qd,d−1 + qd−1,d, p2d = qd,d, if D is odd, we have p2d = 0.

University of Mons

  • O. Sobrie - N. Gillis - V. Mousseau - M. Pirlot - July 15, 2015

12 / 26

slide-14
SLIDE 14

UTA-poly and UTADIS-poly

UTA-poly and UTADIS-poly

◮ Marginal utility functions defined as polynomials of degree D :

u∗

j (aj) = D

  • i=0

pj,i · ai

j. ◮ To ensure monotonicity of the function, u∗′ j (aj) has to be nonnegative.

⇒ u∗′

j

should be a SOS : ∂u∗

j

∂aj = pj,1 + 2pj,2 · aj + 3pj,3 · a2

j + ... + Dpj,n · aD−1 j

= ∂ ∂aj

  • aj TQaj
  • ◮ Using a SDP solver, we impose Q to be semidefinite positive.

University of Mons

  • O. Sobrie - N. Gillis - V. Mousseau - M. Pirlot - July 15, 2015

13 / 26

slide-15
SLIDE 15

UTA-poly and UTADIS-poly

UTA-poly - Example I

x y a1 10 7 a2 6 8 a3 7 5 a1 ≻ a2 ≻ a3

◮ We define u∗ 1(x) and u∗ 2(y) as second degree polynomials :

u∗

1(x) = px,0 + px,1 · x + px,2 · x2,

u∗

2(y) = py,0 + py,1 · y + py,2 · y2. ◮ Utilities of a1, a2 and a3 are given by :

U(a1) = px,0 + 10px,1 + 100px,2 + py,0 + 7py,1 + 49py,2, U(a2) = px,0 + 6px,1 + 36px,2 + py,0 + 8py,1 + 64py,2, U(a3) = px,0 + 7px,1 + 49px,2 + py,0 + 5py,1 + 25py,2.

University of Mons

  • O. Sobrie - N. Gillis - V. Mousseau - M. Pirlot - July 15, 2015

14 / 26

slide-16
SLIDE 16

UTA-poly and UTADIS-poly

UTA-poly - Example II

◮ We have a1 ≻ a2 and a2 ≻ a3, which implies :

U(a1) − U(a2) + σ+(a1) − σ−(a1) − σ+(a2) + σ−(a2) > 0, U(a2) − U(a3) + σ+(a2) − σ−(a2) − σ+(a1) + σ−(a1) > 0.

◮ By replacing U(a1), U(a2) and U(a3), we have :

       4px,1 + 64px,2 − py,1 − 15py,2 + σ+(a1) − σ−(a1) −σ+(a2) + σ−(a2) > 0, −px,1 − 13px,2 + 3py,1 + 39py,2 + σ+(a2) − σ−(a2) −σ+(a3) + σ−(a3) > 0.

University of Mons

  • O. Sobrie - N. Gillis - V. Mousseau - M. Pirlot - July 15, 2015

15 / 26

slide-17
SLIDE 17

UTA-poly and UTADIS-poly

UTA-poly - Example III

◮ We impose the derivate of u∗ 1 and u∗ 2 to be SOS :

∂u∗

1

∂x = xTQx = 1 x T qx,0,0 qx,0,1 qx,1,0 qx,1,1 1 x

  • = q0,0 + (q0,1 + q0,1) x + q1,1x2,

∂u∗

2

∂y = yTRy = r0,0 + (r0,1 + r1,0) y + r1,1y2.

◮ Q and R have to be semi-definite positive, in conjunction with :

  • px,1

= q0,1 + q1,0, 2px,2 = q1,1, and

  • py,1

= r0,1 + r1,0, 2py,2 = r1,1.

University of Mons

  • O. Sobrie - N. Gillis - V. Mousseau - M. Pirlot - July 15, 2015

16 / 26

slide-18
SLIDE 18

UTA-poly and UTADIS-poly

UTA-poly - Example IV

◮ We add normalization constraints :

   px,0 = 0, py,0 = 0, 10px,1 + 100px,2 + 10py,1 + 100py,2 = 1.

University of Mons

  • O. Sobrie - N. Gillis - V. Mousseau - M. Pirlot - July 15, 2015

17 / 26

slide-19
SLIDE 19

UTA-poly and UTADIS-poly

UTA-poly - Example V

◮ Finally, we obtain the following program :

min σ+(a1) + σ−(a1) + σ+(a2) + σ−(a2) + σ+(a3) + σ−(a3). such that :                                    4px,1 + 64px,2 − py,1 − 15py,2 + σ+(a1) − σ−(a1) −σ+(a2) + σ−(a2) > 0, −px,1 − 13px,2 + 3py,1 + 39py,2 + σ+(a2) − σ−(a2) −σ+(a3) + σ−(a3) > 0, px,0 = 0, py,0 = 0, 10px,1 + 100px,2 + 10py,1 + 100py,2 = 1, px,1 = q0,1 + q1,0, 2px,2 = q1,1, py,1 = r0,1 + r1,0, 2py,2 = r1,1, with :

  • Q, R

≥ 0, σ+(a1), σ−(a1), σ+(a2), σ−(a2), σ+(a3), σ−(a3), ≥ 0.

University of Mons

  • O. Sobrie - N. Gillis - V. Mousseau - M. Pirlot - July 15, 2015

18 / 26

slide-20
SLIDE 20

Experiments

Illustrative example (UTADIS-poly) I

◮ Evaluation of accommodations for holidays on 3 criteria : price,

distance and size.

◮ 10 categories (from good to bad) ◮ Consider the following true marginal utility functions 300 400 500 600 0.0 0.2 0.4 euro uj(xj) price 500 1,000 1,500 0.0 0.2 0.4 km distance −1,500−1,000 −500 0.0 0.1 0.2 m2 size ◮ 200 examples given as input to UTADIS-poly

University of Mons

  • O. Sobrie - N. Gillis - V. Mousseau - M. Pirlot - July 15, 2015

19 / 26

slide-21
SLIDE 21

Experiments

Illustrative example (UTADIS-poly) II

300 350 400 450 500 550 600 0.0 0.2 0.4 euro uj(xj) price 400 600 800 1,000 1,200 1,400 1,600 0.0 0.2 0.4 km distance −1,600 −1,400 −1,200 −1,000 −800 −600 −400 0.0 0.1 0.2 m2 uj(xj) size

real D = 3 D = 6 D = 12

University of Mons

  • O. Sobrie - N. Gillis - V. Mousseau - M. Pirlot - July 15, 2015

20 / 26

slide-22
SLIDE 22

Experiments

Computing time

200 400 10 20 30 number of alternatives time (seconds) (a) UTA-polynomial

n = 5; D = 3 n = 5; D = 7 n = 10; D = 3

4 6 8 10 10 20 30 40 number of criteria (b) UTA-polynomial

m = 200; D = 3 m = 200; D = 7 m = 500; D = 3

4 6 10 20 30 degree of the polynomial time (seconds) (c) UTA-polynomial

m = 200; n = 5 m = 200; n = 10 m = 500; n = 5

4 6 8 10 20 40 number of segments (d) UTA

m = 200; n = 5 m = 200; n = 10 m = 500; n = 5

University of Mons

  • O. Sobrie - N. Gillis - V. Mousseau - M. Pirlot - July 15, 2015

21 / 26

slide-23
SLIDE 23

Experiments

Learning a UTA-poly model from a ranking

  • btained with UTA

50 100 0.9 0.95 1 number of alternatives Spearman distance (a)

n = 5; D = 3 n = 5; D = 7 n = 10; D = 3

4 6 8 10 0.97 0.98 0.99 number of criteria (b)

m = 100; D = 3 m = 100; D = 7 m = 200; D = 3

4 6 0.97 0.98 0.99 degree of polynomials (c)

m = 100; n = 5 m = 100; n = 10 m = 200; n = 5

50 100 0.7 0.8 0.9 number of alternatives Kendall Tau

n = 5; D = 3 n = 5; D = 7 n = 10; D = 3

4 6 8 10 0.8 0.85 0.9 0.95 number of criteria

m = 100; D = 3 m = 100; D = 7 m = 200; D = 3

4 6 0.8 0.85 0.9 0.95 degree of polynomials

m = 100; n = 5 m = 100; n = 10 m = 200; n = 5

University of Mons

  • O. Sobrie - N. Gillis - V. Mousseau - M. Pirlot - July 15, 2015

22 / 26

slide-24
SLIDE 24

Experiments

Learning a UTADIS-poly model from assignment examples obtained with UTADIS

50 100 0.7 0.8 0.9 1 number of alternatives classification accuracy (a)

n = 5; p = 2; D = 3 n = 5; p = 2; D = 7 n = 10; p = 2; D = 3 n = 5; p = 5; D = 3

4 6 8 10 0.8 0.85 0.9 0.95 number of criteria (b)

m = 100; p = 2; D = 3 m = 100; p = 2; D = 7 m = 200; p = 2; D = 3 m = 100; p = 5; D = 3

2 4 6 0.8 0.85 0.9 0.95 number of categories classification accuracy (c)

m = 100; n = 5; D = 3 m = 100; n = 5; D = 7 m = 200; n = 5; D = 3 m = 100; n = 10; D = 3

4 6 0.8 0.85 0.9 0.95 degree of the polynomials (d)

m = 100; n = 5; p = 2 m = 100; n = 5; p = 5 m = 200; n = 5; p = 2 m = 100; n = 10; p = 2

University of Mons

  • O. Sobrie - N. Gillis - V. Mousseau - M. Pirlot - July 15, 2015

23 / 26

slide-25
SLIDE 25

Conclusion

Conclusion

◮ More natural marginal utility functions ◮ Do not increase computing time ◮ Some marginal utility functions are difficult to model (step)

University of Mons

  • O. Sobrie - N. Gillis - V. Mousseau - M. Pirlot - July 15, 2015

24 / 26

slide-26
SLIDE 26

Conclusion

Thank you for your attention !

University of Mons

  • O. Sobrie - N. Gillis - V. Mousseau - M. Pirlot - July 15, 2015

25 / 26

slide-27
SLIDE 27

References

References I

Bugera, V., Konno, H., and Uryasev, S. (2002). Credit cards scoring with quadratic utility functions. Journal of Multi-Criteria Decision Analysis, 11(4-5) :197–211. Jacquet-Lagrèze, E. and Siskos, Y. (1982). Assessing a set of additive utility functions for multicriteria decision making : the UTA method. European Journal of Operational Research, 10 :151–164. Słowínski, R., Greco, S., and Mousseau, V. (2005). Multi-criteria ranking of a finite set of alternatives using ordinal regression and additive utility functions - a new UTA-GMS method. In Practical Approaches to Multi-Objective Optimization.

University of Mons

  • O. Sobrie - N. Gillis - V. Mousseau - M. Pirlot - July 15, 2015

26 / 26