Descriptive complexity linear algebra of Bjarki Holm Logical - - PowerPoint PPT Presentation

descriptive complexity linear algebra
SMART_READER_LITE
LIVE PREVIEW

Descriptive complexity linear algebra of Bjarki Holm Logical - - PowerPoint PPT Presentation

Descriptive complexity linear algebra of Bjarki Holm Logical Approaches to Barriers in Computing & Complexity II Isaac Newton Institute Overview Study definability of natural problems in linear algebra and expressiveness


slide-1
SLIDE 1

Descriptive complexity

Logical Approaches to Barriers in Computing & Complexity II

Bjarki Holm

linear algebra

  • f



Isaac Newton Institute

slide-2
SLIDE 2

Overview

Study definability of natural problems in linear algebra and expressiveness of logics with algebraic operators.

  • Background & motivation
  • Descriptive complexity of problems in linear algebra
  • Logics with matrix-rank operators
  • Pebble games for rank logics & the Weisfeiler-Lehman

method

slide-3
SLIDE 3

Overview

Study definability of natural problems in linear algebra and expressiveness of logics with algebraic operators.

  • Background & motivation
  • Descriptive complexity of problems in linear algebra
  • Logics with matrix-rank operators
  • Pebble games for rank logics & the Weisfeiler-Lehman

method

slide-4
SLIDE 4

A logic for NP

Existential second-order logic Second-order variables existentially quantified, followed by a first-order formula:

∃R1, . . . , Rk . ϕ(R1, . . . , Rk)

ESO —

slide-5
SLIDE 5

A logic for NP

Existential second-order logic Second-order variables existentially quantified, followed by a first-order formula:

∃R1, . . . , Rk . ϕ(R1, . . . , Rk)

ESO —

Fagin (1974)

A decision problem is in NP if and only if it can be defined in ESO.

slide-6
SLIDE 6

A logic for NP

Existential second-order logic Second-order variables existentially quantified, followed by a first-order formula:

∃R1, . . . , Rk . ϕ(R1, . . . , Rk)

“guess”

ESO —

Fagin (1974)

A decision problem is in NP if and only if it can be defined in ESO.

slide-7
SLIDE 7

A logic for NP

Existential second-order logic Second-order variables existentially quantified, followed by a first-order formula:

∃R1, . . . , Rk . ϕ(R1, . . . , Rk)

“guess” “verify”

ESO —

Fagin (1974)

A decision problem is in NP if and only if it can be defined in ESO.

slide-8
SLIDE 8

A logic for NP

Existential second-order logic Second-order variables existentially quantified, followed by a first-order formula:

∃R1, . . . , Rk . ϕ(R1, . . . , Rk)

“guess” “verify”

ESO —

Fagin (1974)

A decision problem is in NP if and only if it can be defined in ESO. Is there a logic for PTIME?

slide-9
SLIDE 9

A logic for PTIME?

slide-10
SLIDE 10

Fixed-point logic captures PTIME on

  • rdered structures

FP is first-order logic with an inflationary fixed-point

  • perator.

A property P of ordered structures can be decided in PTIME if and only if P can be defined by a sentence of FP.

Immerman-Vardi (1982)

slide-11
SLIDE 11

Fixed-point logic captures PTIME on

  • rdered structures

FP is first-order logic with an inflationary fixed-point

  • perator.

A property P of ordered structures can be decided in PTIME if and only if P can be defined by a sentence of FP.

Immerman-Vardi (1982)

Ordered structure: Vocabulary contains a binary symbol interpreted as a total ordering of the vertices.

“6”

slide-12
SLIDE 12

Fixed-point logic captures PTIME on

  • rdered structures

FP is first-order logic with an inflationary fixed-point

  • perator.

A property P of ordered structures can be decided in PTIME if and only if P can be defined by a sentence of FP.

Immerman-Vardi (1982)

slide-13
SLIDE 13

Fixed-point logic captures PTIME on

  • rdered structures

FP is first-order logic with an inflationary fixed-point

  • perator.

A property P of ordered structures can be decided in PTIME if and only if P can be defined by a sentence of FP.

Immerman-Vardi (1982)

  • On unordered structures, FP cannot even express if a

graph has an even or odd number of vertices.

slide-14
SLIDE 14

Fixed-point logic captures PTIME on

  • rdered structures

FP is first-order logic with an inflationary fixed-point

  • perator.

A property P of ordered structures can be decided in PTIME if and only if P can be defined by a sentence of FP.

Immerman-Vardi (1982)

  • On unordered structures, FP cannot even express if a

graph has an even or odd number of vertices.

  • Fixed-point logic with counting (FPC) is FP together with

terms that count the number of solutions to formulas.

slide-15
SLIDE 15

FPC captures PTIME on...

FO FP FPC PTIME

slide-16
SLIDE 16

FPC captures PTIME on...

Ordered structures—1982

FO FP FPC PTIME

slide-17
SLIDE 17

FPC captures PTIME on...

Ordered structures—1982

FO FP FPC PTIME

Trees—1986

slide-18
SLIDE 18

FPC captures PTIME on...

Ordered structures—1982

FO FP FPC PTIME

Trees—1986 Planar graphs—1998

slide-19
SLIDE 19

FPC captures PTIME on...

Ordered structures—1982

FO FP FPC PTIME

Trees—1986 Planar graphs—1998 Graphs of bounded treewidth—1999

slide-20
SLIDE 20

FPC captures PTIME on...

Ordered structures—1982

FO FP FPC PTIME

Trees—1986 Planar graphs—1998 Graphs of bounded treewidth—1999 Minor-closed classes

  • f graphs—2010
slide-21
SLIDE 21

FPC captures PTIME on...

Ordered structures—1982

FO FP FPC PTIME

Trees—1986 Planar graphs—1998 Graphs of bounded treewidth—1999 Minor-closed classes

  • f graphs—2010

“Almost all” graphs—1996

slide-22
SLIDE 22

FPC captures PTIME on... all graphs?

Ordered structures—1982

FO FP FPC PTIME

Trees—1986 Planar graphs—1998 Graphs of bounded treewidth—1999 Minor-closed classes

  • f graphs—2010

“Almost all” graphs—1996

???

slide-23
SLIDE 23

Proving non-definability in FPC

first-order logic with variables x1, ..., xk and counting quantifiers of the form

⇠ 9≥ix . ϕ

Ck —

slide-24
SLIDE 24

Proving non-definability in FPC

first-order logic with variables x1, ..., xk and counting quantifiers of the form

⇠ 9≥ix . ϕ

Ck —

  • 1. Every formula of FPC is invariant under Ck-

equivalence, for some k.

slide-25
SLIDE 25

Proving non-definability in FPC

first-order logic with variables x1, ..., xk and counting quantifiers of the form

⇠ 9≥ix . ϕ

Ck —

  • 1. Every formula of FPC is invariant under Ck-

equivalence, for some k.

  • 2. Ck-equivalence can be characterised by a k-pebble

bijection game

  • (a variant of Ehrenfeucht–Fraïsse)
slide-26
SLIDE 26

Proving non-definability in FPC

first-order logic with variables x1, ..., xk and counting quantifiers of the form

⇠ 9≥ix . ϕ

Ck —

  • 1. Every formula of FPC is invariant under Ck-

equivalence, for some k.

  • 2. Ck-equivalence can be characterised by a k-pebble

bijection game

  • (a variant of Ehrenfeucht–Fraïsse)

G and H agree on all sentences of Ck Duplicator has a winning strategy in the k-pebble bijection game on G and H iff

slide-27
SLIDE 27

Proving non-definability in FPC

first-order logic with variables x1, ..., xk and counting quantifiers of the form

⇠ 9≥ix . ϕ

Ck —

slide-28
SLIDE 28

Proving non-definability in FPC

first-order logic with variables x1, ..., xk and counting quantifiers of the form

⇠ 9≥ix . ϕ

Ck — To show that a property P is not definable in FPC:

slide-29
SLIDE 29

Proving non-definability in FPC

first-order logic with variables x1, ..., xk and counting quantifiers of the form

⇠ 9≥ix . ϕ

Ck — To show that a property P is not definable in FPC: For each k, exhibit a pair of graphs Gk and Hk for which

slide-30
SLIDE 30

Proving non-definability in FPC

first-order logic with variables x1, ..., xk and counting quantifiers of the form

⇠ 9≥ix . ϕ

Ck — To show that a property P is not definable in FPC: For each k, exhibit a pair of graphs Gk and Hk for which

  • Gk has property P but Hk does not; and
slide-31
SLIDE 31

Proving non-definability in FPC

first-order logic with variables x1, ..., xk and counting quantifiers of the form

⇠ 9≥ix . ϕ

Ck — To show that a property P is not definable in FPC: For each k, exhibit a pair of graphs Gk and Hk for which

  • Gk has property P but Hk does not; and
  • Duplicator wins the k-pebble game on Gk and Hk.
slide-32
SLIDE 32

Proving non-definability in FPC

first-order logic with variables x1, ..., xk and counting quantifiers of the form

⇠ 9≥ix . ϕ

Ck —

  • 1. Every formula of FPC is invariant under Ck-

equivalence, for some k.

  • 2. Ck-equivalence can be characterised by a k-pebble

bijection game

  • (a variant of Ehrenfeucht–Fraïsse)
slide-33
SLIDE 33

Proving non-definability in FPC

first-order logic with variables x1, ..., xk and counting quantifiers of the form

⇠ 9≥ix . ϕ

Ck —

  • 1. Every formula of FPC is invariant under Ck-

equivalence, for some k.

  • 2. Ck-equivalence can be characterised by a k-pebble

bijection game

  • (a variant of Ehrenfeucht–Fraïsse)

Facts

slide-34
SLIDE 34

Proving non-definability in FPC

first-order logic with variables x1, ..., xk and counting quantifiers of the form

⇠ 9≥ix . ϕ

Ck —

  • 1. Every formula of FPC is invariant under Ck-

equivalence, for some k.

  • 2. Ck-equivalence can be characterised by a k-pebble

bijection game

  • (a variant of Ehrenfeucht–Fraïsse)

Facts

  • For each k, we can decide the winner of the k-pebble

game in polynomial time.

slide-35
SLIDE 35

Proving non-definability in FPC

first-order logic with variables x1, ..., xk and counting quantifiers of the form

⇠ 9≥ix . ϕ

Ck —

  • 1. Every formula of FPC is invariant under Ck-

equivalence, for some k.

  • 2. Ck-equivalence can be characterised by a k-pebble

bijection game

  • (a variant of Ehrenfeucht–Fraïsse)

Facts

  • For each k, we can decide the winner of the k-pebble

game in polynomial time.

  • Close connection with a family of algorithms for graph

isomorphism: Weisfeiler-Lehman method.

slide-36
SLIDE 36

Non-definability result for FPC

There is a polynomial-time decidable property of finite graphs that is not definable in FPC.

Cai, Fürer and Immerman (1992)

slide-37
SLIDE 37

Non-definability result for FPC

There is a polynomial-time decidable property of finite graphs that is not definable in FPC.

Cai, Fürer and Immerman (1992) “CFI property”

slide-38
SLIDE 38

Non-definability result for FPC

There is a polynomial-time decidable property of finite graphs that is not definable in FPC.

Cai, Fürer and Immerman (1992) “CFI property”

Corollary FPC does not capture PTIME on

slide-39
SLIDE 39

Non-definability result for FPC

There is a polynomial-time decidable property of finite graphs that is not definable in FPC.

Cai, Fürer and Immerman (1992)

  • graphs of bounded degree

“CFI property”

Corollary FPC does not capture PTIME on

slide-40
SLIDE 40

Non-definability result for FPC

There is a polynomial-time decidable property of finite graphs that is not definable in FPC.

Cai, Fürer and Immerman (1992)

  • graphs of bounded degree

(not even degree 3) “CFI property”

Corollary FPC does not capture PTIME on

slide-41
SLIDE 41

Non-definability result for FPC

There is a polynomial-time decidable property of finite graphs that is not definable in FPC.

Cai, Fürer and Immerman (1992)

  • graphs of bounded degree
  • graphs of bounded colour-class size

(not even degree 3) “CFI property”

Corollary FPC does not capture PTIME on

slide-42
SLIDE 42

Non-definability result for FPC

There is a polynomial-time decidable property of finite graphs that is not definable in FPC.

Cai, Fürer and Immerman (1992)

  • graphs of bounded degree
  • graphs of bounded colour-class size

(not even degree 3) (not even size 4) “CFI property”

Corollary FPC does not capture PTIME on

slide-43
SLIDE 43

Non-definability result for FPC

There is a polynomial-time decidable property of finite graphs that is not definable in FPC.

Cai, Fürer and Immerman (1992)

Still, the CFI query is hardly a natural graph property...

  • graphs of bounded degree
  • graphs of bounded colour-class size

(not even degree 3) (not even size 4) “CFI property”

Corollary FPC does not capture PTIME on

slide-44
SLIDE 44

Non-definability result for FPC

There is a polynomial-time decidable property of finite graphs that is not definable in FPC.

Cai, Fürer and Immerman (1992)

Still, the CFI query is hardly a natural graph property... More recently: See which problems in linear algebra can be expressed in FPC

  • graphs of bounded degree
  • graphs of bounded colour-class size

(not even degree 3) (not even size 4) “CFI property”

Corollary FPC does not capture PTIME on

slide-45
SLIDE 45

Descriptive complexity of problems in linear algebra

slide-46
SLIDE 46

The usual notion of a matrix

— an m-by-n rectangular array of elements

1 2 3 4 5 6 7 8 9 10 1 2 3 4 5 6 7 8 9 10

A = (aij)

slide-47
SLIDE 47

The usual notion of a matrix

— an m-by-n rectangular array of elements

1 2 3 4 5 6 7 8 9 10 1 2 3 4 5 6 7 8 9 10

A = (aij) Recall: Over ordered structures FP (and hence FPC) can define all polynomial-time properties.

slide-48
SLIDE 48

The usual notion of a matrix

— an m-by-n rectangular array of elements

1 2 3 4 5 6 7 8 9 10 1 2 3 4 5 6 7 8 9 10

rows and columns

  • rdered

all PTIME matrix properties can be defined in FP

A = (aij) Recall: Over ordered structures FP (and hence FPC) can define all polynomial-time properties.

slide-49
SLIDE 49

The usual notion of a matrix

— an m-by-n rectangular array of elements

1 2 3 4 5 6 7 8 9 10 1 2 3 4 5 6 7 8 9 10

rows and columns

  • rdered

all PTIME matrix properties can be defined in FP

A = (aij) Many natural matrix properties invariant under permutation of rows and columns Recall: Over ordered structures FP (and hence FPC) can define all polynomial-time properties.

slide-50
SLIDE 50

The usual notion of a matrix

— an m-by-n rectangular array of elements

1 2 3 4 5 6 7 8 9 10 1 2 3 4 5 6 7 8 9 10

rows and columns

  • rdered

all PTIME matrix properties can be defined in FP

A = (aij) Many natural matrix properties invariant under permutation of rows and columns Recall: Over ordered structures FP (and hence FPC) can define all polynomial-time properties.

slide-51
SLIDE 51

The usual notion of a matrix

— an m-by-n rectangular array of elements

1 2 3 4 5 6 7 8 9 10 1 2 3 4 5 6 7 8 9 10

rows and columns

  • rdered

all PTIME matrix properties can be defined in FP

A = (aij) Many natural matrix properties invariant under permutation of rows and columns Recall: Over ordered structures FP (and hence FPC) can define all polynomial-time properties.

slide-52
SLIDE 52

The usual notion of a matrix

— an m-by-n rectangular array of elements

1 2 3 4 5 6 7 8 9 10 1 2 3 4 5 6 7 8 9 10

rows and columns

  • rdered

all PTIME matrix properties can be defined in FP

A = (aij) Many natural matrix properties invariant under permutation of rows and columns (rank, determinant, etc.) Recall: Over ordered structures FP (and hence FPC) can define all polynomial-time properties.

slide-53
SLIDE 53

Unordered matrices

I, J — finite and non-empty sets D — a group, a ring or a field

slide-54
SLIDE 54

Unordered matrices

I, J — finite and non-empty sets D — a group, a ring or a field

I J

A : I ⇥ J ! D

slide-55
SLIDE 55

Unordered matrices

I, J — finite and non-empty sets D — a group, a ring or a field

I J

“an I-by-J matrix over D”

A : I ⇥ J ! D

slide-56
SLIDE 56

Unordered systems of linear equations

I J t = I J

I, J — finite and non-empty sets D — a group, a ring or a field

slide-57
SLIDE 57

Unordered systems of linear equations

I J t = A x b = I J

I, J — finite and non-empty sets D — a group, a ring or a field

slide-58
SLIDE 58

Unordered systems of linear equations

I J t = A x b = I J

slide-59
SLIDE 59

Unordered systems of linear equations

As a relational structure over a fixed domain D:

I J t = A x b = I J

slide-60
SLIDE 60

Unordered systems of linear equations

As a relational structure over a fixed domain D:

I J t = A x b = I J

) Ad ✓ I ⇥ J

d bd ✓ I

⇥ ! S = (I, J; (Ad)d∈D, (bd)d∈D)

where and

slide-61
SLIDE 61

Unordered systems of linear equations

As a relational structure over a fixed domain D:

I J t = A x b = I J

) Ad ✓ I ⇥ J

d bd ✓ I

⇥ ! S = (I, J; (Ad)d∈D, (bd)d∈D)

where and

A0

slide-62
SLIDE 62

Unordered systems of linear equations

As a relational structure over a fixed domain D:

I J t = A x b = I J

) Ad ✓ I ⇥ J

d bd ✓ I

⇥ ! S = (I, J; (Ad)d∈D, (bd)d∈D)

where and

A0

slide-63
SLIDE 63

Unordered systems of linear equations

As a relational structure over a fixed domain D:

I J t = A x b = I J

) Ad ✓ I ⇥ J

d bd ✓ I

⇥ ! S = (I, J; (Ad)d∈D, (bd)d∈D)

where and

A1

slide-64
SLIDE 64

Unordered systems of linear equations

As a relational structure over a fixed domain D:

I J

1 1 1 1 1 1 1 1 1 1 1 1 1

t = A x b = I J

) Ad ✓ I ⇥ J

d bd ✓ I

⇥ ! S = (I, J; (Ad)d∈D, (bd)d∈D)

where and

A1

slide-65
SLIDE 65

Unordered systems of linear equations

As a relational structure over a fixed domain D:

I J

1 1 1 1 1 1 1 1 1 1 1 1 1

In this talk: Focus on I = J

t = A x b = I J

) Ad ✓ I ⇥ J

d bd ✓ I

⇥ ! S = (I, J; (Ad)d∈D, (bd)d∈D)

where and

A1

slide-66
SLIDE 66

FPC — more non-definability results

Solvability of systems of linear equations over any fixed finite Abelian group is not definable in FPC.

Atserias, Bulatov and Dawar (2007)

slide-67
SLIDE 67

FPC — more non-definability results

Corollary Solvability of systems of linear equations over any fixed finite field is not definable in FPC.

Atserias, Bulatov and Dawar (2007)

slide-68
SLIDE 68

FPC — more non-definability results

Corollary Solvability of systems of linear equations over any fixed finite field is not definable in FPC. Recall: A linear system Ax = b over a field k is solvable if and only if the matrices A and (A|b) have the same rank

  • ver k

Atserias, Bulatov and Dawar (2007)

slide-69
SLIDE 69

FPC — more non-definability results

Corollary Solvability of systems of linear equations over any fixed finite field is not definable in FPC. Recall: A linear system Ax = b over a field k is solvable if and only if the matrices A and (A|b) have the same rank

  • ver k

Atserias, Bulatov and Dawar (2007)

Corollary Matrix rank over finite fields is not definable in FPC.

slide-70
SLIDE 70

Which matrix properties can be defined in FPC?

slide-71
SLIDE 71

Which matrix properties can be defined in FPC?

1. Characteristic polynomial and determinant of a square matrix over Z, Q and any finite field.

Dawar, H., Grohe, Laubner (2009)

slide-72
SLIDE 72

Which matrix properties can be defined in FPC?

1. Characteristic polynomial and determinant of a square matrix over Z, Q and any finite field. 2. The inverse to any invertible square matrix over Z, Q and any finite field.

Dawar, H., Grohe, Laubner (2009)

slide-73
SLIDE 73

Which matrix properties can be defined in FPC?

1. Characteristic polynomial and determinant of a square matrix over Z, Q and any finite field. 2. The inverse to any invertible square matrix over Z, Q and any finite field. 3. Rank of a matrix over Q.

Dawar, H., Grohe, Laubner (2009)

slide-74
SLIDE 74

Which matrix properties can be defined in FPC?

1. Characteristic polynomial and determinant of a square matrix over Z, Q and any finite field. 2. The inverse to any invertible square matrix over Z, Q and any finite field. 3. Rank of a matrix over Q. 4. Minimal polynomial of a square matrix over Q and any finite field.

Dawar, H., Grohe, Laubner (2009) H.-Pakusa (2010)

slide-75
SLIDE 75

Which matrix properties can be defined in FPC?

1. Characteristic polynomial and determinant of a square matrix over Z, Q and any finite field. 2. The inverse to any invertible square matrix over Z, Q and any finite field. 3. Rank of a matrix over Q. 4. Minimal polynomial of a square matrix over Q and any finite field.

Dawar, H., Grohe, Laubner (2009)

Fundamental linear-algebraic property over fields that separates FPC from PTIME: rank over finite fields

H.-Pakusa (2010)

slide-76
SLIDE 76

Which matrix properties can be defined in FPC?

1. Characteristic polynomial and determinant of a square matrix over Z, Q and any finite field. 2. The inverse to any invertible square matrix over Z, Q and any finite field. 3. Rank of a matrix over Q. 4. Minimal polynomial of a square matrix over Q and any finite field.

Dawar, H., Grohe, Laubner (2009)

Fundamental linear-algebraic property over fields that separates FPC from PTIME: rank over finite fields

H.-Pakusa (2010)

(Next talk: solvability problems over groups and rings)

slide-77
SLIDE 77

Next step: extend fixed-point logic with ability to define matrix rank

slide-78
SLIDE 78

Definable matrix relations

Recall: View any A in I x I as a matrix over GF(2).

) A ✓ I ⇥ I

slide-79
SLIDE 79

Definable matrix relations

ϕ(x, y)

formula graph G = (V, E)

Recall: View any A in I x I as a matrix over GF(2).

) A ✓ I ⇥ I

slide-80
SLIDE 80

Definable matrix relations

V V

ϕ(x, y)

formula graph G = (V, E)

) MG

ϕ : (over GF(2))

Recall: View any A in I x I as a matrix over GF(2).

) A ✓ I ⇥ I

slide-81
SLIDE 81

Definable matrix relations

V V

ϕ(x, y)

formula graph G = (V, E)

) MG

ϕ : (over GF(2))

u v

Recall: View any A in I x I as a matrix over GF(2).

) A ✓ I ⇥ I

slide-82
SLIDE 82

Definable matrix relations

V V

(u, v) 7! ( 1 if G | = ϕ[u, v],

  • therwise.

ϕ(x, y)

formula graph G = (V, E)

) MG

ϕ : (over GF(2))

u v

Recall: View any A in I x I as a matrix over GF(2).

) A ✓ I ⇥ I

slide-83
SLIDE 83

Definable matrix relations

V V

(u, v) 7! ( 1 if G | = ϕ[u, v],

  • therwise.

ϕ(x, y)

formula graph G = (V, E)

) MG

ϕ : (over GF(2))

u v

Example:

) MG

ϕ = adjacency matrix of G

I ϕ(x, y) := E(x, y)

Recall: View any A in I x I as a matrix over GF(2).

) A ✓ I ⇥ I

slide-84
SLIDE 84

Definable matrix relations

V V

(u, v) 7! ( 1 if G | = ϕ[u, v],

  • therwise.

ϕ(x, y)

formula graph G = (V, E)

) MG

ϕ : (over GF(2))

u v

Example:

) MG

ϕ = adjacency matrix of G

I ϕ(x, y) := E(x, y)

More generally: formalise matrices over GF(p), p prime Recall: View any A in I x I as a matrix over GF(2).

) A ✓ I ⇥ I

slide-85
SLIDE 85

Fixed-point logic with rank operators

Variables are typed:

1 2 3 4 5 6 7 ...

N

G = (V, E)

slide-86
SLIDE 86

Fixed-point logic with rank operators

Variables are typed:

1 2 3 4 5 6 7 ...

N

G = (V, E)

vertex variables: range

  • ver the vertices V
slide-87
SLIDE 87

Fixed-point logic with rank operators

Variables are typed:

1 2 3 4 5 6 7 ...

N

G = (V, E)

vertex variables: range

  • ver the vertices V

number variables: range over N

slide-88
SLIDE 88

Fixed-point logic with rank operators

Variables are typed:

1 2 3 4 5 6 7 ...

N

G = (V, E)

vertex variables: range

  • ver the vertices V

number variables: range over N

  • Bounded quantification over number sort
slide-89
SLIDE 89

Fixed-point logic with rank operators

Variables are typed:

1 2 3 4 5 6 7 ...

N

G = (V, E)

  • Extend FP with rules for rank terms: rkp(x, y).ϕ

(p prime)

vertex variables: range

  • ver the vertices V

number variables: range over N

  • Bounded quantification over number sort
slide-90
SLIDE 90

Fixed-point logic with rank operators

Variables are typed:

1 2 3 4 5 6 7 ...

N

G = (V, E)

  • Extend FP with rules for rank terms: rkp(x, y).ϕ

(p prime)

Semantics: over GF(p)

(rkp(x, y).ϕ)G := rank(MG

ϕ )

vertex variables: range

  • ver the vertices V

number variables: range over N

  • Bounded quantification over number sort
slide-91
SLIDE 91

Fixed-point logic with rank operators

Variables are typed:

1 2 3 4 5 6 7 ...

N

G = (V, E)

  • Extend FP with rules for rank terms: rkp(x, y).ϕ

(p prime)

Semantics: over GF(p)

(rkp(x, y).ϕ)G := rank(MG

ϕ )

Logics FPRp, FPR and similarly FORp, FOR

vertex variables: range

  • ver the vertices V

number variables: range over N

  • Bounded quantification over number sort
slide-92
SLIDE 92

Expressive power of rank logics

For any prime p, FPRp can express solvability of linear equations over GF(p).

Dawar, Grohe, H., Laubner (2009)

slide-93
SLIDE 93

Expressive power of rank logics

For any prime p, FPRp can express solvability of linear equations over GF(pm) for any m.

  • H. (2010)
slide-94
SLIDE 94

Expressive power of rank logics

For any prime p, FPRp can express solvability of linear equations over GF(pm) for any m.

t

=

  • ver GF(pm)
  • H. (2010)
slide-95
SLIDE 95

Expressive power of rank logics

For any prime p, FPRp can express solvability of linear equations over GF(pm) for any m.

t

=

  • ver GF(pm)
  • H. (2010)

Represent each element of GF(pm) as an m-by-m matrix over GF(p)

slide-96
SLIDE 96

Expressive power of rank logics

For any prime p, FPRp can express solvability of linear equations over GF(pm) for any m.

t

=

  • ver GF(pm)

equivalent system over GF(p)

t

=

  • H. (2010)

Represent each element of GF(pm) as an m-by-m matrix over GF(p)

slide-97
SLIDE 97

Expressive power of rank logics

For any prime p, FPRp can express solvability of linear equations over GF(pm) for any m.

t

=

  • ver GF(pm)

equivalent system over GF(p)

t

=

Corollary For any prime p, FPC ⊊ FPRp ⊆ PTIME.

  • H. (2010)

Represent each element of GF(pm) as an m-by-m matrix over GF(p)

slide-98
SLIDE 98

Expressive power of rank logics

For any prime p, FPRp can express solvability of linear equations over GF(pm) for any m.

t

=

  • ver GF(pm)

equivalent system over GF(p)

t

=

Corollary For any prime p, FPC ⊊ FPRp ⊆ PTIME.

(we can simulate counting by expressing rank of diagonal matrices)

  • H. (2010)

Represent each element of GF(pm) as an m-by-m matrix over GF(p)

slide-99
SLIDE 99

CFI graphs revisited

Non-isomorphic CFI graphs can be distinguished by a sentence of FOR2.

Dawar, Grohe, H., Laubner (2009)

slide-100
SLIDE 100

CFI graphs revisited

Non-isomorphic CFI graphs can be distinguished by a sentence of FOR2.

Dawar, Grohe, H., Laubner (2009)

Recall: FPC does not capture PTIME on graphs of bounded colour-class size not even size 4

slide-101
SLIDE 101

CFI graphs revisited

Non-isomorphic CFI graphs can be distinguished by a sentence of FOR2.

Dawar, Grohe, H., Laubner (2009)

Isomorphism of graphs of colour class size 4 can be expressed in FOR2.

Dawar, H. (2011)

Recall: FPC does not capture PTIME on graphs of bounded colour-class size not even size 4

slide-102
SLIDE 102

Pebble games for rank logics & the Weisfeiler-Lehman method

slide-103
SLIDE 103

Proving non-definability in FPRp

Recall: Proofs of inexpressibility in FPC are generally formulated using a game method.

slide-104
SLIDE 104

Proving non-definability in FPRp

Recall: Proofs of inexpressibility in FPC are generally formulated using a game method. Our wish list:

slide-105
SLIDE 105

Proving non-definability in FPRp

Recall: Proofs of inexpressibility in FPC are generally formulated using a game method. Our wish list: A pebble game for finite-variable rank logics for which...

slide-106
SLIDE 106

Proving non-definability in FPRp

Recall: Proofs of inexpressibility in FPC are generally formulated using a game method. Our wish list: A pebble game for finite-variable rank logics for which...

  • 1. we can decide who wins the game in

polynomial time, and

slide-107
SLIDE 107

Proving non-definability in FPRp

Recall: Proofs of inexpressibility in FPC are generally formulated using a game method. Our wish list: A pebble game for finite-variable rank logics for which...

  • 1. we can decide who wins the game in

polynomial time, and

  • 2. there is a corresponding “stable colouring

algorithm”, like for the counting game on graphs.

slide-108
SLIDE 108

Proving non-definability in FPRp

Recall: Proofs of inexpressibility in FPC are generally formulated using a game method. Our wish list: A pebble game for finite-variable rank logics for which...

  • 1. we can decide who wins the game in

polynomial time, and

  • 2. there is a corresponding “stable colouring

algorithm”, like for the counting game on graphs.

matrix-rank game

slide-109
SLIDE 109

Proving non-definability in FPRp

Recall: Proofs of inexpressibility in FPC are generally formulated using a game method. Our wish list: A pebble game for finite-variable rank logics for which...

  • 1. we can decide who wins the game in

polynomial time, and

  • 2. there is a corresponding “stable colouring

algorithm”, like for the counting game on graphs.

matrix-rank game invertible- map game

slide-110
SLIDE 110

Proving non-definability in FPRp

first-order logic with variables x1, ..., xk and rank quantifiers of the form — [ rk≥i

p (x, y) . (')

[ Rk

p

slide-111
SLIDE 111

Proving non-definability in FPRp

first-order logic with variables x1, ..., xk and rank quantifiers of the form — [ rk≥i

p (x, y) . (')

[ Rk

p

  • 1. Every formula of FPRp is invariant under -

equivalence, for some k.

[ Rk

p

slide-112
SLIDE 112

Proving non-definability in FPRp

first-order logic with variables x1, ..., xk and rank quantifiers of the form — [ rk≥i

p (x, y) . (')

[ Rk

p

  • 2. -equivalence can be characterised by a k-pebble

matrix-rank game (over GF(p))

[ Rk

p

  • 1. Every formula of FPRp is invariant under -

equivalence, for some k.

[ Rk

p

slide-113
SLIDE 113

Proving non-definability in FPRp

first-order logic with variables x1, ..., xk and rank quantifiers of the form —

G and H agree on all sentences of k-variable rank logic over GF(p) Duplicator has a winning strategy in the k-pebble matrix- rank game on G and H iff

[ rk≥i

p (x, y) . (')

[ Rk

p

  • 2. -equivalence can be characterised by a k-pebble

matrix-rank game (over GF(p))

[ Rk

p

  • 1. Every formula of FPRp is invariant under -

equivalence, for some k.

[ Rk

p

slide-114
SLIDE 114

Matrix-rank game over GF(p)

slide-115
SLIDE 115

Matrix-rank game over GF(p)

Game played on finite graphs G and H

slide-116
SLIDE 116

Matrix-rank game over GF(p)

Game played on finite graphs G and H

  • Protocol based on partitioning each game board

into disjoint {0,1}-matrices (“partition matrices”).

slide-117
SLIDE 117

Matrix-rank game over GF(p)

Game played on finite graphs G and H

  • Protocol based on partitioning each game board

into disjoint {0,1}-matrices (“partition matrices”).

  • Algebraic game rules: At each round, Duplicator

has to ensure that every linear combination of partition matrices over G has the same GF(p)-rank as the corresponding linear combination over H.

slide-118
SLIDE 118

Matrix-rank game over GF(p)

Game played on finite graphs G and H

  • Protocol based on partitioning each game board

into disjoint {0,1}-matrices (“partition matrices”).

  • Algebraic game rules: At each round, Duplicator

has to ensure that every linear combination of partition matrices over G has the same GF(p)-rank as the corresponding linear combination over H.

Problem: Not known if we can decide in polynomial time which player wins the game.

slide-119
SLIDE 119

Matrix-rank game over GF(p)

Game played on finite graphs G and H

  • Protocol based on partitioning each game board

into disjoint {0,1}-matrices (“partition matrices”).

  • Algebraic game rules: At each round, Duplicator

has to ensure that every linear combination of partition matrices over G has the same GF(p)-rank as the corresponding linear combination over H.

Problem: Not known if we can decide in polynomial time which player wins the game.

slide-120
SLIDE 120

Strengthening the game rules

Two tuples (A1, A2, ..., Am) and (B1, B2, ..., Bm) of n-by-n matrices over a field k are simultaneously similar if there is an invertible S such that S Ai S-1 = Bi for all i.

slide-121
SLIDE 121

Strengthening the game rules

Two tuples (A1, A2, ..., Am) and (B1, B2, ..., Bm) of n-by-n matrices over a field k are simultaneously similar if there is an invertible S such that S Ai S-1 = Bi for all i. There is a deterministic algorithm that, given two m- tuples A and B of n-by-n matrices over a finite field GF(q), determines in time poly(n, m, q) whether A and B are simultaneously similar.

Chistov, Karpinsky and Ivanyov (1997)

slide-122
SLIDE 122

Game based on invertible linear maps

Invertible-map game on G and H over GF(p):

  • Protocol based on partitioning each game board into

disjoint {0,1}-matrices (“partition matrices”).

slide-123
SLIDE 123

Game based on invertible linear maps

Invertible-map game on G and H over GF(p):

  • Protocol based on partitioning each game board into

disjoint {0,1}-matrices (“partition matrices”).

  • New game rule: At each round, Duplicator has to

ensure that the two tuples of partition matrices (over G and H) are simultaneously similar over GF(p).

slide-124
SLIDE 124

Game based on invertible linear maps

Invertible-map game on G and H over GF(p):

  • Protocol based on partitioning each game board into

disjoint {0,1}-matrices (“partition matrices”).

  • New game rule: At each round, Duplicator has to

ensure that the two tuples of partition matrices (over G and H) are simultaneously similar over GF(p). Facts:

slide-125
SLIDE 125

Game based on invertible linear maps

Invertible-map game on G and H over GF(p):

  • Protocol based on partitioning each game board into

disjoint {0,1}-matrices (“partition matrices”).

  • New game rule: At each round, Duplicator has to

ensure that the two tuples of partition matrices (over G and H) are simultaneously similar over GF(p). Facts:

  • We can decide who wins this game in PTIME.
slide-126
SLIDE 126

Game based on invertible linear maps

Invertible-map game on G and H over GF(p):

  • Protocol based on partitioning each game board into

disjoint {0,1}-matrices (“partition matrices”).

  • New game rule: At each round, Duplicator has to

ensure that the two tuples of partition matrices (over G and H) are simultaneously similar over GF(p). Facts:

  • We can decide who wins this game in PTIME.
  • Refines -equivalence: If Duplicator wins the k-

pebble invertible-map game on G and H then she also wins the k-pebble matrix rank game on G and H.

[ Rk

p

slide-127
SLIDE 127

Connection with stable colouring

Recall: Our wish list: A pebble game for finite-variable rank logics for which...

  • 1. we can decide who wins the game in

polynomial time, and

  • 2. there is a corresponding “stable colouring

algorithm”, like for the counting game on graphs.

matrix-rank game invertible- map game

slide-128
SLIDE 128

Weisfeiler-Lehman refinement

Input: Graph G = (V, E) Output: Equivalence relation on V.

C ≈

u u1 u2 u3 v v1 v2 v3

slide-129
SLIDE 129

Weisfeiler-Lehman refinement

Input: Graph G = (V, E) Output: Equivalence relation on V.

C ≈

“colour refinement”

  • r “stable colouring”

u u1 u2 u3 v v1 v2 v3

slide-130
SLIDE 130

Weisfeiler-Lehman refinement

Input: Graph G = (V, E) Output: Equivalence relation on V.

C ≈

“colour refinement”

  • r “stable colouring”

d ⇠0 ◆ ⇠1 ◆ . . . ◆ ⇠m = ⇠m+1 =: ⇡

Inductively define:

u u1 u2 u3 v v1 v2 v3

slide-131
SLIDE 131

Weisfeiler-Lehman refinement

Input: Graph G = (V, E) Output: Equivalence relation on V.

C ≈

“colour refinement”

  • r “stable colouring”

Initial:

u ∼0 v

∼ ⊇ ∼ ⊇ ⊇ ∼ v deg(u) = deg(v)

iff

d ⇠0 ◆ ⇠1 ◆ . . . ◆ ⇠m = ⇠m+1 =: ⇡

Inductively define:

u u1 u2 u3 v v1 v2 v3

slide-132
SLIDE 132

Weisfeiler-Lehman refinement

Input: Graph G = (V, E) Output: Equivalence relation on V.

C ≈

“colour refinement”

  • r “stable colouring”

Initial:

u ∼0 v

∼ ⊇ ∼ ⊇ ⊇ ∼ v deg(u) = deg(v)

iff

d ⇠0 ◆ ⇠1 ◆ . . . ◆ ⇠m = ⇠m+1 =: ⇡

Inductively define:

u u1 u2 u3 v v1 v2 v3

3 2 1 1 1 1 3 3 2 1 1 1 2

slide-133
SLIDE 133

Weisfeiler-Lehman refinement

Input: Graph G = (V, E) Output: Equivalence relation on V.

C ≈

“colour refinement”

  • r “stable colouring”

Initial:

u ∼0 v

∼ ⊇ ∼ ⊇ ⊇ ∼ v deg(u) = deg(v)

iff Refine: iff

⇡ ⇠ ◆ ⇠ ◆ ◆ ⇠ kN(u) \ αk = kN(v) \ αk

and for all α 2 V/ ⇠i:

u ⇠i+1 v u ⇠i v

d ⇠0 ◆ ⇠1 ◆ . . . ◆ ⇠m = ⇠m+1 =: ⇡

Inductively define:

u u1 u2 u3 v v1 v2 v3

3 2 1 1 1 1 3 3 2 1 1 1 2

slide-134
SLIDE 134

Weisfeiler-Lehman refinement

Input: Graph G = (V, E) Output: Equivalence relation on V.

C ≈

“colour refinement”

  • r “stable colouring”

Initial:

u ∼0 v

∼ ⊇ ∼ ⊇ ⊇ ∼ v deg(u) = deg(v)

iff Refine: iff

⇡ ⇠ ◆ ⇠ ◆ ◆ ⇠ kN(u) \ αk = kN(v) \ αk

and for all α 2 V/ ⇠i:

u ⇠i+1 v u ⇠i v

d ⇠0 ◆ ⇠1 ◆ . . . ◆ ⇠m = ⇠m+1 =: ⇡

Inductively define:

u u1 u2 u3 v v1 v2 v3

3 2 1 1 1 1 3 3 2 1 1 1 2

⇠ ↵ = {w | deg(w) = 2}

slide-135
SLIDE 135

Weisfeiler-Lehman refinement

Input: Graph G = (V, E) Output: Equivalence relation on V.

C ≈

“colour refinement”

  • r “stable colouring”

Initial:

u ∼0 v

∼ ⊇ ∼ ⊇ ⊇ ∼ v deg(u) = deg(v)

iff Refine: iff

⇡ ⇠ ◆ ⇠ ◆ ◆ ⇠ kN(u) \ αk = kN(v) \ αk

and for all α 2 V/ ⇠i:

u ⇠i+1 v u ⇠i v

d ⇠0 ◆ ⇠1 ◆ . . . ◆ ⇠m = ⇠m+1 =: ⇡

Inductively define:

u u1 u2 u3 v v1 v2 v3

3 2 1 1 1 1 3 3 2 1 1 1 2

⇠ ↵ = {w | deg(w) = 2}

slide-136
SLIDE 136

Weisfeiler-Lehman algorithm for GI

Input: Graphs G = (VG, EG) and H = (VH, EH) Output: “isomorphic” or “not isomorphic”

slide-137
SLIDE 137

Weisfeiler-Lehman algorithm for GI

Input: Graphs G = (VG, EG) and H = (VH, EH) Output: “isomorphic” or “not isomorphic”

  • 1. Compute the WL refinement on
  • 2. Output “not isomorphic” if there is some

such that ; else “isomorphic”.

G ˙ [ H ⇠ ↵ 2 G ˙ [ H/ ⇡ s.t. k↵ \ VGk 6= k↵ \ VHk

C ≈

slide-138
SLIDE 138

Weisfeiler-Lehman algorithm for GI

Input: Graphs G = (VG, EG) and H = (VH, EH) Output: “isomorphic” or “not isomorphic”

  • 1. Compute the WL refinement on
  • 2. Output “not isomorphic” if there is some

such that ; else “isomorphic”.

G ˙ [ H ⇠ ↵ 2 G ˙ [ H/ ⇡ s.t. k↵ \ VGk 6= k↵ \ VHk

C ≈

Some facts:

slide-139
SLIDE 139

Weisfeiler-Lehman algorithm for GI

Input: Graphs G = (VG, EG) and H = (VH, EH) Output: “isomorphic” or “not isomorphic”

  • 1. Compute the WL refinement on
  • 2. Output “not isomorphic” if there is some

such that ; else “isomorphic”.

G ˙ [ H ⇠ ↵ 2 G ˙ [ H/ ⇡ s.t. k↵ \ VGk 6= k↵ \ VHk

C ≈

Some facts:

  • 1. WL runs in time O(n2 log(n))
slide-140
SLIDE 140

Weisfeiler-Lehman algorithm for GI

Input: Graphs G = (VG, EG) and H = (VH, EH) Output: “isomorphic” or “not isomorphic”

  • 1. Compute the WL refinement on
  • 2. Output “not isomorphic” if there is some

such that ; else “isomorphic”.

G ˙ [ H ⇠ ↵ 2 G ˙ [ H/ ⇡ s.t. k↵ \ VGk 6= k↵ \ VHk

C ≈

Some facts:

  • 1. WL runs in time O(n2 log(n))
  • 2. WL is correct almost surely
  • Babai, Erdös and Selkow (1980)
slide-141
SLIDE 141

Weisfeiler-Lehman algorithm for GI

Input: Graphs G = (VG, EG) and H = (VH, EH) Output: “isomorphic” or “not isomorphic”

  • 1. Compute the WL refinement on
  • 2. Output “not isomorphic” if there is some

such that ; else “isomorphic”.

G ˙ [ H ⇠ ↵ 2 G ˙ [ H/ ⇡ s.t. k↵ \ VGk 6= k↵ \ VHk

C ≈

Some facts:

  • 1. WL runs in time O(n2 log(n))
  • 2. WL is correct almost surely
  • Babai, Erdös and Selkow (1980)
  • 3. WL fails on non-isomorphic regular graphs
slide-142
SLIDE 142

k-dimensional WL* refinement

One-element extensions in G = (V, E) For , a k-tuple and , let:

[ ↵ ✓ V k

[ ~ u 2 V k

k 0  i < k

Γi(~ u, ↵) := {w 2 V | ~ u w

i 2 ↵}

˙

slide-143
SLIDE 143

k-dimensional WL* refinement

One-element extensions in G = (V, E) For , a k-tuple and , let:

[ ↵ ✓ V k

[ ~ u 2 V k

k 0  i < k

Γi(~ u, ↵) := {w 2 V | ~ u w

i 2 ↵}

˙

u a v b w

Example: Let k = 3 and

2  ↵ := {(x, y, z) 2 V 3 | (x, y, z) = }

slide-144
SLIDE 144

k-dimensional WL* refinement

One-element extensions in G = (V, E) For , a k-tuple and , let:

[ ↵ ✓ V k

[ ~ u 2 V k

k 0  i < k

Γi(~ u, ↵) := {w 2 V | ~ u w

i 2 ↵}

˙

u a v b w

Example: Let k = 3 and

2  ↵ := {(x, y, z) 2 V 3 | (x, y, z) = }

{ 2 Γ0(uvw, ↵) = {a, b} Γ1(uvw, ↵) = ;

slide-145
SLIDE 145

k-dimensional WL* refinement

Input: Graph G = (V, E) Output: Equivalence relation on Vk.

C ≈

slide-146
SLIDE 146

k-dimensional WL* refinement

Input: Graph G = (V, E) Output: Equivalence relation on Vk.

C ≈

Initial: iff

atpG(~ u) = atpG(~ v)

G

~ u ⇠0 ~ v

slide-147
SLIDE 147

k-dimensional WL* refinement

Input: Graph G = (V, E) Output: Equivalence relation on Vk.

C ≈

Initial: iff

atpG(~ u) = atpG(~ v)

G

~ u ⇠0 ~ v

Refine: iff and for all

k 0  i < k

for all there is a bijection

2 ⇠ f : V ! V s.t. ! f : Γi(~ u, ↵) 7! Γi(~ v, ↵)

⇠ ↵ 2 V k/ ⇠m

⇠ ~ u ⇠m+1 ~ v

⇠ ~ u ⇠m ~ v

slide-148
SLIDE 148

k-dimensional WL* refinement

Input: Graph G = (V, E) Output: Equivalence relation on Vk.

C ≈

Initial: iff

atpG(~ u) = atpG(~ v)

G

~ u ⇠0 ~ v

Γi(~ u, ↵) := {w 2 V | ~ u w

i 2 ↵}

˙

Refine: iff and for all

k 0  i < k

for all there is a bijection

2 ⇠ f : V ! V s.t. ! f : Γi(~ u, ↵) 7! Γi(~ v, ↵)

⇠ ↵ 2 V k/ ⇠m

⇠ ~ u ⇠m+1 ~ v

⇠ ~ u ⇠m ~ v

slide-149
SLIDE 149

k-dimensional WL* refinement

Input: Graph G = (V, E) Output: Equivalence relation on Vk.

C ≈

Initial: iff

atpG(~ u) = atpG(~ v)

G

~ u ⇠0 ~ v

Theorem: iff they agree on all Ck-formulas in G.

~ u ⇡ ~ v

Γi(~ u, ↵) := {w 2 V | ~ u w

i 2 ↵}

˙

Refine: iff and for all

k 0  i < k

for all there is a bijection

2 ⇠ f : V ! V s.t. ! f : Γi(~ u, ↵) 7! Γi(~ v, ↵)

⇠ ↵ 2 V k/ ⇠m

⇠ ~ u ⇠m+1 ~ v

⇠ ~ u ⇠m ~ v

slide-150
SLIDE 150

k-dimensional WL* algorithm for GI

As before: compute k-dimensional WL* refinement and compare across the two graphs. PTIME for fixed k: k-dim WL* runs in time O(nk+1 log(n)).

slide-151
SLIDE 151

k-dimensional WL* algorithm for GI

As before: compute k-dimensional WL* refinement and compare across the two graphs. PTIME for fixed k: k-dim WL* runs in time O(nk+1 log(n)). There exists a sequence of pairs {(Gn, Hn)}n of non- isomorphic graphs for which it holds that:

  • Gn and Hn have O(n) vertices but
  • Gn and Hn are not distinguished by the n-dim WL*

algorithm.

Cai, Fürer and Immerman (1992)

slide-152
SLIDE 152

Refinement by invertible linear maps

Two-element extensions in G = (V, E) For , a k-tuple and , let:

[ ↵ ✓ V k

[ ~ u 2 V k

2 [ ⇡ k \ k 6 k \ k Γij(~ u, ↵) := {(a, b) 2 V ⇥ V | ~ u a

i b j 2 ↵} ✓ V ⇥ V

˙

k 0  i 6= j < k

slide-153
SLIDE 153

Refinement by invertible linear maps

Two-element extensions in G = (V, E) For , a k-tuple and , let:

[ ↵ ✓ V k

[ ~ u 2 V k

2 [ ⇡ k \ k 6 k \ k Γij(~ u, ↵) := {(a, b) 2 V ⇥ V | ~ u a

i b j 2 ↵} ✓ V ⇥ V

˙

{0,1}-matrix

k 0  i 6= j < k

slide-154
SLIDE 154

Refinement by invertible linear maps

Two-element extensions in G = (V, E) For , a k-tuple and , let:

[ ↵ ✓ V k

[ ~ u 2 V k

2 [ ⇡ k \ k 6 k \ k Γij(~ u, ↵) := {(a, b) 2 V ⇥ V | ~ u a

i b j 2 ↵} ✓ V ⇥ V

˙

{0,1}-matrix

Example: Let k = 3 and

2  ↵ := {(x, y, z) 2 V 3 | (x, y, z) = }

u a v b w c d e

k 0  i 6= j < k

slide-155
SLIDE 155

Refinement by invertible linear maps

Two-element extensions in G = (V, E) For , a k-tuple and , let:

[ ↵ ✓ V k

[ ~ u 2 V k

2 [ ⇡ k \ k 6 k \ k Γij(~ u, ↵) := {(a, b) 2 V ⇥ V | ~ u a

i b j 2 ↵} ✓ V ⇥ V

˙

{0,1}-matrix

Example: Let k = 3 and

2  ↵ := {(x, y, z) 2 V 3 | (x, y, z) = }

u a v b w c d e

⇡ Γ12:

u v w a b c d e u v w a b c d e 1 1 1 1 1 1 1 1

k 0  i 6= j < k

slide-156
SLIDE 156

k-dimensional IM refinement over GF(p)

Input: Graph G = (V, E) Output: Equivalence relation on Vk.

C ≈

slide-157
SLIDE 157

k-dimensional IM refinement over GF(p)

Input: Graph G = (V, E) Output: Equivalence relation on Vk.

C ≈

Initial: iff

atpG(~ u) = atpG(~ v)

G

~ u ⇠0 ~ v

slide-158
SLIDE 158

k-dimensional IM refinement over GF(p)

Input: Graph G = (V, E) Output: Equivalence relation on Vk.

C ≈

Initial: iff

atpG(~ u) = atpG(~ v)

G

~ u ⇠0 ~ v

Refine: iff and for all for all there is s.t.

k 0  i 6= j < k

S 2 GLV (GF(p))

2 S · Γij(~ u, ↵) · S−1 = Γij(~ v, ↵)

⇠ ↵ 2 V k/ ⇠m

⇠ ~ u ⇠m+1 ~ v

⇠ ~ u ⇠m ~ v

slide-159
SLIDE 159

k-dimensional IMp algorithm for GI

Similar to WL: compute k-dimensional IM refinement and compare across the two graphs (here over GF(p))

slide-160
SLIDE 160

k-dimensional IMp algorithm for GI

Similar to WL: compute k-dimensional IM refinement and compare across the two graphs (here over GF(p))

  • For each k, k-dim IMp runs in polynomial time for all p.
  • Refinement: k-dim WL* (k+1)-dim IMp (k+2)-dim IMp

◆ ◆

slide-161
SLIDE 161

k-dimensional IMp algorithm for GI

Similar to WL: compute k-dimensional IM refinement and compare across the two graphs (here over GF(p)) For each k and prime p, there is a pair of non-isomorphic graphs that can be distinguished by 3-dim IMp but not by k-dim WL*.

Dawar and H. (2012)

  • For each k, k-dim IMp runs in polynomial time for all p.
  • Refinement: k-dim WL* (k+1)-dim IMp (k+2)-dim IMp

◆ ◆

slide-162
SLIDE 162

k-dimensional IMp algorithm for GI

Similar to WL: compute k-dimensional IM refinement and compare across the two graphs (here over GF(p)) For each k and prime p, there is a pair of non-isomorphic graphs that can be distinguished by 3-dim IMp but not by k-dim WL*.

Dawar and H. (2012)

  • For each k, k-dim IMp runs in polynomial time for all p.
  • Refinement: k-dim WL* (k+1)-dim IMp (k+2)-dim IMp

◆ ◆ For each k and distinct primes p and q, there is a pair of non-isomorphic graphs that can be distinguished by 3- dim IMp but not by k-dim IMq.

  • H. (2010)
slide-163
SLIDE 163

k-dimensional IMp more generally

Consider the invertible-map algorithm for larger matrices (higher arity) and finite sets of primes. Can we give instances where the general algorithm fails to express graph isomorphism?

slide-164
SLIDE 164

Some open problems

slide-165
SLIDE 165

Problem 1: Separate FORp and FORq

  • ver empty signatures

For formula , integer n and prime p, let denote the GF(p)-rank of the matrix defined by

  • ver an n-element set.

ϕ(x, y) ϕ(x, y)

C rp

ϕ(n)

slide-166
SLIDE 166

Problem 1: Separate FORp and FORq

  • ver empty signatures

For formula , integer n and prime p, let denote the GF(p)-rank of the matrix defined by

  • ver an n-element set.

ϕ(x, y) ϕ(x, y)

C rp

ϕ(n)

Polynomial-rank conjecture For each and each prime p, there are unary polynomials f0, ..., fp-1 such that for all (sufficiently large) n congruent to i modulo p.

ϕ(x, y)

C rp

ϕ(n) = fi(n)

slide-167
SLIDE 167

Problem 1: Separate FORp and FORq

  • ver empty signatures

For formula , integer n and prime p, let denote the GF(p)-rank of the matrix defined by

  • ver an n-element set.

ϕ(x, y) ϕ(x, y)

C rp

ϕ(n)

Polynomial-rank conjecture For each and each prime p, there are unary polynomials f0, ..., fp-1 such that for all (sufficiently large) n congruent to i modulo p.

ϕ(x, y)

C rp

ϕ(n) = fi(n)

True for:

(x1, x2)

  • H. and Laubner (2010)

(y1, y2)

slide-168
SLIDE 168

Problem 1: Separate FORp and FORq

  • ver empty signatures

For formula , integer n and prime p, let denote the GF(p)-rank of the matrix defined by

  • ver an n-element set.

ϕ(x, y) ϕ(x, y)

C rp

ϕ(n)

Polynomial-rank conjecture For each and each prime p, there are unary polynomials f0, ..., fp-1 such that for all (sufficiently large) n congruent to i modulo p.

ϕ(x, y)

C rp

ϕ(n) = fi(n)

True for:

(x1, x2) (y1, y2, y2, ..., yn)

  • H. and Laubner (2010)

Kirsten (2012)

slide-169
SLIDE 169

Problem 1: Separate FORp and FORq

  • ver empty signatures

For formula , integer n and prime p, let denote the GF(p)-rank of the matrix defined by

  • ver an n-element set.

ϕ(x, y) ϕ(x, y)

C rp

ϕ(n)

Polynomial-rank conjecture For each and each prime p, there are unary polynomials f0, ..., fp-1 such that for all (sufficiently large) n congruent to i modulo p.

ϕ(x, y)

C rp

ϕ(n) = fi(n)

???

(x1, x2, ..., xn) (y1, y2, y2, ..., yn)

  • H. and Laubner (2010)

Kirsten (2012)

slide-170
SLIDE 170

Problem 2: Give capturing results for FPR on natural classes of graphs

Consider classes on which we know that FPC does not capture PTIME:

  • graphs of bounded degree
  • graphs of bounded colour-class size
slide-171
SLIDE 171

Further questions

  • Can FPR express matching in arbitrary graphs?
  • Does the “simultaneous similarity game” correspond

to a natural logic? More open problems to come in the next talk!