Kolmogorov complexity of 2D sequences Bruno Durand Laboratoire - - PowerPoint PPT Presentation

kolmogorov complexity of 2d sequences
SMART_READER_LITE
LIVE PREVIEW

Kolmogorov complexity of 2D sequences Bruno Durand Laboratoire - - PowerPoint PPT Presentation

Kolmogorov complexity of 2D sequences Bruno Durand Laboratoire dInformatique Fondamentale de Marseille Kolmogorov complexity Goal: to measure the complexity of an individual object (Shannon) theory of information: measures the complexity


slide-1
SLIDE 1

Kolmogorov complexity of 2D sequences

Bruno Durand Laboratoire d’Informatique Fondamentale de Marseille

slide-2
SLIDE 2

Kolmogorov complexity

Goal: to measure the complexity

  • f an individual object

(Shannon) theory of information:

measures the complexity of a random variable

A theory of optimal compression

“the size of the smallest program that generates the object”

slide-3
SLIDE 3

Examples

K(n) < log(n) + c K(2n+17) < log(n) + c K(xy) < log(x) + log(y) + c K(xy|y) < log(x) + c

Strings with low complexity are rare

slide-4
SLIDE 4

Two theorems

The set of prime numbers is infinite If K(x0,x1,…xn|n) < c, then xi is computable

slide-5
SLIDE 5

Exemple of 2D infinite objects

A finitary drawing

slide-6
SLIDE 6

This infinite object is “simple”

nxn squares have log(n) complexity

slide-7
SLIDE 7

Complex infinite objects

Flip a coin for each cell No structure Theorem (Levin Schnorr 1971): random configurations have maximal

  • complexity. The complexity of all their nxn-

squares centered in (0,0) is n2.

slide-8
SLIDE 8

Question of the day

What is the complexity induced by a finite set

  • f local constraints?

Motivations: molecule arrangements, etc. Hilbert’s 18th problem Hilbert das Entscheidungsproblem

slide-9
SLIDE 9

Tile sets

Wang tiles Squares with colored borders Tiles with arrows Arrows and colors Polygons -- rational coordinates Correct arrangement

¸ No irrational coordinates (Penrose)

slide-10
SLIDE 10

Wang tiles

Squares of unit size Colored borders No rotations Finite number Matching colors

slide-11
SLIDE 11

Example - Wang tiles

slide-12
SLIDE 12

Periodic tiling obtained

2x4

slide-13
SLIDE 13

Tiles with arrows

Squares of unit size Arrows on borders Rotations allowed Finite number Arrows must match

slide-14
SLIDE 14

Example - tiles with arrows

slide-15
SLIDE 15

See something and…

slide-16
SLIDE 16

…imagine more

slide-17
SLIDE 17

Polygons -- rational coordinates

Polygon on a grid Polygon simple No rotations Finite number Correct arrangement

slide-18
SLIDE 18

Elementary example

slide-19
SLIDE 19

And also…

slide-20
SLIDE 20

Tiling of a region

The matching constraint must be ok inside the region No constraint on the border Examples:

n Tiling of a rectangle n Tiling of a half-plane n Tiling of the plane

slide-21
SLIDE 21

Simulations

These models are equivalent for tilability of a region. Some theory is needed here (skipped)

slide-22
SLIDE 22

A more general model: Local constraints

Planar configurations of 0’s and 1’s A configuration is a tiling if and only if

  • a local and uniform constraint is

verified

ß Local : neighborhood Uniform : same rule in each cell

slide-23
SLIDE 23

Palettes

A local constraint is a palette if and only if it can tile the plane (L. Levin)

n Idem : Wang tiles n Idem : tiles with arrows n Idem : polygons

slide-24
SLIDE 24

« computation - geometry »

Decision problem : « domino problem »

n Input : a local constraint T n Question : is T a palette ?

This problem is undecidable (Berger 1966)

slide-25
SLIDE 25

Break translational symmetry

Nice configuration (little cheating…)

slide-26
SLIDE 26

Still nicer : a carpet !

slide-27
SLIDE 27

How to build such carpets…

slide-28
SLIDE 28
slide-29
SLIDE 29

How to express that

Carpets can be produced by tilings

  • r

There exists a palette that produces carpets

  • r

In all tilings by a palette, carpets appear

slide-30
SLIDE 30

Tilings enforced by a palette

A set of configurations that is Shift invariant Compact

slide-31
SLIDE 31

What we hope to enforce

Let c be a configuration The set of configurations that contain the same finite patterns than c Id est :

slide-32
SLIDE 32

The carpet is enforceable

Possible proofs:

1.

Give explicitly a palette that enforces it

2.

Give a construction method for such a palette

3.

Prove that such a palette exists

slide-33
SLIDE 33
  • 1. A palette that enforces carpets

More or less…

slide-34
SLIDE 34
  • 2. Construction method:

self-similarity of carpets

Smallest squares are red and form a 2 steps grid Squares of same size are vertically and horizontally aligned In the center of a red square (resp. blue) lays a corner

  • f a blue one (resp. red)

Squares of same color are disjoined

slide-35
SLIDE 35
  • 3. Existence proof

A configuration c is :

  • f finite type if and only if there exists n such that
  • f potentially finite type if and only if it can be

« enriched » into a configuration of finite type.

slide-36
SLIDE 36

Finite types and tilability

A configuration is of potentially finite type if and

  • nly if it is enforced by a tiling.

Theorem: the carpet is of potentially finite type.

Constructive proof (n=2)

slide-37
SLIDE 37
slide-38
SLIDE 38

Question of the day (bis)

Consider all tilings obtained with a considered palette. How complex is the simplest one?

slide-39
SLIDE 39

Theorems

Undecidability of the « domino problem »… Applications in logics. (Berger 1966, Robinson 1971, Gurevich and Koriakov 1972) There exists a palette that produces only non-recursive tilings (Hanf and Myers 1974) Cannot be improved (Albert Muchnik) Complexity bound: Any palette can form at least a tiling in which squares

  • f size n contain at most O(n) bits of information. (BD, Leonid Levin and

Alexander Shen 2001) There exists a palette s.t. for all tiling, any square of size n contains about n bits of information. (same paper - long version in preparation - ready November 2067) Checks that the infinite sequence is complex Extensions to configurations that tolerate tiling errors?

slide-40
SLIDE 40

Complex tilings constructed

Aperiodic tile sets Arecursive tile sets (x,y) Æ T(x,y) Complex tilings:

in all nxn-squares there are n bits of a random sequence (optimal)

slide-41
SLIDE 41

Complexity lemma

An infinite sequence x is uniformly c-random if and only if there exists N such that for all k > N for all i K(xi…xi+k) > ck Lemma: For all c < 1 there exists a uniformly c-random sequence works for bi-infinite sequences - no arbitrary large subsequences of 0’s