P M 2 1 Ideal Distributed-Memory Parallel Computer P+M P+M - - PDF document

p m 2 1 ideal distributed memory parallel computer p m p
SMART_READER_LITE
LIVE PREVIEW

P M 2 1 Ideal Distributed-Memory Parallel Computer P+M P+M - - PDF document

Hypercubic Networks Charles E. Leiserson 6.895 Theory of Parallel Systems November 2, 2003 1 Ideal Parallel Computer P M P M P M P M 2 1 Ideal Distributed-Memory Parallel Computer P+M P+M P+M P+M P+M P+M


slide-1
SLIDE 1

1

1

Hypercubic Networks

Charles E. Leiserson 6.895 Theory of Parallel Systems

November 2, 2003

2

“Ideal” Parallel Computer

P P P P M M M M

slide-2
SLIDE 2

2

3

“Ideal” Distributed-Memory Parallel Computer

P+M P+M P+M P+M P+M P+M P+M P+M

4

Interconnection Networks

linear array 2D mesh binary tree

slide-3
SLIDE 3

3

5

Hypercube

d = 0 N = 1 d = 1 N = 2 d = 2 N = 4 d = 3 N = 8 d = 4 N = 16

6

Hypercube

010 011 000 001 110 111 100 101

slide-4
SLIDE 4

4

7

Cube-Connected Cycles

8

Butterfly (FFT) Network

1 2 000 001 010 011 100 101 110 111 000 001 010 011 100 101 110 111

slide-5
SLIDE 5

5

9

Butterflies

10

Decomposing a Butterfly

slide-6
SLIDE 6

6

11

Decomposing a Butterfly

12

Decomposing a Butterfly

slide-7
SLIDE 7

7

13

Decomposing a Butterfly

14

Decomposing a Butterfly II

slide-8
SLIDE 8

8

15

Decomposing a Butterfly II

16

Decomposing a Butterfly II

slide-9
SLIDE 9

9

17

Decomposing a Butterfly II

18

Decomposing a Butterfly II

slide-10
SLIDE 10

10

19

Decomposing a Butterfly II

20

Decomposing a Butterfly II

slide-11
SLIDE 11

11

21

Routing on a Butterfly

1 2 000 001 010 011 100 101 110 111 000 001 010 011 100 101 110 111

22

Tree in Butterfly

1 2 000 001 010 011 100 101 110 111 000 001 010 011 100 101 110 111

slide-12
SLIDE 12

12

23

Tree in Butterfly

1 2 000 001 010 011 100 101 110 111 000 001 010 011 100 101 110 111

24

Beneš Network

slide-13
SLIDE 13

13

25

n/2 Beneš n/2 Beneš

Decomposing a Beneš Network

26

Routing on a Beneš Network

1 2 3 4 5 6 7 5 7 4 6 2 3 1

slide-14
SLIDE 14

14

27

Routing on a Beneš Network

1 2 3 4 5 6 7 5 7 4 6 2 3 1

28

Routing on a Beneš Network

1 2 3 4 5 6 7 5 7 4 6 2 3 1

slide-15
SLIDE 15

15

29

Routing on a Beneš Network

1 2 3 4 5 6 7 5 7 4 6 2 3 1

30

Routing on a Beneš Network

1 2 3 4 5 6 7 5 7 4 6 2 3 1

slide-16
SLIDE 16

16

31

Routing on a Beneš Network

1 2 3 4 5 6 7 5 7 4 6 2 3 1

32

Routing on a Beneš Network

1 2 3 4 5 6 7 5 7 4 6 2 3 1

slide-17
SLIDE 17

17

33

Routing on a Beneš Network

1 2 3 4 5 6 7 5 7 4 6 2 3 1

34

Routing on a Beneš Network

1 2 3 4 5 6 7 5 7 4 6 2 3 1

slide-18
SLIDE 18

18

35

Routing on a Beneš Network

5 7 4 6 2 3 1 1 2 3 4 5 6 7