[PPT] - I n f o r m a t i o n T r a n s m i s s i o n PowerPoint Presentation

SLIDE 1

I n f

r

m a t i

n

T r a n s m i s s i

n

C h a p t e r 5 , B l

c

k c

d

e s

OVE EDFORS ELECTRICAL AND INFORMATION TECHNOLOGY

SLIDE 2

O v e E d f

r

s E I T A 3

C

h a p t e r 5 ( P a r t 4 ) 2

L e a r n i n g

u

t c

m

e s

A

f t e r t h e l e c t u r e s t h e s t u d e n t s h

u

l d :

– U

n d e r s t a n d a n d b e a b l e t

u

s e m

d

u l

t

w

a

r i t h m e t i c ,

– k

n

w

t h a t a r e c e i v e d w

r

d i s c

m

p

s

e d

f

t h e t r a n s m i t t e d c

d

e w

r

d a n d a n e r r

r

p a t t e r n ,

– k

n

w

w h a t t h e m i n i m u m d i s t a n c e

f

a c

d

e i s a n d h

w

i t r e l a t e d t

e

r r

r

c

r

r e c t i

n

a n d e r r

r

d e t e c t i

n

p r

p

e r t i e s ,

– b

e a b l e t

p

e r f

r

m e n c

d

i n g

f

m e s s a g e s i n t

c
d

e w

r

d s ,

– u

n d e r s t a n d h

w

c

d

e w

r

d s a r e g e n e r a t e d u s i n g a g e n e r a t

r

m a t r i x , a n d

– u

n d e r s t a n d h

w

e r r

r

s c a n b e d e t e c t e d u s i n g a p a r i t y c h e c k m a t r i x .

SLIDE 3

O v e E d f

r

s E I T A 3

C

h a p t e r 5 ( P a r t 4 ) 3

Wh e r e a r e w e i n t h e B I G P I C T U R E ?

Block codes Lecture relates to pages 189-195 in textbook.

SLIDE 4

O v e E d f

r

s E I T A 3

C

h a p t e r 5 ( P a r t 4 ) 4

Me t h

d

s

f

c h a n n e l c

d

i n g

F
r

c h a n n e l c

d

i n g ( e r r

r

c

r

r e c t i

n

) w e h a v e t w

m

a i n c l a s s e s

f

c

d

e s , n a m e l y :

– b

l

c

k c

d

e s , w h i c h w e fi r s t e n c

u

n t e r e d w h e n w e d i s c u s s e d S h a n n

n

' s c h a n n e l c

d

i n g t h e

r

e m

– c

n

v

l

u t i

n

a l c

d

e s . We s h a l l b r i e fl y d i s c u s s b

t

h c l a s s e s .

SLIDE 5

O v e E d f

r

s E I T A 3

C

h a p t e r 5 ( P a r t 4 ) 5

D i g i t a l c h a n n e l – s y m b

l

s i n a n d

u

t

Symbols X as input to channel Symbols Y as

utput from channel

Our code words Our code words, corrupted by the noisy channel

SLIDE 6

O v e E d f

r

s E I T A 3

C

h a p t e r 5 ( P a r t 4 ) 6

Tie b i n a r y fj e l d

For the following calculations we use the binary field, for which the rules of addition and multiplication are those of modulo-two arithmetic: Notice that since 1 + 1 = 0, subtraction is the same as addition, which is very convenient

SLIDE 7

O v e E d f

r

s E I T A 3

C

h a p t e r 5 ( P a r t 4 ) 7

Tie e r r

r

p a t t e r n

Suppose that the codeword is transmitted

ver the binary symmetric channel and that

is the possibly erroneously received version of it, then the error pattern is defined to be the N-tuple that satisfies If we have one error, that is, e consists of one 1 and N - 1 0's, then one component in v is altered. Two errors cause two altered components in v.

SLIDE 8

O v e E d f

r

s E I T A 3

C

h a p t e r 5 ( P a r t 4 ) 8

Mi n i m u m d i s t a n c e

The minimum distance, dmin, of a block code B is the minimum of all distances between two non-identical codewords of the code. If the sum of any two codewords is a codeword, then the code is said to be linear. For a linear block code the minimum distance is simply equal to the least number of 1's in a nonzero codeword In general, a block code with minimum distance dmin will correct up (dmin-1)/2 errors. Alternatively, it can be used to detect up to dmin-1 errors.

SLIDE 9

O v e E d f

r

s E I T A 3

C

h a p t e r 5 ( P a r t 4 ) 9

Tie ( 7 , 4 ) H a m m i n g c

d

e

Hamming constructed a class of single-error-correcting linear block codes with minimum distance dmin = 3. In the table we specify an encoder mapping for the (7,4) Hamming code with M = 24 = 16 code words. This code has rate

SLIDE 10

O v e E d f

r

s E I T A 3

C

h a p t e r 5 ( P a r t 4 ) 1

E x a m p l e

Assume that we would like to transmit the information 4- tuple u = (1011) over a binary symmetric channel. Then we encode it, by using the mapping in the table, and

btain the code word v = (0110011).

Let, for example, the sixth position be altered by the

channel. Thus, we receive r = (0110001).

SLIDE 11

O v e E d f

r

s E I T A 3

C

h a p t e r 5 ( P a r t 4 ) 1 1

E x a m p l e ( c

n

t . )

To correct the error we add position-wise modulo-two rows 2, 3, and 7 (the positions corresponding to the 1's in r) from a given matrix HT (which we will explain later) and obtain that is, the binary representation of 6; we flip the sixth position in r = (0110001) and obtain the estimate of the code word which corresponds to the information 4-tuple .

SLIDE 12

O v e E d f

r

s E I T A 3

C

h a p t e r 5 ( P a r t 4 ) 1 2

H

w

d

e

s i t w

r

k ? ( I )

Why does our scheme work? We can write the received 7- tuple as the sum of the code word and the error pattern, that is, r = v + e. Remember that 1 + 1 = 0! Due to this simple equality we can obtain the sum of the rows corresponding to the 1's in r by adding component- wise the sums of the rows corresponding to the 1's in v and e.

SLIDE 13

O v e E d f

r

s E I T A 3

C

h a p t e r 5 ( P a r t 4 ) 1 3

H

w

d

e

s i t w

r

k ? ( I I )

Now we exploit that the mapping in the table is constructed such that the sum of the rows corresponding to the 1's in any code word is 000. Hence, we conclude that the sum of the rows corresponding to the 1's in r (this is the sum that the decoder computes) is equal to the sum of the rows corresponding to the 1's in e.

SLIDE 14

O v e E d f

r

s E I T A 3

C

h a p t e r 5 ( P a r t 4 ) 1 4

H

w

d

e

s i t w

r

k ? ( I I I )

But assuming at most one error during the transmission we

btain in case of no errors the sum of zero rows which we

interpret as 000 and then we accept r as our estimate In case of one error the sum contains one row, namely, precisely the row which is the binary representation of the position of the 1 in e. Hence, flip that position in r and we obtain our estimated codeword

SLIDE 15

O v e E d f

r

s E I T A 3

C

h a p t e r 5 ( P a r t 4 ) 1 5

Tie g e n e r a t

r

m a t r i x

How do we obtain the remarkable encoder mapping? Since the Hamming code is linear the code words corresponding to the information 4 tuples 1000, 0100, 0010, 0001 are of particular interest; these code words form a so- called generator matrix for the (7,4) Hamming code:

SLIDE 16

O v e E d f

r

s E I T A 3

C

h a p t e r 5 ( P a r t 4 ) 1 6

C

d

e w

r

d g e n e r a t i

n

All code words can be obtained as the product of the corresponding information 4-tuples and the generator matrix: For example, the code word corresponding to u = (1011) is

btained as the position-wise modulo-two sum of the first,

third and fourth rows in G, that is, in agreement with the mapping.

FROM PREVIOUS SLIDE

SLIDE 17

O v e E d f

r

s E I T A 3

C

h a p t e r 5 ( P a r t 4 ) 1 7

G e n e r a t i

n
f

t h e p a r i t y c h e c k m a t r i x

Assume that we have a K x N generator G, then by the theory of matrices there exists an (N-K) x N matrix H such that It follows immediately that that is, we have the fundamental result Where H is the so-called parity check matrix.

SLIDE 18

O v e E d f

r

s E I T A 3

C

h a p t e r 5 ( P a r t 4 ) 1 8

Tie p a r i t y

c

h e c k m a t r i x

Parity check in different wording: Let v be a code word, then, if we add (position-wise modulo-two) the rows of HT corresponding to the 1s in v we obtain the all-zero (N-K)- tuple. This computation is a parity-checking procedure and thus we call the matrix H a parity-check matrix of our code.

SLIDE 19

O v e E d f

r

s E I T A 3

C

h a p t e r 5 ( P a r t 4 ) 1 9

G e n e r a t

r

a n d p a r i t y c h e c k m a t r i c e s

It is easily verified that Using linear algebra we can obtain the generator matrix G for a given parity-check matrix H and vice versa.

SLIDE 20

O v e E d f

r

s E I T A 3

C

h a p t e r 5 ( P a r t 4 ) 2

S u m m a r y

Mo

d u l

t

w

a

r i t h m e t i c i s u s e d w h e n p e r f

r

m i n g c a l c u l a t i

n

s

n

b i n a r y c

d

e s

A

r e c e i v e d w

r

d r i s t y p i c a l l y d e s c r i b e d a s t h e s u m r = v + e

f

a t r a n s m i t t e d c

d

e w

r

d v a n d a n e r r

r

p a t t e r n e

T

h e m i n i m u m d i s t a n c e d

m i n

f

a b l

c

k c

d

e i s t h e s m a l l e s t d i s t a n c e b e t w e e n a n y t w

c
d

e w

r

d s , m e a s u r e d i n n u m b e r

f

b i t s b e i n g d i f f e r e n t

A

b l

c

k c

d

e c a n c

r

r e c t ( d

m i n

1

) / 2 b i t e r r

r

s a n d d e t e c t d

m i n

– 1 b i t e r r

r

s , p e r c

d

e w

r

d

H

a m m i n g c

d

e s a r e d

m i n

= 3 (

n

e

e

r r

r

c

r

r e c t i n g ) c

d

e s

Wi

t h g e n e r a t

r

m a t r i x G a n d p a r i t y c h e c k m a t r i x H , t h e c

d

e w

r

d c

r

r e s p

n

d i n g t

m

e s s a g e u i s v = u G , a n d p a r i t y c h e c k

f

a r e c e i v e d w

r

d r i s d

n

e b y c a l c u l a t i n g r H

T

w h i c h r e v e a l s t h e e r r

r

p a t t e r n t h r

u

g h ( v + e ) H

T

= e H

T

.

SLIDE 21