Presentation

Download Report

Transcript Presentation

Error detection and concealment
for Multimedia Communications
Senior Design
Fall 06 and Spring 07
Outline
• Introduction to multimedia communications
• Overview of JPEG2000
• Error detection and concealment of
corrupted regions in the received images
due to transmission over a noisy channel.
Multimedia Communication
Objectives and Requirements
• Transmitting a large amount of data in real time using the
least amount of channel bandwidth
• Transmitted data are robust to channel impairments
Transmission of a 1 second movie clip
Pixel intensity levels 0 to 255
8 Bits
512x512 gray level image
2.1MB
512x512 color image
6.3MB
1 second movie clip
189 MB/sec
Channel Bandwidth
94.5 MHz
JPEG Compression Based on Discrete
Cosine Transform (DCT)
• Data Compression to reduce the transmitted data
–
–
–
–
77
79
79
97
120
150
156
158
Divide Image into Blocks
Discrete Cosine Transform
Quantization
Run length channel coding
66
61
93
65
81
146
145
166
68
61
84
71
82
112
158
147
67
71
64
75
76
83
125
146
98
61
72
75
72
78
107
153
93
78
76
72
77
62
121
149
79
88
95
95
78
91
95
129
81
94
94
111
83
85
86
107
Compression Ratio 10:1
776
-165
82
-37
8
11
11
0
46
-90
6
34
-30
4
12
8
42
8
-46
12
-19
-9
9
-18
776
 48.5
16
15
-2
18
5
21
-7
-1
5
-1
15
-14
6
20
-4
-11
-12
16
12
14
14
18
24
49
72
5
0
-13
0
-2
-4
-19
-3
11
12
13
17
22
35
64
92
6 9
1 3
2 -6
4 5
4 2
9 7
-23 9
13 -1
10
14
16
22
37
55
78
95
16
19
24
29
56
64
87
98
24
26
40
51
68
81
103
112
49
-14
6
-3
0
0
0
0
40
58
57
87
109
104
121
100
51
60
69
80
103
113
120
103
Quantization
4
-7
0
2
-1
0
0
0
61
55
56
62
77
92
101
99
4
1
-3
1
-1
0
0
0
1
0
1
0
0
0
0
0
0
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
49 * 16 = 784
Original
Image
Compressed
Image
The Drawback of Compression
Images received after transmission over noisy channels
JPEG 2000: Architectural Overview
Image Sample
Level offset
Source Coding
Color Transform
RGB->CbCr
Channel Coding
Wavelet Transform
Quantization
Transmission
Block Coder
Region of Interest
Concealment with Edge Information –Transmitted Side
Information
Edge image size = 0.32% of original image
Concealment with Edge Information - Received Side
Information
Concealment with Edge Information- Edge of Received
Image
Concealment with Edge Information- Edge of Received
Image
Senior Design Tasks
• Learn the JPEG2000 standard.
• Search the literature and the internet for the different
methods of error detection and concealment for images
transmitted by JPEG2000 standard.
• Design a method to compress the binary image that
contain the edge information.
• Design a method to conceal the error by estimating the
corrupted pixels using the edge information.
• Evaluate your design by running a simulation of the
noisy channel and implementing your design in
recovering the corrupted images.
Skills Needed for the Error Detection and
Concealment
• Ability to read the literature.
• Ability to use Matlab run the simulations of the
proposed algorithms.
• Ability to understand the mechanism of wavelet to use
the relationships between coefficients in estimating
corrupted pixels.
• Ability to use some probability and statistics to estimate
the values of the corrupted pixels.
• Organization, determination, and team work ethic.