Edges
St Stanfor
- rd University
03-Oct-2019 1
Lecture: Edge Detection Juan Carlos Niebles and Ranjay Krishna - - PowerPoint PPT Presentation
Edges Lecture: Edge Detection Juan Carlos Niebles and Ranjay Krishna Stanford Vision and Learning Lab 03-Oct-2019 1 St Stanfor ord University CS 131 Roadmap Edges Pixels Segments Images Videos Web Recognition Neural networks
Edges
St Stanfor
03-Oct-2019 1
Edges
St Stanfor
03-Oct-2019 2
Convolutions Edges Descriptors
Resizing Segmentation Clustering Recognition Detection Machine learning
Motion Tracking
Neural networks Convolutional neural networks
Edges
St Stanfor
03-Oct-2019 3
Some background reading: Forsyth and Ponce, Computer Vision, Chapter 8
Edges
St Stanfor
03-Oct-2019 4
Some background reading: Forsyth and Ponce, Computer Vision, Chapter 8
Edges
St Stanfor
03-Oct-2019 5
Edges
St Stanfor
03-Oct-2019 6
Edges
St Stanfor
03-Oct-2019 7
Hubel & Wiesel, 1960s
Edges
St Stanfor
03-Oct-2019 8
Hubel & Wiesel, 1960s
Edges
St Stanfor
03-Oct-2019 9
Edges
St Stanfor
03-Oct-2019 10
Walther, Chai, Caddigan, Beck & Fei-Fei, PNAS, 2011
Edges
St Stanfor
03-Oct-2019 11
– Intuitively, most semantic and shape information from the image can be encoded in the edges – More compact than pixels
Source: D. Lowe
Edges
St Stanfor
03-Oct-2019 12
Vanishing point Vanishing line Vanishing point Vertical vanishing point (at infinity)
Source: J. Hayes
Edges
St Stanfor
03-Oct-2019 13
depth discontinuity surface color discontinuity illumination discontinuity surface normal discontinuity
Edges
St Stanfor
03-Oct-2019 14
Edges
St Stanfor
03-Oct-2019 15
Depth discontinuity
Edges
St Stanfor
03-Oct-2019 16
Edges
St Stanfor
03-Oct-2019 17
Edges
St Stanfor
03-Oct-2019 18
Edges
St Stanfor
03-Oct-2019 19
Edges
St Stanfor
03-Oct-2019 20
Edges
St Stanfor
03-Oct-2019 21
Edges
St Stanfor
03-Oct-2019 22
Edges
St Stanfor
03-Oct-2019 23
Edges
St Stanfor
03-Oct-2019 24
Edges
St Stanfor
03-Oct-2019 25
Edges
St Stanfor
03-Oct-2019 26
Edges
St Stanfor
03-Oct-2019 27
Edges
St Stanfor
03-Oct-2019 28
Edges
St Stanfor
03-Oct-2019 29
Edges
St Stanfor
03-Oct-2019 30
Edges
St Stanfor
03-Oct-2019 31
Edges
St Stanfor
03-Oct-2019 32
Edges
St Stanfor
03-Oct-2019 33
Edges
St Stanfor
03-Oct-2019 34
Edges
St Stanfor
03-Oct-2019 35
Edges
St Stanfor
03-Oct-2019 36
Edges
St Stanfor
03-Oct-2019 37
Edges
St Stanfor
03-Oct-2019 38
Edges
St Stanfor
03-Oct-2019 39
image intensity function (along horizontal scanline) first derivative edges correspond to extrema of derivative
Edges
St Stanfor
03-Oct-2019 40
The gradient vector points in the direction of most rapid increase in intensity
Source: Steve Seitz
The gradient direction is given by The edge strength is given by the gradient magnitude
Edges
St Stanfor
03-Oct-2019 41
Original Image Gradient magnitude x-direction y-direction
Edges
St Stanfor
03-Oct-2019 42
Gradient Intensity
Source: D. Hoiem
Edges
St Stanfor
03-Oct-2019 43
– Plotting intensity as a function of position gives a signal
Source: S. Seitz
Edges
St Stanfor
03-Oct-2019 44
Edges
St Stanfor
03-Oct-2019 45
Source: D. Forsyth
Edges
St Stanfor
03-Oct-2019 46
Slide credit: Steve Seitz
Edges
St Stanfor
03-Oct-2019 47
Slide credit: Steve Seitz
Edges
St Stanfor
03-Oct-2019 48
) ( g f dx d *
Source: S. Seitz
Edges
St Stanfor
03-Oct-2019 49
g dx d f *
Source: S. Seitz
Edges
St Stanfor
03-Oct-2019 50
Edges
St Stanfor
03-Oct-2019 51
Edges
St Stanfor
03-Oct-2019 52
Edges
St Stanfor
03-Oct-2019 53
Source: D. Forsyth
Edges
St Stanfor
03-Oct-2019 54
– Good detection: the optimal detector must minimize the probability of false positives (detecting spurious edges caused by noise), as well as that
Edges
St Stanfor
03-Oct-2019 55
– Good detection: the optimal detector must minimize the probability of false positives (detecting spurious edges caused by noise), as well as that
– Good localization: the edges detected must be as close as possible to the true edges
Edges
St Stanfor
03-Oct-2019 56
– Good detection: the optimal detector must minimize the probability of false positives (detecting spurious edges caused by noise), as well as that
– Good localization: the edges detected must be as close as possible to the true edges – Single response: the detector must return one point only for each true edge point; that is, minimize the number of local maxima around the true edge
Edges
St Stanfor
03-Oct-2019 57
Edges
St Stanfor
03-Oct-2019 58
Edges
St Stanfor
03-Oct-2019 59
Gaussian smoothing differentiation
Edges
St Stanfor
03-Oct-2019 60
Edges
St Stanfor
03-Oct-2019 61
Edges
St Stanfor
03-Oct-2019 62
Edges
St Stanfor
03-Oct-2019 63
Edges
St Stanfor
03-Oct-2019 64
Analysis and Machine Intelligence, 8:679-714, 1986.
Edges
St Stanfor
03-Oct-2019 65
– Assures minimal response
Edges
St Stanfor
03-Oct-2019 66
Edges
St Stanfor
03-Oct-2019 67
x-direction y-direction
Edges
St Stanfor
03-Oct-2019 68
X-Derivative of Gaussian Y-Derivative of Gaussian Gradient Magnitude
Source: J. Hayes
Edges
St Stanfor
03-Oct-2019 69
Source: J. Hayes
Edges
St Stanfor
03-Oct-2019 70
X-Derivative of Gaussian Y-Derivative of Gaussian Gradient Magnitude
Edges
St Stanfor
03-Oct-2019 71
– Assures minimal response
Edges
St Stanfor
03-Oct-2019 72
– Suppress all pixels in each direction which are not maxima – Do this in each marked pixel neighborhood
Edges
St Stanfor
03-Oct-2019 73
Edges
St Stanfor
03-Oct-2019 74
– Suppress all pixels in each direction which are not maxima – Do this in each marked pixel neighborhood
Edges
St Stanfor
03-Oct-2019 75
Source: D. Forsyth
Edges
St Stanfor
03-Oct-2019 76
Edges
St Stanfor
03-Oct-2019 77
– Assures minimal response
Edges
St Stanfor
03-Oct-2019 78
Edges
St Stanfor
03-Oct-2019 79
– If less than Low, not an edge – If greater than High, strong edge – If between Low and High, weak edge
Edges
St Stanfor
03-Oct-2019 80
– Consider its neighbors iteratively then declare it an “edge pixel” if it is connected to an ‘strong edge pixel’ directly or via pixels between Low and High
Edges
St Stanfor
03-Oct-2019 81
Source: S. Seitz
strong edge pixel weak but connected edge pixels strong edge pixel
Edges
St Stanfor
03-Oct-2019 82
Edges
St Stanfor
03-Oct-2019 83
Edges
St Stanfor
03-Oct-2019 84
Canny with Canny with
Source: S. Seitz
Edges
St Stanfor
03-Oct-2019 85
Gradients (e.g. Canny) Color Texture Combined Human
Edges
St Stanfor
03-Oct-2019 86
Source: Arbelaez, Maire, Fowlkes, and Malik. TPAMI 2011 (pdf)
Edges
St Stanfor
03-Oct-2019 87
Edges
St Stanfor
03-Oct-2019 88
Edges
St Stanfor
03-Oct-2019 89
Edges
St Stanfor
03-Oct-2019 90
– There are many lines passing through the point (xi ,yi ).
– Common to them is that they satisfy the equation for some set of parameters (a, b)
Edges
St Stanfor
03-Oct-2019 91
– b = -a*xi + yi – We can now consider x and y as parameters – a and b as variables.
– So: a single point in x1,y1-space gives a line in (a,b) space. – Another point (x2, y2 ) will give rise to another line (a,b) space.
Edges
St Stanfor
03-Oct-2019 92
Edges
St Stanfor
03-Oct-2019 93
Edges
St Stanfor
03-Oct-2019 94
Edges
St Stanfor
03-Oct-2019 95
– For each pair of points (x1, y1) and (x2, y2) detected as an edge, find the intersection (a’,b’) in (a, b)space. – Increase the value of a cell in the range [[amin, amax],[bmin,bmax]] that (a’, b’) belongs to. – Cells receiving more than a certain number of counts (also called ‘votes’) are assumed to correspond to lines in (x,y) space.
Edges
St Stanfor
03-Oct-2019 96
Edges
St Stanfor
03-Oct-2019 97
– x*cosθ + y*sinθ = ρ
– (x y) and (ρ θ)?
Edges
St Stanfor
03-Oct-2019 98
Edges
St Stanfor
03-Oct-2019 99
Edges
St Stanfor
03-Oct-2019 100
– Conceptually simple. – Easy implementation – Handles missing and occluded data very gracefully. – Can be adapted to many types of forms, not just lines
– Computationally complex for objects with many parameters. – Looks for only one single type of object – Can be “fooled” by “apparent lines”. – The length and the position of a line segment cannot be determined. – Co-linear line segments cannot be separated.
Edges
St Stanfor
03-Oct-2019 101