COMPUTER VISION

Three-Dimensional Data from Images

Reinhard Klette, Karsten Schlüns, and Andreas Koschan

Springer Singapore, 1998

ISBN 981-3083-71-9


Index

  • 1
  • 3
  • A
  • B
  • C
  • D
  • E
  • F
  • G
  • H
  • I
  • J
  • K
  • L
  • M
  • N
  • O
  • P
  • Q
  • R
  • S
  • T
  • U
  • V
  • W
  • X
  • Y
  • Z
  • 1

    1-CCD camera 69
    

    3

    3-CCD camera 69
    3D model 367
    3D profile 360
    3D rotation matrix 51, 59, 65
    3D scanner 348
    3D translation vector 51, 59
    

    A

    active color stereo analysis 370
    ADC 74
    ADJUST 15
    albedo 236
    albedo dependent 302, 310, 331
    albedo independent 302, 326, 335
    algorithm representation 15, 38
    analog/digital converter 74
    analytical reflection mode 248
    angle
      incident angle 237
      emergent angle 237
      emittance angle 237
      phase angle 237
    angle criterion 138
    anisotropic 237
    antiderivative 84, 127
    aperture problem (motion analysis) 180
    apparent contour 89
    approximation 130
    approximation of surfaces 39
    area-based stereo 145
    arithmetic mean 35
    azimuthal projection 118
    

    B

    backprojection 99
    base distance 30, 131
    base line 131, 134
    beam-splitter prism 71
    Beckmann-Spizzichino model 250
    bidirectional reflectance-distribution function 232
    binary encoded light stripe projection 363
    binary image 12
    binocular image acquisition 5, 29, 129
    bit-plane stack 363
    black level 77
    block-matching method 146, 155
    blooming 74
    body reflection 253
    body reflection color 253
    bootstrap problem 142
    BRDF, see bidirectional reflectance-distribution function
    brightness constraint 280
    

    C

    calculus of variations 285
    calibration
      see direct linear transformation
      see Tsai calibration
    calibration marks 53
    calibration object 48, 53, 54, 63, 207, 246, 357
    calibration points 53
    calibration technique 53, 62
    camera
      CCD camera 6, 33, 62
      camera centered coordinate system 44, 
            51, 57, 58
      camera constant 48, 50
      camera coordinate system 48
      camera coordinates 43
      camera geometry 43
      camera modeling 130
      camera rotation 189
    capture of image data, see image acquisition
    CCD 68
    camera 6, 33, 62
    central projection 30, 44, 49, 100, 106, 132, 182, 185, 220
    centroid 53
    characteristic curve 273
    charge coupled device, see CCD
    clipping 73
    collinear 31
    collineation 46
    color 12
    color cube 13
    color difference 156
    color distance 156
    color encoded light stripe projection 367
    color gradients 166
    color histogram 255
    color image 12
    color image model 39
    color image stereo analysis 155
    color signal 72
    color-signal plane 255
    color stereo image 33
    color stripe filter 70, 71
    compatibility assumption for features 140
    compatibility assumption for intensity values 138
    compatibility constraint 136
    complementary color mosaic filter 71
    concave orientation edge 123
    concave-convex conflict 304, 305, 314
    conic section 243, 310, 332
    conservative vector field 84, 319
    constrained search space (turntable) 212
    constraint 10
    constraint combination 284
    continuity assumption for disparities 139
    continuity assumption for disparities along the edges 140
    continuity constraint 136, 139
    continuous function 82, 127
    continuous illumination 370
    continuous surface functions 83
    contour plot 115, 243
    contrasting illumination 370
    convex orientation edge 123
    convolution 25
    convolution operation 24
    coordinate system
      , image centered coordinate system 44, 45, 51, 57, 58
    coordinates ideal image43
    coordinates spherical 233
    coordinates stereographic 238, 241, 280, 286
    coordinates undistorted image 58
    coplanarity 123
    correspondence analysis 130, 207
    correspondence problem 33, 135
    corresponding points 31, 209
      assigning 135
    cross product 122
    cumulative dissimilarity functional 152
    curved surface 83
    cyclopean separation 143
    cylindrical lens 356
    

    D

    dark current 77
    depth map 95, 97, 105
    determination equations 185
    dichromatic plane 255
    dichromatic reflection model 252
    difference quotient 90
    differential quotient 90
    diffuse reflection component 248
    direct linear transformation 53, 54, 63
    direction angle 22
    directional derivative 87
    discrete iteration scheme 196
    disparity 31
    disparity map 31, 33, 36
    disparity candidate multi-interval 162
    disparity gradient 143
    disparity gradient limit 144, 136
    disparity histogram, global 161
    disparity histogram, local 162
    disparity limit 136, 142, 152
    disparity smoothness constraint 139
    displacement parameters 185
    dissimilarity measure 35
    distance error 110
    DLT, see direct linear transformation
    dot notation 85
    DRM, see dichromatic reflection model
    dual point 122
    dual straight line 121, 244, 327
    dynamic programming 153, 172
    dynamic range 73, 
    dynamic stereo analysis 130, 180
    

    E

    edge detection 19, 38
    edge
      , gray value 20
      , highlight 141
      , illumination 141
      , image value 20
      , object 2, 141
      , occlusion 141
    edge  operator 37
    edge
      , orientation 141
      , reflectance 141
      , shadow 141
    effective focal length 29, 48, 50, 55, 58
    emergent angle 237
    emittance angle 237
    empirical reflectance map 248
    empirical reflection model 246
    epipolar constraint 136, 137
    epipolar geometry 134
    epipolar line 135, 137
    epipolar epipolar plane 134, 135
    epipolar epipolar profile 151
    epipole 134
    error  function 67
    error
      , sum of angular 205
      , sum of relative 205
    expected value 35
    extrinsic parameters 52
    

    F

    f-stop 74
    face 2
    facet 82, 100, 124, 182
    fast Fourier transform 113, 114, 116, 125
    feature compatibility constraint 140
    feature extraction 130
    feature-based correspondence analysis 159
    feature-based stereo 159
    FFT, see fast Fourier transform
    field of local displacement vectors 177
    figural continuity constraint 136, 140
    focal length 9, 50
      see also effective focal length
    focal point 29
    focal separation 33
    forward differences 202
    Fourier
      see also fast Fourier transform
    Fourier  coefficient 110
    Fourier  expansion 110
    Fourier  function 110
    frame grabber 51, 62
    frame transfer sensor 68
    Frankot-Chellappa algorithm 109
    Fresnel term 250
    functional determinant 190
    functional representation 81
    

    G

    gamma correction 76
    gamma recorrection 259
    gamma value 76
    Gauss filter 167
    Gaussian coordinates 92
    Gaussian curvature 118
    Gaussian hemisphere 92, 307
    Gaussian lens formula 49
    Gaussian sphere 92, 103, 118, 190, 266
    Gaussian general reflectance map 275
    general shape reconstruction problem 95
    general shape recovery problem 95
    generalized cylinder 270
    geometric similarity constraint 136, 138
    geometrical attenuation 250
    geometrical optics 249
    geometry of scene objects 124
    geometry of stereo analysis 172
    global integration method 109
    global minimization approach 280
    gnomonic projection 118, 241
    gonio-reflectometer 236
    gradient 20, 67, 87
    gradient map 95, 98, 105, 115
    gradient space 117, 124, 238
    gradient vector 20
    Gray code 363
    gray tone 13
    gray value 12
      see also image irradiance
    gray value relief 20
    great circle 92
    GretagMacbeth ColorChecker 16, 17, 77, 255
    ground truth 97
    

    H

    halfway-vector 251
    height map 95, 97, 105
    Homogeneous coordinates 45
    Horn-Schunck algorithm 198
    Horn-Schunck constraint 193
    Horn-Schunck method 193, 222
    HSI model 14, 72
    human visual system 172
    hybrid reflection 248
    

    I

    ideal image coordinates 43
    ideal lens 49
    illuminance 228
    illumination direction 237
      calculation 340
    illumination gradient 239
    image 6, 12, 44
    image buffer (coordinates) 51, 58
    image center 52, 63
    image-centered coordinate system 44, 45, 51, 57, 58
    image-centered projection 185
    image formation 258
    image irradiance 228, 229, 232, 233, 260
    image irradiance equation 258, 266
    image plane 6, 29
    image point 12, 44
    image processing 1, 38
    image resolution 12
    image segmentation 16
    image sequence 178
    image size 12
    image stitching 17
    image transformation 38
    image value 6
    image value function 20
    image
      , digital 12
      , gray value 12
    image pixel 62
    image width 49
    image acquisition 43, 130
      , active 5
      , binocular 5, 29, 129
      , dynamic 2
      , monocular 5
      , polyocular 5
    incident angle 237
    indefinite integral 84
    inhomogeneous coordinates 45
    inhomogeneous dielectric 252
    inner vector product 121
    integrability condition 83, 127
    integrability constraint 110, 283, 318
    integration 95
    integration path 85, 128
    intensity 14
    intensity gradient constraint 284
    intensity-based correspondence analysis 146
    intercept 82
    interface reflection 253
    interline transfer sensor 68
    internal scattering 249
    interreflections 256
    intrinsic parameters 52
    inverse square law 231
    inverse photometric stereo method 341
    irradiance constraint 280
    irradiance gradient constraint 284
    irradiance pair 307
    irradiance triplet 331
    irradiance
      see also image irradiance
    isoirradiance curve 244
    isoradiance curve 244
    isotropic 237
    

    J

    Jacobian determinant 190
    

    L

    laboratory set-up 4
      see also image acquisition
    Lambertian reflectance map 240
    Lambertian reflector 234
    Lambertian surface 4, 236
    Lambertian texture 115
    Lambert's cosine law 235, 249, 266
    Laplace derivation 22
    Laplace operator 287
    Laplacian 22
    Laplacian-of-Gaussian 24
    laser range finder 6
      see also 3D scanner
    law of reciprocity 231
    LCD-projector 367
    length criterion 139
    light spot projection 349
    light spot stereo analysis 353
    light stripe projection 355
    linear reflectance map 238, 271, 308
    linear surface patch 82
    linear transformation 46
    linearity assumption 90
    local difference operation 199
    local displacement field 179
    local displacement vector 179
    local integration technique 109
    local shape from shading 293
    local velocity vector 179
    LoG filter 24
    LoG operator 40, 161
    look-up table 334
    luminance 228
    luminous emittance 228
    luminous energy 228
    luminous exitance 228
    luminous flux 228
    luminous intensity 228
    luminous power 228
    

    M

    Macbeth ColorChecker, see GretagMacbeth ColorChecker
    master black control 77
    matching corresponding points 135
    mean 35
    mean square error 148
    measured image irradiance 258, 263
    median operator 150
    Mexican hat 24
    minimization problem 197
    mobile robots 173
    Moore-Penrose inverse 55, 64
    motion
      , 3D 177
      , absolute 178
      , relative 178
      vector 146
    moving light displays 177, 223
    MSE, see mean square error
    mutual illuminations 256
    

    N

    National Television System Committee 76
    needle map 102, 115, 291, 297, 319, 324
    negative solution 315
    neutral interface reflection model 254
    NIRM, see neutral interface reflection model
    normal 87
    normal distribution 24
    normal vector 21
    NTSC, see National Television System Committee
    

    O

    object
      , 2.5-D  9
      , 3D 8
    object edge 2
    object face 2
    object in 3D Euclidean space 8
    object surface 2, 39, 81
    object tracking 11, 222
    object width 49
    occluding boundary 89, 141, 182, 218, 291
    occlusion edge 89
    optical axis 29
    optical center 29
    optical-lens camera model 48
      mapping 6
    optical flow 190
      , image value fidelity of the 192
      , motion fidelity of the 193
      , representation of 203
      , smoothness of 195
      technique 11, 222
    optimal difference recursive filter 37
    optimization problem 110
    ordering constraint 136, 144, 145, 151
    orientation 87
    orientation edge 89, 123
    orthogonal (parallel) projection, see parallel projection
    orthogonal matrix 189
    orthogonal vectors 121
    orthogonality 121
    orthographic projection, see parallel projection
    outer vector product 122
    

    P

    PAL, see phase alternation line
    pan angle 52
    parallax 31
    parallel implementation 174
    partial derivatives 67
    pattern analysis 1, 2, 4, 38
    perfectly diffuse 234
    perspective projection 44, 57
    phase alternation line 76
    phase angle 237
    phase shift 366
    Phong model 251
    photogrammetry 129
    photometric calibration 75, 259
    photometric compatibility constraint 136, 145
    photometric compatibility constraint, 
    photometric differential 138
    photometric quanti-ties 228
    photometric sensor model 71
    photometric stereo 3, 5, 301
    photometric stereo analysis, see photometric stereo
    photometric stereo method, see photometric stereo
    physical optics 249
    pinhole camera 29, 44, 48
    pixel 12
    plane 88
      , slope 82
      , slope-intercept equation 82, 88
    plane at infinity 45
    point
      , visible 96
    point-based differential techniques 206
    point at infinity 45, 47
    polar projection 118
    polyhedral scene object 101
    polyhedral world 101
    polyhedron 82
    position vector 6
    positive solution 315
    pre-knee-circuit 73
    primary color mosaic filter 69
    primary colors 13
    principal point 51, 52, 58, 63, 68
    problem
      , ill-posed 7
      , well-posed 7
    profile 89
    projection 44, 47, 108, 127, 179, 188, 218, 237, 259
      see also central projection
      see also parallel projection
    projection center 30, 45, 47
    projection equation 44, 45, 59, 46, 47
    projection optics 6
    projection plane 45
    projection points 45
    projection space 45
    propagation method 271
    PSM, see photometric stereo
    

    Q

    quadratic variation 22
    quantization 12
    

    R

    radial lens distortions 59
    radiance 228, 230, 231, 233
    radiant emittance 228, 229, 234
    radiant energy 228, 229
    radiant exitance 228, 229
    radiant flux 228, 229
    radiant intensity 228, 229, 231
    radiant power 228, 229, 230
    radiation 228
    radiometric quantities 228
    radiosity 231
    range data analysis 2
    range image 97
    range scanner, see 3D scanner
    ray 225
    ray of projection 95
    ray theorem 9, 44, 59, 182
    re-correction 76
    reconstruction of object surfaces 1
    recovery of object shapes 1
    rectangle 179
    rectification 134, 138
    reflectance map 237
    reflected radiance 230, 234
      see also radiance
    reflection anisotropic 237
    reflection isotropic 237
    reflection component 248
    reflection hybrid reflection 248
    reflection model 227
      Dichromatic reflection model 252
      Beckmann-Spizzichino reflection model 250
      Phong reflection model 251
      Torrance-Sparrow reflection model 250
    registration 95
    regularization 281
    relief, gray value 20
    RGB model 12, 156
    right circular cone 266, 312
    rigid object 7, 81, 177
    rim 89, 218
    robotics 173
    roll 56
    roll angle 52
    rotation 131
    rotation matrix 189, 208, 214
    rotation parameters 188
    rotationally symmetric reflectance map 275
    rotationally symmetric Lambertian reflectance map 241, 268
    roughness 250
    ruled surface 305
    

    S

    sampling theorem 25
    saturation 14, 74
    scalar disparity 31
    scalar product 121
    scaling factor 65
    scan algorithm 109
    scene 5, 44
      , dynamic 2
      , geometric resolution in the 9
      , indoor 2
      , outdoor 2
    scen analysis 2, 38
    scene objects, geometry of 39
    scene space 6
    scene value 6
    scene point 44
    scene radiance 230, 254, 260
    Schwarz function 126
    search window 146
    SECAM, see sequentiel couleur a memoire
    self-shadow 244
    self-shadow line 244
    sensor
      , interline transfer 68
      , frame transfer 68
    sensor characteristics 43
    sensor coordinates 58, 61
    sensor elements 62
    sensor model 68
    sequentiel couleur a memoire 76
    set
      , compact 8
    set simply-connected 8, 83
    SFS, see shape from shading
    shape 7
    shape from focus 5
    shape from motion 5, 11, 222
    shape from occluding boundaries 5, 223
      volume based approach 221
    shape from texture 11
    shape reconstruction 2
    shape recovery 1, 129
    shape from shadows 11
    shape from shading 11, 263
      classification 267
      limitations 302
      , local shape from shading 293
      , global minimization 280
      , propagation 271
    Shirai algorithm 33, 40, 140, 142
    silhouette 89
    similarity
      function 41
      measure 35, 145, 151
    slant 21, 56, 92, 103, 113, 118
    smoothing 24
    smoothness constraint 110, 281, 292
    smoothness error 195
    Sobel operator 23
    solid angle 229
    spatial resolution 9
    spectral
    spectral power distribution 71
    spectral reflectance factor 71, 77
    spectral reflection component 249
    spectral response curve 71
    spectral sensitivity 71
    specular lobe 250
    specular spike 250
    sphere 2, 91, 98
    spherical coordinates 233
    spherical lune 93
    square error 35
    ssg, see standard stereo geometry
    staircase example 109
    standard deviation 24
    standard stereo geometry 30, 31, 40, 130, 133, 175
    static light pattern projection 362
    static scene 2
    static stereo analysis 29, 129, 353
    stereo pipeline 130
    steradiant 94
    stereo
      , area-based 145
    stereo color image 36
    stereo vision 129
    stereographic coordinates 238, 241, 280, 286
    stereographic projection 118
    stereopsis 129
    structured lighting 5, 347
    subpixel accuracy 160
    surface 2, 39
      , Lambertian 4
    surface curvature 118
    surface function 112
    surface gradient 260
    surface patches 10
    surface point 8
    surface reconstruction 2
    surface representation 125
      , floating horizon 115
      , grid 115
      , shaded 115
    surface roughness 251
    symmetry plane 312
    

    T

    tangent plane 86
    Taylor expansion 90, 193
    texture 4
    three source photometric stereo 331
    tilt 56, 92, 103, 118
    tilt angle 52
    topology of 3D objects 39
    Torrance-Sparrow model 250
    translation vector 208
    triangulation 130, 133, 207, 349
    trinocular stereo analysis 169, 170
    tristimulus values 13
    Tsai calibration 62
    turntable 207, 214, 218
    two source photometric stereo 307
    

    U

    undistorted image coordinates 58
    uniqueness assumption 136, 138
    unit (surface) normal 87, 92, 118, 238
    unit (surface) normal constraint 284
    

    V

    valid (distorted) image coordinates 58
    vanishing plane 45
    variance 24, 35
    variation calculus 196
    vector field 84, 128
    vector product 122, 182
    velocity 183
    velocity space 194
    viewer direction 237
    vignetting 259
    visible, entirely from outside, 8
    vision
      , active 191
      , animate 191
    visual sensor 2
    visualizations of object surfaces 125
    

    W

    weighted moments 53
    weighting parameter 196
    white balance 78
    white level 74
    world coordinate system 48, 58
    world coordinates 43, 51, 209
    

    Y

    Ye-Cy-Mg-G color mosaic filter 71
    

    Z

    zero crossing 23, 28
    vector 161
    zero-irradiance 307
    
    
    

    CITR: last update: 21 April 1998