Prerequisites: Experience in programming (in particular, C/C++ and OpenCV; either Windows or Linux is fine) and in digital imaging.
The course assignments count 30% of the total mark, and the exam 70%. There are two individual assignments:
(1) implement and test one stereo algorithm for recorded stereo sequences, and
(2) implement and test one
motion analysis algorithm.
For each assignment, a report needs to be submitted by the due date (as announced in lectures), and solutions and data need to be explained in lab meetings or short seminars.
Left to right: HAKA1, stereo cameras behind windscreen, scene flow analysis, 3D visualization for ETRI visitors, computer graphics for generating synthetic stereo sequences, camera calibration
SUBMISSION OF FIRST ASSIGNMENT ON STEREO SEQUENCE ANALYSIS
Latex template for report (provided by Gisela Klette, for optional use)
(1) There are free software downloads available for multimedia imaging, such as OpenCV, OpenGL, GIMP, and ImageJ. See also the software-link on The Computer Vision Homepage.
(2) On OpenCV, see materials prepared by Tobi Vaudrey for COMPSCI 375 in 2008: Handout OpenCV, Basic image analysis, and Sequence analysis and optical flow. See also the Intro into OpenCV by Gady Agam.
Collections of links
Overview on driver assistance systems
Automatic parking
Web site on 3D shape recovery technologies
University research
The Drivsco Project
Vision-based driver assistance system
Self-driving bus at UCB
Urban 3D Modelling from Video
Company R&D
Inro - Advanced vhicle automation, New Zealand
Blackhawk Tracking Systems, New Zealand
Driver assistance systems at Hella Aglaia, Germany
Driver assistance systems at Hella KGaA Hueck and Co, Germany
Advanced transport systems by ULTra, UK, see this 2007 info
Connected cars 'promise safer roads', 6 July 2007
(printable version: here)
Conferences
Pacific-Rim Symposium on Image and Video Technology
3DTCV-CON
Int. Conf. Arts & Technology
Robot Vision
IEEE International Conference on Robotics and Automation (in 2008, over 1330 attendees and 661 papers presented)
Int. Symposium on Robotics
IEEE Intelligent Vehicles Symposium
Contests
Middlebury Stereo Evaluation
Middlebury Optic Flow Evaluation
DARPA Urban Challenge
DARPA Grand Challenge
B. Leibe et a.: Coupled Object Detection and Tracking from Static Cameras and Moving Vehicles (2008)
H.M.Ozaktas and L. Onural (eds.): Three-Dimensional Television (2007)
Ernst D. Dickmanns: Dynamic Vision for Perception and Control of Motion (2007)
Klaus et al.: Segment-based stereo matching using belief propagation and a self-adapting dissimilarity measure (2006)
Zhao et al.: Local-global stereo matching algorithm (2006)
Franke et al.: 6D-vision - fusion of stereo and motion for robust environment perception (2005)
T. Dang et al.: Fusing optical flow and stereo disparity for object tracking (2002)
Barron and Klette: Quantitative color optical flow (2002)
Barron and Klette: Experience with optical flow in colour video image sequences (2001)
G.Egnal: Mutual information as a stereo correspondence measure (2000)
J. Miura et al.: An active vision system for real-time traffic sign recognition (2000)
Adelson et al.: Pyramid methods in image processing (1984)