We propose a method to reliably estimate the motion of a dynamic stereo camera system in the three dimensional world where observations are disturbed by high portions of independently moving objects. Robustness of the estimation process is achieved by applying an additional visual sensor. The system consists of a stereo vision sensor, acquiring optical flow and depth information of the scene and a camera with its optical axis oriented perpendicular to the road surface, measuring the speed over

more »

... round of the camera-equipped vehicle. The fusion approach presented in this paper combines the motion estimates of the two sensors and applies an efficient random sampling scheme that evaluates the distribution of motion patterns in the scene. The goal of the sampling scheme is to separate the observations into alien and ego-motion portions used in the subsequent step to extract the ego-motion of the camera system. The presented setup of the two visual sensors in combination with the observation sampling scheme increases robustness of the overall system. The authors would like to thank the German Research Foundation (Deutsche Forschungsgemeinschaft, DFG) for the financial support within the special research project SFB/Tr 28 "cognitive automobiles". incorporating depth information of the scene [2], [3]. Both, mono and stereo approaches assume rigid body motion with observations originating exclusively from one region or object performing the same motion in the 3D world. This basic prerequisite is very difficult to accomplish if it comes to real traffic scenarios where the rigidly moving background can be overlayed by a unknown number of objects varying in velocity, size, motion, appearance, etc. (see fig. 1 ).