Distance-Dependent Multimodal Image Registration for Agriculture Tasks

Ron Berenstein, Marko Hočevar, Tone Godeša, Yael Edan, Ohad Ben-Shahar
2015 Sensors  
Image registration is the process of aligning two or more images of the same scene taken at different times; from different viewpoints; and/or by different sensors. This research focuses on developing a practical method for automatic image registration for agricultural systems that use multimodal sensory systems and operate in natural environments. While not limited to any particular modalities; here we focus on systems with visual and thermal sensory inputs. Our approach is based on
more » ... ting a distance-dependent transformation matrix (DDTM) between the sensors; and representing it in a compact way by regressing the distance-dependent coefficients as distance-dependent functions. The DDTM is measured by calculating a projective transformation matrix for varying distances between the sensors and possible targets. To do so we designed a unique experimental setup including unique Artificial Control Points (ACPs) and their detection algorithms for the two sensors. We demonstrate the utility of our approach using different experiments and evaluation criteria. OPEN ACCESS Sensors 2015, 15 20846
doi:10.3390/s150820845 pmid:26308000 pmcid:PMC4570450 fatcat:yvgofmigavdnhh2eqygmnyxl6a