Image fusion of mass spectrometry and microscopy: a multimodality paradigm for molecular tissue mapping

Raf Van de Plas, Junhai Yang, Jeffrey Spraggins, Richard M Caprioli
2015 Nature Methods  
A new predictive imaging modality is created through the 'fusion' of two distinct technologies: imaging mass spectrometry (IMS) and microscopy. IMS-generated molecular maps, rich in chemical information but having coarse spatial resolution, are combined with optical microscopy maps, which have relatively low chemical specificity but high spatial information. The resulting images combine the advantages of both technologies, enabling prediction of a molecular distribution both at high spatial
more » ... lution and with high chemical specificity. Multivariate regression is used to model variables in one technology, using variables from the other technology. Several applications demonstrate the remarkable potential of image fusion: (i) 'sharpening' of IMS images, which uses microscopy measurements to predict ion distributions at a spatial resolution that exceeds that of measured ion images by ten times or more; (ii) prediction of ion distributions in tissue areas that were not measured by IMS; and (iii) enrichment of biological signals and attenuation of instrumental artifacts, revealing insights that are not easily extracted from either microscopy or IMS separately. Image fusion enables a new multi-modality paradigm for tissue exploration whereby mining relationships between different imaging sensors yields novel imaging modalities that combine and surpass what can be gleaned from the individual technologies alone. Biology and medicine are experiencing an unprecedented level of information acquisition, fueled by technological advancements that deliver enormous amounts of data with everincreasing instrumental precision. As a result, the integration of information across different Users may view, print, copy, and download text and data-mine the content in such documents, for the purposes of academic research, subject always to the full Conditions of use:
doi:10.1038/nmeth.3296 pmid:25707028 pmcid:PMC4382398 fatcat:qwqtqaxptfcx7mly7lfqx7lx6y