C3: A Command-line Catalogue Cross-matching tool for modern astrophysical survey data

Giuseppe Riccio, Massimo Brescia, Stefano Cavuoti, Amata Mercurio, Anna Maria Di Giorgio, Sergio Molinari
2016 Proceedings of the International Astronomical Union  
In the current data-driven science era, it is needed that data analysis techniques has to quickly evolve to face with data whose dimensions has increased up to the Petabyte scale. In particular, being modern astrophysics based on multi-wavelength data organized into large catalogues, it is crucial that the astronomical catalog cross-matching methods, strongly dependant from the catalogues size, must ensure efficiency, reliability and scalability. Furthermore, multi-band data are archived and
more » ... uced in different ways, so that the resulting catalogues may differ each other in formats, resolution, data structure, etc, thus requiring the highest generality of cross-matching features. We present C 3 (Command-line Catalogue Cross-match), a multi-platform application designed to efficiently cross-match massive catalogues from modern surveys. Conceived as a stand-alone command-line process or a module within generic data reduction/analysis pipeline, it provides the maximum flexibility, in terms of portability, configuration, coordinates and cross-matching types, ensuring high performance capabilities by using a multi-core parallel processing paradigm and a sky partitioning algorithm.
doi:10.1017/s1743921316013120 fatcat:mhetxl3txvea7ex5vtz4w6q5nu