This work provides a damage detection method utilizing the variation in frequency response function (FRF) data measured while moving an additional mass. The variance between the proper orthogonal modes (POMs) to transform two different FRF responses is transformed to the curvature and the curvature is utilized as an index to evaluate the damage. It is shown that the proposed method and statistical analysis can be explicitly utilized under the existence of external noise.