In this report, we consider the challenging problem of recovering a specular shape from the continuous observation during motion. We find that under certain constraints, the information contained in the perceived optical flow (also known as specular flow) is sufficient to locally reconstruct a surface and its first-and second-order derivatives. We further consider the effect of measurement errors and the practical implementation issues.