This paper overviews our project to develop techniques for modeling and conservation of cultural heritage through observation. Main research area of this project includes: reconstruction of geometric model, photometric model through observation, automatic creation of virtual and mixed reality model, and modeling and conservation of prominent skill of living national treasure. On top of this component development, we have been developing a digital archive of heritage objects.