A spatio-temporal semantic model for multimedia database systems and multimedia information systems

Shu-Ching Chen, R.L. Kashyap
2001 IEEE Transactions on Knowledge and Data Engineering  
AbstractÐAs more information sources become available in multimedia systems, the development of abstract semantic models for video, audio, text, and image data becomes very important. An abstract semantic model has two requirements: It should be rich enough to provide a friendly interface of multimedia presentation synchronization schedules to the users and it should be a good programming data structure for implementation in order to control multimedia playback. An abstract semantic model based
more » ... on an augmented transition network (ATN) is presented. The inputs for ATNs are modeled by multimedia input strings. Multimedia input strings provide an efficient means for iconic indexing of the temporal/spatial relations of media streams and semantic objects. An ATN and its subnetworks are used to represent the appearing sequence of media streams and semantic objects. The arc label is a substring of a multimedia input string. In this design, a presentation is driven by a multimedia input string. Each subnetwork has its own multimedia input string. Database queries relative to text, image, and video can be answered via substring matching at subnetworks. Multimedia browsing allows users the flexibility to select any part of the presentation they prefer to see. This means that the ATN and its subnetworks can be included in multimedia database systems which are controlled by a database management system (DBMS). User interactions and loops are also provided in an ATN. Therefore, ATNs provide three major capabilities: multimedia presentations, temporal/spatial multimedia database searching, and multimedia browsing. Fig. 1. Timeline for multimedia presentation. t I to t T are the time instances. d I is the time duration between t I and t P , and so on. Fig. 2. Augmenetd transition network for a multimedia presentation. Get procedure is to access an individual media stream. Get_Symbol is a procedure which reads the next input symbol of a multimedia input string. Next_State is a procedure to advance to the next state in ATN. Display procedure displays the media streams. , (, and & are the parameters.
doi:10.1109/69.940735 fatcat:vfj3qjm7h5g75fgwgdoi5dpdf4