Selective perception policies for guiding sensing and computation in multimodal systems

Nuria Oliver, Eric Horvitz
2003 Proceedings of the 5th international conference on Multimodal interfaces - ICMI '03  
Intensive computations required for sensing and processing perceptual information can impose significant burdens on personal computer systems. We explore several policies for selective perception in SEER, a multimodal system for recognizing office activity that relies on a layered Hidden Markov Model representation. We review our efforts to employ expected-value-of-information (EVI) computations to limit sensing and analysis in a context-sensitive manner. We discuss an implementation of a
more » ... entation of a one-step myopic EVI analysis and compare the results of using the myopic EVI with a heuristic sensing policy that makes observations at different frequencies. Both policies are then compared to a random perception policy, where sensors are selected at random. Finally, we discuss the sensitivity of ideal perceptual actions to preferences encoded in utility models about information value and the cost of sensing.
doi:10.1145/958432.958442 dblp:conf/icmi/OliverH03 fatcat:xcvs3ktrfbdnhfhne5hhzd73qu