Voxel-based Viterbi Active Speaker Tracking (V-VAST) with best view selection for video lecture post-production

Damien Kelly, Anil Kokaram, Frank Boland
2011 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)  
An automated system is presented for reducing a multi-view lecture recording into a single view video containing a best view summary of active speakers. The system uses skin color detection and voxel-based analysis in locating likely speaker locations. Using time-delay estimates from multiple microphones, speech activity is analyzed for each speaker position. The Viterbi algorithm is then used to estimate a track of the active speaker which maximizes the observed speech activity. This novel
more » ... oach is termed Voxel-based Viterbi Active Speaker Tracking (V-VAST) and is shown to track speakers with an accuracy of 0.23m. Using the tracking information, the system then extracts from the available camera views the most frontal face view of the active speaker to display.
doi:10.1109/icassp.2011.5946941 dblp:conf/icassp/KellyKB11 fatcat:4hkechvwm5cfdl2xvn3crkohla