4,116 Hits in 5.4 sec

Multimodal 3-D tracking and event detection via the particle filter

D. Zotkin, R. Duraiswami, L.S. Davis
Proceedings IEEE Workshop on Detection and Recognition of Events in Video  
We use Bayesian inference and the particle filter for tracking moving objects, using both video data obtained from multiple cameras and audio data obtained using arrays of microphones.  ...  In the first, the behavior of a flying echolocating bat as it approaches a moving prey is studied, and the events of search, approach and capture are detected.  ...  We develop a multimodal sensor fusion framework based on particle filters and apply it to tracking and event detection using audio and video modalities.  ... 
doi:10.1109/event.2001.938862 dblp:conf/event/ZotkinDD01 fatcat:xfrnbx5qufgrhn3kola5bkcdyq

Gestures Everywhere

Nicholas Gillian, Sara Pfenninger, Spencer Russell, Joseph A. Paradiso
2014 Proceedings of The International Symposium on Pervasive Displays - PerDis '14  
Gestures Everywhere fuses the multimodal sensor data using radial basis function particle filters and performs real-time analysis on the aggregated data.  ...  We describe the algorithms and architecture of our system and discuss the lessons learned from the systems deployment.  ...  A new particle filters is used to track each new user in range of display k, with each particle filter using 500 particles.  ... 
doi:10.1145/2611009.2611032 dblp:conf/perdis/GillianPRP14 fatcat:qnjp7lb5h5ghjgptud4wofsspe

Target Detection and Tracking With Heterogeneous Sensors

Huiyu Zhou, M. Taj, A. Cavallaro
2008 IEEE Journal on Selected Topics in Signal Processing  
Index Terms-Multimodal detection and tracking, Kalman filter, particle filter, heterogeneous sensors, low bit rate communication.  ...  We present a multimodal detection and tracking algorithm for sensors composed of a camera mounted between two microphones.  ...  Similarly, turn taking events can be recognized by semantic analysis of the scene using trajectories generated via the audiovisual particle filter ( [31] ).  ... 
doi:10.1109/jstsp.2008.2001429 fatcat:6jttgi4scja4tpzyxzdjxpknnu

Perceiving user's intention-for-interaction: A probabilistic multimodal data fusion scheme

C. Mollaret, A. A. Mekonnen, I. Ferrane, J. Pinquier, F. Lerasle
2015 2015 IEEE International Conference on Multimedia and Expo (ICME)  
The multimodal detector achieves up to 80% correct detection rates improving purely audio and RGB-D based variants.  ...  The proposed detector fuses multimodal cues, including estimated head pose, shoulder orientation and vocal activity detection, using a probabilistic discrete state Hidden Markov Model.  ...  The 6-D state vec- tor, [x ′ h , y ′ h , z ′ h , θ ′ h , φ ′ h , ψ ′ h ] , contains the 3-D head position and the 3 orientation angles relative to the sensor.  ... 
doi:10.1109/icme.2015.7177514 dblp:conf/icmcs/MollaretMFPL15 fatcat:a5ba7jesa5c4fjkwglud6xsfpq

A realtime multimodal system for analyzing group meetings by combining face pose tracking and speaker diarization

Kazuhiro Otsuka, Shoko Araki, Kentaro Ishizuka, Masakiyo Fujimoto, Martin Heinrich, Junji Yamato
2008 Proceedings of the 10th international conference on Multimodal interfaces - IMCI '08  
This paper also presents new 3-D visualization schemes for meeting scenes and the results of an analysis.  ...  Using the microphone array, robust speaker diarization is carried out by a VAD (Voice Activity Detection) and a DOA (Direction of Arrival) estimation followed by sound source clustering.  ...  For face tracking, we employ STCTracker [12, 13] ; it includes an initialization part and particle filtering.  ... 
doi:10.1145/1452392.1452446 dblp:conf/icmi/OtsukaAIFHY08 fatcat:ecx55jf4irbqhfczemblazofzq

Tracking People Motion Based on Extended Condensation Algorithm

Jorge Garcia, Alfredo Gardel, Ignacio Bravo, Jose Luis Lazaro, Miguel Martinez
2013 IEEE Transactions on Systems, Man & Cybernetics. Systems  
Four fundamental aspects can be identified: the detection and tracking of human motion using an extended particle filter, the use of 3-D measurements in order to increase the system's robustness and a  ...  A processing ratio of around 30 frames/s is necessary in order to capture the real-time trajectory of people and obtain robust tracking results.  ...  The bootstrap particle filter, a version of the SIR filter, was used in [19] to track blobs. None of the filters cited thus far are multimodal.  ... 
doi:10.1109/tsmca.2012.2220540 fatcat:df5dw7yb2fewberjnlnqa7dxgi

Multimodal identification and localization of users in a smart environment

Albert Ali Salah, Ramon Morros, Jordi Luque, Carlos Segura, Javier Hernando, Onkar Ambekar, Ben Schouten, Eric Pauwels
2008 Journal on Multimodal User Interfaces  
with particle filters to obtain robust localization and identification.  ...  Detecting the location and identity of users is a first step in creating context-aware applications for technologically-endowed environments.  ...  Lale Akarun, Cem Keskin, and Ceren Kayalar, who were part of our project group during the workshop, and our anonymous reviewers.  ... 
doi:10.1007/s12193-008-0008-y fatcat:buvzrwgl4ncezm7etflabtqwsu

Multi-Floor Indoor Pedestrian Dead Reckoning with a Backtracking Particle Filter and Viterbi-Based Floor Number Detection

Cedric De Cock, Wout Joseph, Luc Martens, Jens Trogh, David Plets
2021 Sensors  
We also proposed a clustering algorithm on top of the BPF to solve multimodality, a known problem with particle filters.  ...  The PDR output is matched to a scaled floor plan and fused with model-based WiFi received signal strength fingerprinting by a Backtracking Particle Filter (BPF).  ...  Sample Availability: Samples of the compounds are available from the authors.  ... 
doi:10.3390/s21134565 fatcat:dzz2ohdpsjd6zc66pzg5cvdip4

Audiovisual Head Orientation Estimation with Particle Filtering in Multisensor Scenarios

Cristian Canton-Ferrer, Carlos Segura, Josep R. Casas, Montse Pardàs, Javier Hernando
2007 EURASIP Journal on Advances in Signal Processing  
The use of particle filters as a unified framework for the estimation of the head orientation for both monomodal and multimodal cases is proposed.  ...  Furthermore, two different particle filter multimodal information fusion schemes for combining the audio and video streams are analyzed in terms of accuracy and robustness.  ...  ACKNOWLEDGMENT The authors would like to express their gratitude to Andrey Temko for fruitful discussions.  ... 
doi:10.1155/2008/276846 fatcat:xuvedqy5xjbmtgnaryj3zyuhny

Real-Time Audio-Visual Analysis for Multiperson Videoconferencing

Petr Motlicek, Stefan Duffner, Danil Korchagin, Hervé Bourlard, Carl Scheffler, Jean-Marc Odobez, Giovanni Del Galdo, Markus Kallinger, Oliver Thiergart
2013 Advances in Multimedia  
They comprise continuous localisation of audio objects and its application for spatial audio object coding, detection, and tracking of faces, estimation of head poses and visual focus of attention, detection  ...  and localisation of verbal and paralinguistic events, and the association and fusion of these different events.  ...  Acknowledgment The research leading to these results has received funding from the European Community's 7th Framework Programme ICT Integrating Projects TA2 (Grant agreement no. 214793).  ... 
doi:10.1155/2013/175745 fatcat:izfdlmjwxrdxxjmys3bhmovbdy

Pedestrian localisation for indoor environments

Oliver Woodman, Robert Harle
2008 Proceedings of the 10th international conference on Ubiquitous computing - UbiComp '08  
This paper looks at how a foot-mounted inertial unit, a detailed building model, and a particle filter can be combined to provide absolute positioning, despite the presence of drift in the inertial unit  ...  Our results show that we can track a user throughout a 8725 m 2 building spanning three floors to within 0.5 m 75% of the time, and to within 0.73 m 95% of the time.  ...  Acknowledgements The authors would like to thank Andy Hopper for his insightful comments. This work has been funded by EPSRC.  ... 
doi:10.1145/1409635.1409651 dblp:conf/huc/WoodmanH08 fatcat:b4zlftaasrfubhysbl65xzewnu

Target tracking in urban environments using audio-video signal processing in heterogeneous wireless sensor networks

Manish Kushwaha, Songhwai Oh, Isaac Amundson, Xenofon Koutsoukos, Akos Ledeczi
2008 2008 42nd Asilomar Conference on Signals, Systems and Computers  
Our system uses acoustic beamforming and motion detection for audio and video sensors, respectively. We also employ MCMCDA algorithm for data association and tracking.  ...  In this paper, we describe an approach for target tracking in urban environments utilizing a wireless HSN of mote class devices equipped with acoustic sensor boards and embedded PCs equipped with web cameras  ...  Work in multimodal target tracking and multimodal sensor fusion using audio-video data includes object localization and tracking based on Kalman filtering [24] as well as particle filtering approaches  ... 
doi:10.1109/acssc.2008.5074694 fatcat:ylk3gau4pnc7hlpy54r4e5trpe

Topology-Based Analysis for Multimodal Atmospheric Data of Volcano Eruptions [chapter]

Alexander Kuhn, Wito Engelke, Markus Flatken, Hans-Christian Hege, Ingrid Hotz
2017 Mathematics and Visualization  
The data sets comprise observation and imaging data from satellites as well as results from numerical particle simulations.  ...  Effectively combining and analyzing such multimodal and partially incomplete data of limited accuracy in an integrated way is challenging.  ...  This work was funded by the German Federal Ministry of Education and Research under grant number 01LK1213A and by the European Union Framework Programme FP7 under grant agreement number 607177.  ... 
doi:10.1007/978-3-319-44684-4_2 fatcat:mwi7cvlff5cafmtk6dxkwu3fqq

Event Tactic Analysis Based on Broadcast Sports Video

Guangyu Zhu, Changsheng Xu, Qingming Huang, Yong Rui, Shuqiang Jiang, Wen Gao, Hongxun Yao
2009 IEEE transactions on multimedia  
Based on the multi-object trajectories tracked in the shot, a weighted graph is constructed via the analysis of temporal-spatial interaction among the players and the ball.  ...  For a detected event, two tactic representations, aggregate trajectory and play region sequence, are constructed based on multi-object trajectories and field locations in the event shots.  ...  Once the ball is detected, the tracking procedure based on SVR particle filter and template matching is started. SVR particle filter and the template are initialized using detection results.  ... 
doi:10.1109/tmm.2008.2008918 fatcat:sxpny4cbgbbznbsy4aejchynmu

A mixture regularized rao-blackwellized particle filter for terrain positioning

Achille Murangira, Christian Musso, Karim Dahia
2016 IEEE Transactions on Aerospace and Electronic Systems  
This study is concerned with the development of a robust particle filtering algorithm tailored to the problem of terrain aided positioning (TAP) via radaraltimeter measurements.  ...  In this article, we propose a particle filtering importance sampling method adapted to multimodal distributions.  ...  His main research interests are estimation, tracking, detection and Monte Carlo methods for nonlinear filtering and for optimization.  ... 
doi:10.1109/taes.2016.150089 fatcat:j253m3pfvzf4hfys4s2jafipa4
« Previous Showing results 1 — 15 out of 4,116 results