99 Hits in 6.5 sec

Hand Gesture Classification using Inaudible Sound with Ensemble Method

Jinwon Cheon, Sunwoong Choi
2020 Advances in Science, Technology and Engineering Systems  
We convert the sound using Short-Time Fourier Transform to magnitude and phase. We trained two types of data on Convolutional Neural Network model.  ...  This study classifies hand gestures by creating sound in the inaudible frequency range from a smartphone and analyzing the reflected signals.  ...  There are several methods to analyze a signal into time and frequency domain, among them, we analyzed the signal using the Short-Time Fourier Transform (STFT) [5] .  ... 
doi:10.25046/aj0506115 fatcat:ddtn672zbnd7zfwt4mpjeduyiu

Gestures Recognition from Sound Waves

Nguyen Dang Binh
2016 EAI Endorsed Transactions on Context-aware Systems and Applications  
The main contribution of this paper is to recognize gestures based on the analysis of short-time Fourier transforms (STFT) using the Doppler effect to sense gestures.  ...  We propose a new method to recognize gestures from sound waves.  ...  The basic idea is to recognize gestures based on the analysis of short-time Fourier transforms (STFT).  ... 
doi:10.4108/eai.12-9-2016.151679 fatcat:5tjxmau4fbhdzicyvd3vf4a5a4

A Survey on Human Behavior Recognition Using Smartphone-based Ultrasonic Signal

Zhengjie Wang, Yushan Hou, Kangkang Jiang, Chengming Zhang, Wenwen Dou, Zehua Huang, Yinjing Guo
2019 IEEE Access  
Afterward, according to the purpose of these applications, we classify them into five groups and compare them in detail including hand gesture recognition, activity recognition, hand trajectory tracking  ...  Then, we introduce the fundamental principle of human behavior recognition based on ultrasound signals.  ...  This system utilizes a sliding time window and short-time Fourier transform (STFT) to implement the above procedures.  ... 
doi:10.1109/access.2019.2931088 fatcat:ajuq6a4cr5coxjxfompyd5xnpe

Collocated Multi-user Gestural Interactions with Unmodified Wearable Devices

Mihai Bâce, Sander Staal, Gábor Sörös, Giorgio Corbellini
2017 Augmented Human Research  
The proximity of users and devices is detected through acoustic ranging using inaudible signals, while in-air hand gestures are recognized from threeaxis accelerometers.  ...  Many real-life scenarios can benefit from both physical proximity and natural gesture interaction. In this paper, we explore shared collocated interactions on unmodified wearable devices.  ...  Gesture Recognition via Motion Sensors We presented a method based on DTW to recognize hand gestures as user input modality.  ... 
doi:10.1007/s41133-017-0009-z fatcat:smogzadyenagdicjrioikvctgq

Hand Gesture Recognition Based on Active Ultrasonic Sensing of Smartphone: A Survey

Zhengjie Wang, Yushan Hou, Kangkang Jiang, Wenwen Dou, Chengming Zhang, Zehua Huang, Yinjing Guo
2019 IEEE Access  
Firstly, we review the existing research of hand gesture recognition based on acoustic signals.  ...  Finally, we conclude by discussing the challenges, insight, and open issues involved in hand gesture recognition based on ultrasonic signal of the smartphone.  ...  After obtaining the echoes, EchoWrite first transforms the time domain data into frequency domain data by performing short-time Fourier transform (STFT).  ... 
doi:10.1109/access.2019.2933987 fatcat:icxpcfs6nva2pjict6jqoggnt4

Ubiquitous Acoustic Sensing on Commodity IoT Devices: A Survey [article]

Chao Cai, Rong Zheng, Jun Luo
2021 arXiv   pre-print
Finally, research opportunities and future directions are discussed to spawn further in-depth investigation on acoustic sensing.  ...  With the proliferation of Internet-of-Things devices, acoustic sensing attracts much attention in recent years.  ...  The waveform and its Short Time Fourier Transform (STFT) spectrogram of a single tone signal are shown in Fig. 5 (a) and 5(b), respectively.  ... 
arXiv:1901.03450v2 fatcat:h6a2eyhjhzejfmyld5ahx23gmi

EchoLock: Towards Low Effort Mobile User Identification [article]

Yilin Yang, Chen Wang, Yingying Chen, Yan Wang
2020 arXiv   pre-print
These acoustic signals produce distinct structure-borne sound reflections when contacting the user's hand, which can be used to differentiate between different people based on how they hold their mobile  ...  sizes, holding strength, and gesture.  ...  For example, existing works show that it is possible to identify a user based on finger gestures on the touch screen [28, 29, 26] , hand gestures in the air [20] , finger input on any solid surface  ... 
arXiv:2003.09061v2 fatcat:dkgpouzfrnbijhlon4enqbvlx4

Deep Room Recognition Using Inaudible Echos [article]

Qun Song, Chaojie Gu, Rui Tan
2018 arXiv   pre-print
Compared with the state-of-the-art approaches based on support vector machine, RoomRecognize significantly improves the Pareto frontier of recognition accuracy versus robustness against interfering sounds  ...  However, the short-time and narrowband audio signal carries limited information about the room's characteristics, presenting challenges to accurate room recognition.  ...  We acknowledge the support of NVIDIA Corporation with the donation of the Quadro P5000 GPU used in this research.  ... 
arXiv:1809.00531v2 fatcat:prv26marpnbpbezu6ew577gkxq

ParaSight: Enabling Privacy-preserving Sensing Data Sharing via Device-to-device Utterance-based Communication

Youngwook Do, Seong-Eun Moon, Minsuk Chang
2022 CHI Conference on Human Factors in Computing Systems Extended Abstracts  
(a) End-users often fail to indicate when and which data are being communicated as existing smart home devices use invisible and inaudible data communications.  ...  Also, we are grateful to John Joon Young Chung, Hee-Seung Moon, Soyoung Kang, Nahyeon Ryu, Wonjae Kim, Wooseok Kim, and members of Naver AI Lab for their feedback to help shape our research direction and  ...  Second, a user can command a voice agent with other types of input including hand gestures as well as speech input.  ... 
doi:10.1145/3491101.3519757 fatcat:ka7waw7rljgr5hkettguphfpry

3D Gestural Interaction: The State of the Field

Joseph J. LaViola
2013 ISRN Artificial Intelligence  
In this paper, we examine the state of the field of 3D gestural interfaces by presenting the latest strategies on how to collect the raw 3D gesture data from the user and how to accurately analyze this  ...  3D gestural interaction provides a powerful and natural way to interact with computers using the hands and body for a variety of different applications including video games, training and simulation, and  ...  Hsieh et al. took a similar approach for hand gesture recognition but used the discrete Fourier transform (DFT) coupled with the Camshift algorithm and boundary detection to extract the features used as  ... 
doi:10.1155/2013/514641 fatcat:rzkdndomfjaqzew3fham47554u

SonarSnoop: Active Acoustic Side-Channel Attacks [article]

Peng Cheng, Ibrahim Ethem Bagci, Utz Roedig, Jeff Yan
2018 arXiv   pre-print
Speakers are used to emit human inaudible acoustic signals and the echo is recorded via microphones, turning the acoustic system of a smart phone into a sonar system.  ...  Overall, our work highlights a new family of security threats.  ...  The 128sample time domain signal is generated using the Inverse Fast Fourier transform (IFFT). The real part is divided in half, and the first half used as the signal.  ... 
arXiv:1808.10250v1 fatcat:ttdthkglf5arli4frpe4jt5gku

SonarSnoop: active acoustic side-channel attacks

Peng Cheng, Ibrahim Ethem Bagci, Utz Roedig, Jeff Yan
2019 International Journal of Information Security  
Speakers are used to emit human inaudible acoustic signals, and the echo is recorded via microphones, turning the acoustic system of a smart phone into a sonar system.  ...  Overall, our work highlights a new family of security threats.  ...  This article does not contain any studies with animals performed by any of the authors. Informed consent Informed consent was obtained from all individual participants included in the study.  ... 
doi:10.1007/s10207-019-00449-8 fatcat:jfxslizj6rap3arkk3macsftmu

Overview [chapter]

2013 Musical Signal Processing  
The most famous, the short-time Fourier transform gives a short-time spectrum, that is a series of spectra taken on succes sive temporal frames.  ...  The short-time discrete Fourier transform (STFT) overcomes this by giving a time-dependent version of the discrete Fourier transform.  ...  Leman is based on a type of representation which is both subsymbolic and analogical. On the other hand, the HARP system developed by A.  ... 
doi:10.4324/9781315078120-11 fatcat:rylq5og6njbqbhe6idh2n7nksy

A Survey on CSI-based Human Behavior Recognition in Through-the-Wall Scenario

Zhengjie Wang, Kangkang Jiang, Yushan Hou, Zehua Huang, Wenwen Dou, Chengming Zhang, Yinjing Guo
2019 IEEE Access  
This paper presents a survey on the stateof-art progresses in device-free through-the-wall human behavior recognition based on CSI.  ...  Among these encouraging implementations, device-free behavior recognition based on WiFi channel state information (CSI) has attracted significant attention due to the popularity of WiFi devices and abundant  ...  Similarly, we can also get the statistical results based on the frequency domain data after Fast Fourier transformation (FFT) of time domain data.  ... 
doi:10.1109/access.2019.2922244 fatcat:lofr7xfuufgbranwrofa4qdy7u

From musical analysis to musical expression

Oscar Mayor, Xavier Serra
2003 Zenodo  
research and some topics on musical performance analysis.  ...  In the first part, a state of the art of each of the topics I have been involved in is presented, from audio identification to musical instrument synthesis, including tempo tracking and rhythm perception  ...  Acknowledgements I would like to thank Professor Xavier Serra, my thesis director and also director of the Music Technology Group, I would like also to give an acknowledgement to all my workmates at the  ... 
doi:10.5281/zenodo.3739258 fatcat:sv4sx3lcsbejjltlhobmysdaza
« Previous Showing results 1 — 15 out of 99 results