1,962 Hits in 3.4 sec

Streaming Linear System Identification with Reverse Experience Replay [article]

Prateek Jain, Suhas S Kowshik, Dheeraj Nagaraj, Praneeth Netrapalli
2021 arXiv   pre-print
In this work, we propose a novel streaming algorithm, SGD with Reverse Experience Replay (𝖲𝖦𝖣-𝖱𝖤𝖱), that is inspired by the experience replay (ER) technique popular in the RL literature.  ...  Furthermore, 𝖲𝖦𝖣-𝖱𝖤𝖱 can be applied to more general settings like sparse LTI identification with known sparsity pattern, and non-linear dynamical systems.  ...  In this work, we propose reverse experience replay for linear system identification.  ... 
arXiv:2103.05896v3 fatcat:rpitlvth5rhh7acvrs7wojtch4

Real-time classification of experience-related ensemble spiking patterns for closed-loop applications

Davide Ciliberti, Frédéric Michon, Fabian Kloosterman
2018 eLife  
Our system decodes multi-neuronal patterns at 10 ms resolution, identifies within 50 ms experience-related patterns with over 70% sensitivity and specificity, and classifies their content with 95% accuracy  ...  To bridge this gap, we developed a system for classifying ensemble patterns in a closed-loop setting and demonstrated its application in the online identification of hippocampal neuronal replay sequences  ...  In conclusion, we successfully bridged the gap between the basic formulation of online replay identification algorithms and an actual experiment-ready system that addresses the challenges associated with  ... 
doi:10.7554/elife.36275 fatcat:awmmtgozsjagrjgip55pdyw4sq

Pressurized Pepsin Digestion in Proteomics

Daniel López-Ferrer, Konstantinos Petritis, Errol W. Robinson, Kim K. Hixson, Zhixin Tian, Jung Hwa Lee, Sang-Won Lee, Nikola Tolić, Karl K. Weitz, Mikhail E. Belov, Richard D. Smith, Ljiljana Paša-Tolić
2010 Molecular & Cellular Proteomics  
proteomics experiments.  ...  LC system referred to as a fast on-line digestion system (FOLDS).  ...  experiments but with a design modification to our reactor to handle low flow rates, low sample concentrations, and incorporation of a RePlay system (24) .  ... 
doi:10.1074/mcp.m110.001479 pmid:20627868 pmcid:PMC3033671 fatcat:lge5lvhecng2fbtzgh4ln6ijiu

A Tool to Simulate the Transmission, Reception, and Execution of Interactive TV Applications

Manoel Carvalho Marques Neto, Raoni Kulesza, Thiago Rodrigues, Felipe A. L. Machado, Celso A. S. Santos
2017 International Scholarly Research Notices  
It allows simulating the transmission of interactive content along with the linear TV program (simulating the transmission of content over the air and in broadcast to the receivers).  ...  Among these opportunities we can highlight interactive contents that run together with linear TV program (television service where the viewer has to watch a scheduled TV program at the particular time  ...  Thus, the videos with replays used in this experiment are already edited and stored on disk.  ... 
doi:10.1155/2017/1834907 pmid:28280770 pmcid:PMC5326679 fatcat:han3ue57wfbapdlyxj7yshs34y

Peeling Away Layers of an RFID Security System [chapter]

Henryk Plötz, Karsten Nohl
2012 Lecture Notes in Computer Science  
This paper details how the algorithms were found from opening silicon chips as well as interacting with tags and readers.  ...  The Legic Prime system uses proprietary RFIDs to secure building access and micropayment applications. The employed algorithms rely on obscurity and consequently did not withstand scrutiny.  ...  Completely replaying frames worked flawlessly (as long as the timing of the original trace was followed precisely), so next we experimented with changing single bits in the main phase of the replayed traces  ... 
doi:10.1007/978-3-642-27576-0_17 fatcat:kwqlorwbynej7bcbksycflqqoy

Cued Memory Reactivation During SWS Abolishes the Beneficial Effect of Sleep on Abstraction

Nora Hennies, Matthew A Lambon Ralph, Simon J Durrant, James N Cousins, Penelope A Lewis
2017 Sleep  
In different groups, the exposure stream was replayed during SWS in the night between the recall sessions (SWS-replay group), in wake just before sleep (pre-sleep replay group), or not at all (control  ...  Importantly, sleep structure and sleep quality did not differ between groups, suggesting that replay during SWS did not impair sleep, but rather disrupted or interfered with sleep-dependent mechanisms  ...  Surprisingly, however, the replay before sleep also had an interfering effect and reversed the association with SWS.  ... 
doi:10.1093/sleep/zsx102 pmid:28821209 fatcat:gqihe7mz7nfmvdwhh24cvttt3e

PipeNet: Selective Modal Pipeline of Fusion Network for Multi-Modal Face Anti-Spoofing [article]

Qing Yang, Xia Zhu, Jong-Kae Fwu, Yun Ye, Ganmei You, Yuan Zhu
2020 arXiv   pre-print
In this paper, we propose a novel pipeline-based multi-stream CNN architecture called PipeNet for multi-modal face anti-spoofing.  ...  Our final submission achieves the Average Classification Error Rate (ACER) of 2.21 with Standard Deviation of 1.26 on the test set.  ...  3.67e-6 N/A N/A Disorder 3.00e-6 N/A N/A Original 6.74e-5 N/A 0.0005 Video Replay Reverse 5.06e-5 N/A 0.0002 Disorder 5.64e-5 N/A 0.0002 3D Print Mask Original 0.0968 N/A N/A Reverse  ... 
arXiv:2004.11744v1 fatcat:xcz6k5h3cvce5k2h6ikpyxtot4

Closed-Loop Control of Active Sensing Movements Regulates Sensory Slip [article]

Debojyoti Biswas, Luke A Arend, Sarah A Stamper, Balázs P Vágvölgyi, Eric S Fortune, Noah J Cowan
2018 bioRxiv   pre-print
This system modulates the gain of reafferent feedback by adjusting the position of a refuge based on real-time videographic measurements of fish position.  ...  We performed two categories of experiments, augmented feedback experiments and open-loop replay experiments.  ...  A task-level model for optomotor yaw regulation in Drosophila melanogaster: A frequency-domain system identification approach. In Proc. IEEE Conf. Dec. Control, pages 3721-3726. 56.  ... 
doi:10.1101/366609 fatcat:6zuxcjrw6vgs3jyx7vbmvhntv4

Pupillometry in auditory multistability

Jan Grenzebach, Thomas G. G. Wegner, Wolfgang Einhäuser, Alexandra Bendixen, Christoph W. Korn
2021 PLoS ONE  
streaming.  ...  When participants instead responded to actual stimulus changes that closely mimicked the multistable perceptual experience ("replay condition"), the pupil dilated more around such responses than in multistability  ...  Identification of each replayed percept and mapping to the correct button was practiced in training blocks before the first block of the replay condition (i.e., before block 3 of the experiment).  ... 
doi:10.1371/journal.pone.0252370 pmid:34086770 fatcat:gs6wjaudgvdufawd76uy4knoue

Reversely Discovering and Modifying Properties Based on Active Deep Q-Learning

Yu Lei, Huo Zhifa
2020 IEEE Access  
Prioritized experience replay uses weighted sampling of replay buffer to replace the uniform sampling of conventional DQN.  ...  The TD loss is: L(θ) = ( r + γ × Q(s ′ , argmax ′ ∈ Q(s ′ , a ′ ; θ); θ ̅ ) −Q(s, a; θ) ) 2 (2) 2) PRIORITIZED EXPERIENCE REPLAY: Prioritized experience replay samples more frequently those transitions  ... 
doi:10.1109/access.2020.3019278 fatcat:vbcdj2zsnzaxpcbu3uae2awz4e

On the Evolution of Subjective Experience [article]

Jerome A. Feldman
2021 arXiv   pre-print
The core issue is the incompatibility of objective (3rd person) public science with subjective (1st person) private experience.  ...  People exhibit the same phenomena, but there are remaining mysteries of everyday experience that are demonstrably incompatible with current neuroscience.  ...  The core problem is still the gap between 3 rd person objective science and subjective, agent-centered experience.  ... 
arXiv:2008.08073v2 fatcat:edrailue2jconehvksfxgt572e

An Adaptive IO Prefetching Approach for Virtualized Data Centers

Ron C. Chiang, Ahsen J. Uppal, H. Howie Huang
2017 IEEE Transactions on Services Computing  
We have implemented a real system in Linux and evaluated it on different storage devices with the virtualization layer.  ...  The proposed method improves virtual I/O performance up to 43% with the average of 14% for 1 to 12 VMs while running various applications on a Xen virtualization system.  ...  (a) Experiments with various numbers of VMs; (b) Experiments with different numbers of in-guest processes; (c) Experiments with multiple VMs and mixed workload types; (d) Experiments with multiple in-guest  ... 
doi:10.1109/tsc.2015.2469295 fatcat:u6ujp2w5ljd6nctwv3y3e26aiq

Catching Remote Administration Trojans (RATs)

Zhongqiang Chen, Peter Wei, Alex Delis
2008 Software, Practice & Experience  
While interacting with a RAT server, an attacker can record keystrokes, intercept passwords, manipulate file systems, and usurp resources of victim systems [43] .  ...  The polymorphic nature and parasitic mechanisms of RATs render their identification a challenge even if we seek specific and known types of Trojans [11, 12, 2, 43] .  ...  We also thank Qinghong Yi, Gary Duan, Ping Wu, Joe Zhu, Yelin Guan, and Hong Huang for helping us with various aspects of the RAT Catcher implementation and testing and Prof.  ... 
doi:10.1002/spe.837 fatcat:nfpvzj6lavb5pcr4e6lkt7dcya

On the detection of custom memory allocators in C binaries

Xi Chen, Asia Slowinska, Herbert Bos
2015 Empirical Software Engineering  
Our system uses dynamic analysis and detects memory allocation and deallocation routines by searching for functions that comply with a set of generic characteristics of allocators and deallocators.  ...  As we show, we can furnish existing reverse engineering tools with detailed information about the memory management API, and as a result perform an analysis of the actual application specific data structures  ...  This issue can be solved with a more careful implementation. (It did not pose a problem in our experiments.) Identification of the buffers released with a c free routine.  ... 
doi:10.1007/s10664-015-9362-z fatcat:ja4vzufh6bgvfcnkuuojsm7cjq

Online Target Q-learning with Reverse Experience Replay: Efficiently finding the Optimal Policy for Linear MDPs [article]

Naman Agarwal, Syomantak Chaudhuri, Prateek Jain, Dheeraj Nagaraj, Praneeth Netrapalli
2021 arXiv   pre-print
By carefully combining Q-learning with OTL and reverse experience replay (RER) (a form of experience replay), we present novel methods Q-Rex and Q-RexDaRe (Q-Rex + data reuse).  ...  (online target learning, or OTL) , and (ii) experience replay (ER) (Mnih et al., 2015).  ...  Experience Replay and Reverse Experience Replay Reinforcement learning involves learning on-the-go with Markovian data, which are highly correlated.  ... 
arXiv:2110.08440v2 fatcat:6jlqjmydtbfcdclybj7q76siha
« Previous Showing results 1 — 15 out of 1,962 results