Filters








3,947,339 Hits in 6.7 sec

On Processing Extreme Data

Dana Petcu, Gabriel Iuhasz, Daniel Pop, Domenico Talia, Jesus Carretero, Radu Prodan, Thomas Fahringer, Ivan Grasso, Ramon Doallo, Maria J. Martin, Basilio B. Fraguela, Roman Trobec (+11 others)
2016 Scalable Computing : Practice and Experience  
for data access, data communication and data processing on groups of cores.  ...  We provided in this paper a roadmap to reach the extreme-scale level in data processing.  ... 
doi:10.12694/scpe.v16i4.1134 fatcat:yibmtpz5szgudgocgoojodhjc4

On the Processing of Extreme Scale Datasets in the Geosciences [chapter]

Sangmi Lee Pallickara, Matthew Malensek, Shrideep Pallickara
2011 Handbook of Data Intensive Computing  
This section describes data processes used for knowledge discovery in the geosciences research based on the characteristics of each process.  ...  For example, many filters specify limits on the amount of data being processed in their contracts. VisIt uses two approaches for rendering.  ... 
doi:10.1007/978-1-4614-1415-5_20 fatcat:iz6q2gvk3rhvblekprn7e4lxcq

Quality Control Methods in Accelerometer Data Processing: Identifying Extreme Counts

Carly Rich, Marco Geraci, Lucy Griffiths, Francesco Sera, Carol Dezateux, Mario Cortina-Borja, Susanne Breuer Votruba
2014 PLoS ONE  
Conclusions: Quality control processes should be undertaken during accelerometer fieldwork and prior to analysing data to identify monitors recording error values and EHCV.  ...  Accelerometers are designed to measure plausible human activity, however extremely high count values (EHCV) have been recorded in large-scale studies.  ...  Acknowledgments The hard work of the accelerometer data collection team (Jane Ahn, Florence Kinnafick and Richard Pulsford) is gratefully acknowledged.  ... 
doi:10.1371/journal.pone.0085134 pmid:24454804 pmcid:PMC3890298 fatcat:5ibnhbepybfepkw4nyodpl22yq

A Simple and Effective Scheme for Data Pre-processing in Extreme Classification

Sujay Khandagale, Rohit Babbar
2019 The European Symposium on Artificial Neural Networks  
In this paper, we propose a method for effective and well-motivated data pre-processing scheme in XMC.  ...  Extreme multi-label classification (XMC) refers to supervised multi-label learning involving hundreds of thousand or even millions of labels.  ...  The growing significance of XMC in web-scale data mining is further highlighted by dedicated workshops in premier machine learning and data mining conferences (cf. workshops on extreme classification at  ... 
dblp:conf/esann/KhandagaleB19 fatcat:xof2vgp6l5b23m4cbwyhhleo7e

Online Maritime Abnormality Detection Using Gaussian Processes and Extreme Value Theory

Mark Smith, Steven Reece, Stephen Roberts, Iead Rezek
2012 2012 IEEE 12th International Conference on Data Mining  
This paper introduces a novelty detection technique using a combination of Gaussian Processes and extreme value theory to identify anomalous behaviour in streaming data.  ...  The approach is tested on both synthetic and real data, showing itself to be effective in our primary application of maritime vessel track analysis.  ...  Gaussian Process Extreme Value Theory In much of the existing work on novelty detection using extreme value methods, the work has focused on nonsequential conditions, or more precisely, on a fixed training  ... 
doi:10.1109/icdm.2012.137 dblp:conf/icdm/SmithRRR12 fatcat:dvqqsmsivzfxrgrs6hyvoq7fqi

Evaluating accumulo performance for a scalable cyber data processing pipeline

Scott M. Sawyer, B. David O'Gwynn
2014 2014 IEEE High Performance Extreme Computing Conference (HPEC)  
Accumulo performance is measured on a database of up to 8 nodes using real cyber data.  ...  We evaluate Accumulo's ingestion scalability as a function of number of client processes and servers.  ...  Column qualifiers can also be provided through the API to perform projections on returned data. Because entries are sorted first by row ID, queries based primarily on row IDs are extremely fast.  ... 
doi:10.1109/hpec.2014.7040978 dblp:conf/hpec/SawyerO14 fatcat:sxtl2xkpnfh25b3hlwfwzwhzvi

Point process models for novelty detection on spatial point patterns and their extremes

Stijn E. Luca, Marco A.F. Pimentel, Peter J. Watkinson, David A. Clifton
2018 Computational Statistics & Data Analysis  
The proposed models are demonstrated on synthetic and real-world data sets.  ...  The use of point process models is introduced that allow us to describe the length N as well as the geometrical configuration in data space of such patterns.  ...  Extreme value theory In many applications, it is not the distribution of the bulk of data that is of interest, but rather the behaviour of the extremes.  ... 
doi:10.1016/j.csda.2018.03.019 fatcat:fvci42rju5cqbbsooycvmk4b54

Research and Application of a Hybrid Wind Energy Forecasting System Based on Data Processing and an Optimized Extreme Learning Machine

Rui Wang, Jingrui Li, Jianzhou Wang, Chengze Gao
2018 Energies  
In this paper, a hybrid forecasting system based on data preprocessing and an Extreme Learning Machine optimized by the cuckoo algorithm is proposed, which can overcome the limitations of the single ELM  ...  In the system, the standard genetic algorithm is added to reduce the dimensions of the input and utilize the time series model for error correction by focusing on the optimized extreme learning machine  ...  Extreme Learning Machine is a method, which is applied to forecast based on the processed data.  ... 
doi:10.3390/en11071712 fatcat:lmfhwthc7faopkq6dnzheuveea

Next-generation sequencing data processing: Analysis of unmapped reads and extremely high mapped peaks

Jiao Chen, ZuoLei Dai, ChangChang Cao, QianQian Zhang, HongDe Liu, Xiao Sun
2012 2012 5th International Conference on BioMedical Engineering and Informatics  
of mapped reads on the reference genome.  ...  However, during the reads mapping and data pre-analysis steps, only 40% of the sequenced reads can be mapped to the reference genome hg19 and there are some extremely high peaks (EHPs) in the profiles  ...  An extremely high peak is shown at the left edge of the centromeric region. The similar phenomenon is also observed in Anton Valouev et al.'s MNase-seq data of human T cells [5] on chromosome 1.  ... 
doi:10.1109/bmei.2012.6512933 dblp:conf/bmei/ChenDCZLS12 fatcat:7z6g6vdcw5a6lcbe3zeyapwc7a

Performance comparison of Extreme Learning Machines and other machine learning methods on WBCD data set

Omer Selim Keskin, Akif Durdu, Muhammet Fatih Aslan, Abdullah Yusefi
2021 2021 29th Signal Processing and Communications Applications Conference (SIU)  
Breast cancer is one of the most common forms of cancer among women in our country and the world.  ...  According to the results of the study, the ELM approach is more successful than other approaches on the WBCD dataset.  ...  The ELM method was used to apply the classification process to the WBCD dataset with the aid of this library.  ... 
doi:10.1109/siu53274.2021.9477984 fatcat:jry44e7rkfbzppnhtpbwxxkz6e

The Adaptive Extremal Sampling Based on a Simple Acoustic Model(Biosensors: Data Acquisition, Processing and Control)

H. Yoshida, K. Kakui, Y. Maeda, Y. Fujiwara
2009 International journal of biomedical soft computing and human sciences  
reproduction qfsound maintaining the pitch, louduess and timbre. 111ie aeoustic structure has been simply modetea in which ten partial sums of'the thurier series representing the audible sound Because one  ...  Each piece of data was processed by the finite impulse response (FIR) The ratio of the data size is equal to the reciprocal of the remaining time.  ...  Let one word be of two bytes, The fbrrner is a constant of44,lOO by 2 bytes; the latter always varies in the acoustic environment, where the extremal data consist of four-byte time and two-byte amplitude  ... 
doi:10.24466/ijbschs.14.2_27 fatcat:a56nobeplraybo64emwzhapzvm

On an Extremal Data Processing Inequality for long Markov Chains

Thomas A. Courtade, Jiantao Jiao, Tsachy Weissman
2014
proved by Oohama in his work on the quadratic Gaussian one-helper problem.  ...  We pose the following extremal conjecture: Let X, Y be jointly Gaussian random variables with linear correlation ρ.  ...  On the term "Data Processing" As the title suggests, we refer to (1) as a data processing inequality since it gives the upper bound I(Y ; U ) + I(X; V |U ) ≤ − 1 2 log 1 − ρ 2 + ρ 2 2 −2[I(X;U )+I(Y ;V  ... 
doi:10.3929/ethz-a-010094597 fatcat:l2gxzjhsanegzc6zoptwp7t3xm

Data processing on simulated data for SHARK-NIR

Elena Carolo
2017 Proceedings of the Adaptive Optics for Extremely Large Telescopes 5   unpublished
A robust post processing technique is mandatory to analyse the coronagraphic high contrast imaging data.  ...  The focus of this work is to apply these two data reduction techniques to obtain the best limit detection for each coronagraphic setting that has been simulated for the SHARK-NIR, a coronagraphic camera  ...  We are focusing on increasing the number of images to compare our simulations to the real amount of data taken during an on sky observation and also because we are confident that the post processing code  ... 
doi:10.26698/ao4elt5.0068 fatcat:kkx4jfozabbfzdzovj2ixvp32a

Data processing on simulated data for SHARK-NIR

Daniele Vassallo, Elena Carolo, Jacopo Farinato
2017 Proceedings of the Adaptive Optics for Extremely Large Telescopes 5   unpublished
A robust post processing technique is mandatory to analyse the coronagraphic high contrast imaging data.  ...  The focus of this work is to apply these two data reduction techniques to obtain the best limit detection for each coronagraphic setting that has been simulated for the SHARK-NIR, a coronagraphic camera  ...  We are focusing on increasing the number of images to compare our simulations to the real amount of data taken during an on sky observation and also because we are confident that the post processing code  ... 
doi:10.26698/ao4elt5.0134 fatcat:tbgrhanoejc3lns7mdbrydtjsq

The Digital Data Processing Unit for the HTRS on board IXO

Henning Wende
2011 Proceedings of Fast X-ray timing and spectroscopy at extreme count rates — PoS(HTRS 2011)   unpublished
The soft-and hardware for the HTRS Data Processing Unit (DPU) is being developed and will be tested in Tübingen. We give a brief overview of the HTRS and the DPU with its main components and tasks.  ...  Fast X-ray timing and spectroscopy at extreme count rates  ...  PoS(HTRS 2011)078 The Digital Data Processing Unit for the HTRS on board IXO Henning Wende PoS(HTRS 2011)078 The Digital Data Processing Unit for the HTRS on board IXO Henning Wende Channel-Bit-Width  ... 
doi:10.22323/1.122.0078 fatcat:qugggsqn7fdi5o4lybdji2whh4
« Previous Showing results 1 — 15 out of 3,947,339 results