74,400 Hits in 7.3 sec

Uncertainty in Rank-Biased Precision

Laurence A. F. Park
2016 Proceedings of the 21st Australasian Document Computing Symposium on ZZZ - ADCS '16  
Information retrieval metrics that provide uncertainty intervals when faced with unjudged documents, such as Rank-Biased Precision (RBP), provide us with an indication of the upper and lower bound of the  ...  In this article, we examine the distribution of the uncertainty per query and averaged over all queries, under the assumption that each unjudged document has the same probability of being relevant.  ...  ADCS UNCERTAINTY IN RBP Rank-biased precision [2] is an Information Retrieval evaluation function that assigns a score contribution based on the position of each relevant document in a ranking, where  ... 
doi:10.1145/3015022.3015029 fatcat:afvyrpfk3zf4va2uu6hmlpplky

Rank-biased precision for measurement of retrieval effectiveness

Alistair Moffat, Justin Zobel
2008 ACM Transactions on Information Systems  
In this article, we introduce a new effectiveness metric, rank-biased precision, that avoids these problems.  ...  Rank-biased precision is derived from a simple model of user behavior, is robust if answer rankings are extended to greater depths, and allows accurate quantification of experimental uncertainty, even  ...  In this article, we introduce a new metric, rank-biased precision (RBP), that avoids many of the failings of average precision.  ... 
doi:10.1145/1416950.1416952 fatcat:qpe7245dgfelvn5hwnjrjyuiuq

Numerical comparisons between Bayesian and frequentist low-rank matrix completion: estimation accuracy and uncertainty quantification [article]

The Tien Mai
2021 arXiv   pre-print
In this paper we perform a numerious numerical studies for the problem of low-rank matrix completion.  ...  Moreover, Bayesian approaches are much more stable and can outperform the de-biased estimator in the case of small samples.  ...  More precisely, we report the 95% confidence intervals for the de-biased method.  ... 
arXiv:2103.11749v1 fatcat:diwl2x42ijglzh4tbnawllapyy

Methodology and issues of integral experiments selection for nuclear data validation

Ivanova Tatiana, Evgeny Ivanov, Ian Hill, A. Plompen, F.-J. Hambsch, P. Schillebeeckx, W. Mondelaers, J. Heyse, S. Kopecky, P. Siegler, S. Oberstedt
2017 EPJ Web of Conferences  
The approach is based on well-known General Linear Least Squared Method (GLLSM) extended to establish biases and uncertainties for given cross sections (within a given energy interval).  ...  The statistical treatment results in a vector of weighting factors for the integral benchmarks.  ...  We thank our colleagues from different institutes and countries who participating in the Sub-group provided insight and expertise that greatly assisted the research, although they may not agree with all  ... 
doi:10.1051/epjconf/201714606002 fatcat:w3n3szdfwfd4dhi55li6ocoeva

Agreement was moderate between data-based and opinion-based assessments of biases affecting randomised trials within meta-analyses

Rebecca M. Turner, Kirsty M. Rhodes, Hayley E. Jones, Julian Higgins, Jess Haskins, Penny Whiting, Asbjørn Hróbjartsson, Debbi Caldwell, Richard Morris, Barney C. Reeves, Helen Worthington, Isabelle Boutron (+1 others)
2020 Journal of Clinical Epidemiology  
We found moderate agreement between opinion and data-based evidence in pairs where assessors ranked one trial as more biased.  ...  Assessors judged trials to be equally biased in 68% of pairs evaluated.  ...  among trial pairs in which assessors ranked one trial as more biased.  ... 
doi:10.1016/j.jclinepi.2020.05.009 pmid:32416338 pmcid:PMC7482431 fatcat:zrk24ff7kjd4pkralseljtphf4

The Effect of Phylogenetic Uncertainty and Imputation on EDGE Scores [article]

K. Bodie Weedop, Arne O. Mooers, Caroline M. Tucker, William D. Pearse
2018 bioRxiv   pre-print
On the basis of these results, we provide clear guidance for EDGE scoring in the face of phylogenetic uncertainty.  ...  We find that the EDGE ranking for species on a tree is remarkably robust to missing species from that tree, but that phylogenetic imputation for missing species, while unbiased, does not accurately reconstruct  ...  This uncertainty has, indeed, already been shown to affect EDGE scores and 267 rankings (Pearse et al., 2015).  ... 
doi:10.1101/375246 fatcat:z3t3m2ii3vecvkgzq26druzi5i

On Zero Point Calibration of the Red Giant Branch Tip in the Magellanic Clouds [article]

Taylor J. Hoyt
2021 arXiv   pre-print
It is shown that TRGB measurements made in star-forming regions, with concomitantly high quantities of gas and dust, are less precise and biased to fainter magnitudes, as compared to the same measurements  ...  made in quiescent regions.  ...  driven by systematic biases in literature measurements and subsequently underestimated uncertainties.  ... 
arXiv:2106.13337v1 fatcat:hinwdapvp5f2znctctz776elqe

Variance Component Estimation in Performance Characteristics Applied to Feature Extraction Procedures [chapter]

Marc Luxen
2003 Lecture Notes in Computer Science  
This paper proposes variance component estimation (VCE) for empirical quality evaluation in computer vision. An outline is given for the scope of VCE in the context of quality evaluation.  ...  Ground truth is only partly needed for estimating the precision, accuracy and bias of extracted points and straight lines. The results of diverse feature extraction modules are compared.  ...  Fig. 5 . 5 Noise dependence of precision, accuracy and bias of lines from FEX and from the Schickler-Operator. Top row: Uncertainty in line direction Left: Precisionσ φ . Center: Accuracy aσ φ .  ... 
doi:10.1007/978-3-540-45243-0_64 fatcat:p4eyi6cdpbg45fmvx442f37e3y

Sources of bias and uncertainty in a visual temporal individuation task

Paolo Martini
2012 Attention, Perception & Psychophysics  
In addition to variability in temporal coding, observers' choices are also limited by a number of other factors, such as categorical errors and biases related to the position of the cue in the letters'  ...  Attentional filtering improves categorization, but crucially, it does not seem to increase the temporal precision of judgment.  ...  In this case, report accuracy and precision will depend entirely on the observer's uncertainty in mutually localizing in time the cue and the letters.  ... 
doi:10.3758/s13414-012-0384-y pmid:23143914 fatcat:tvpvxlwzrrf65fcmi4wlpbizvq

Dempster-Shafer Theory for a Query-Biased Combination of Evidence on the Web

Vassilis Plachouras, Iadh Ounis
2005 Information retrieval (Boston)  
The query-biased mechanism is based on the query scope, a measure of the query specificity.  ...  This paper reports on a large-scale experiment for the evaluation of a formal query-biased combination of evidence mechanism.  ...  The idea is to optimise the measures of uncertainty m c (Θ) and m l (Θ), so that we obtain the best combined ranking of the two initial sources of evidence.  ... 
doi:10.1007/s10791-005-5659-7 fatcat:laishsj7rrcm3leqaxm54qkmoa

Uncertainty-aware Gait-based Age Estimation and Its Applications

Chi Xu, Atsuya Sakata, Yasushi Makihara, Noriko Takemura, Daigo Muramatsu, Yasushi Yagi, Jianfeng Lu
2021 IEEE Transactions on Biometrics Behavior and Identity Science  
Moreover, we demonstrated the effectiveness of the uncertainty-aware framework in applications to person search and people counting through experiments on the database.  ...  methods in terms of age estimation accuracy.  ...  drawn using pairs of precision and recall over ranks.  ... 
doi:10.1109/tbiom.2021.3080300 fatcat:4az7xhgmkbemxac7du5dnqaws4

A Cognitive Decision Tool To Optimise Integrated Weed Management

S K Devitt, T Perez, D Polson, T Pearce, R Quagliata, W Taylor, D Thornby, J Beekhuyzen
2017 Zenodo  
However, weed management can be daunting and uncertain leading to biased, avoidant or suboptimal decisions.  ...  in temperature and rainfall.  ...  The team also acknowledges the Women in Research QUT fund that allowed the first author to present at the conference.  ... 
doi:10.5281/zenodo.895617 fatcat:saqtfxwhengklngpvzuwsb7h34

Rethinking the Ranks of Visual Channels [article]

Caitlyn M. McColeman, Fumeng Yang, Steven Franconeri, Timothy F. Brady
2021 arXiv   pre-print
With a Bayesian multilevel modeling approach, we observed how the relevant rank positions of visual channels shift across different numbers of marks (2, 4 or 8) and for bias, precision, and error measures  ...  The ranking did not hold, even for reproductions of only 2 marks, and the new ranking was highly inconsistent for reproductions of different numbers of marks.  ...  In the spirit of rethinking the previous ranks and in the context of Bayesian statistics, we will derive probabilistic ranks that acknowledge the uncertainty in the observations and the modeling processes  ... 
arXiv:2107.11367v1 fatcat:t5my6mz2bngx7eimvh2gf67j4y

Estimating tropical tree diversity indices from forestry surveys: A method to integrate taxonomic uncertainty

Stéphane Guitet, Daniel Sabatier, Olivier Brunaux, Bruno Hérault, Mélaine Aubry-Kientz, Jean-François Molino, Christopher Baraloto
2014 Forest Ecology and Management  
We developed and tested a novel approach to evaluate taxonomic reliability of forestry surveys and to propagate the resulting uncertainty in the estimates of several diversity indicators (alpha and beta  ...  We obtained a robust ranking of sites consistent with those shown by botanical inventories.  ...  Nevertheless, errors and biases need to be better understood in order to control uncertainties associated with these kinds of data.  ... 
doi:10.1016/j.foreco.2014.05.045 fatcat:fif7rtd77bcxhgk2ogdcejnd4u

A Perceptual Inference Mechanism for Hallucinations Linked to Striatal Dopamine

Clifford M. Cassidy, Peter D. Balsam, Jodi J. Weinstein, Rachel J. Rosengard, Mark Slifstein, Nathaniel D. Daw, Anissa Abi-Dargham, Guillermo Horga
2018 Current Biology  
tracking environmental uncertainty.  ...  the perceived duration of auditory stimuli under different levels of uncertainty.  ...  precision of predictions, thus failing to dampen perceptual biases towards expected sensory states under higher uncertainty (i.e. they show reduced uncertainty adjustment consistent with the hypothesized  ... 
doi:10.1016/j.cub.2017.12.059 pmid:29398218 pmcid:PMC5820222 fatcat:3q3rcg2ljnembc7izroraofjoa
« Previous Showing results 1 — 15 out of 74,400 results