64,719 Hits in 6.0 sec

User Evaluation of Multidimensional Relevance Assessment

Célia da Costa Pereira, Mauro Dragoni, Gabriella Pasi
2010 Italian Information Retrieval Workshop  
In this paper a user evaluation is proposed to assess the effectiveness of systems based on multidimensional relevance assessment.  ...  Then, we describe how the user evaluation has been performed, and finally, we discuss the results obtained.  ...  It is important to notice that in the case of a user-independent aggregation of the multiple relevance numeric assessments, a traditional system's evaluation could be applied.  ... 
dblp:conf/iir/PereiraDP10 fatcat:24iqqpattza75jcbyqx6djxxqe

Multidimensional Relevance in Legal and Health Domains

Georgios Peikos, Gabriella Pasi
2021 Italian Information Retrieval Workshop  
Also, several users, tasks and domain factors have been identified and assessed to estimate the "utility" of an information item with respect to the situation at hand.  ...  The purpose of this paper is to provide an overview of such situations, by identifying several user types, tasks and relevance factors in legal and health related searches.  ...  In addition, these models will be evaluated across different domain-specific and professional contexts and tasks to the aim of verifying how relevance assessment depends on specific relevance factors,  ... 
dblp:conf/iir/PeikosP21 fatcat:5gv5wayiqrhobgagqcngwgxic4

Multidimensional Relevance in Microblog Search

Divi Galih Prasetyo Putri
2019 BCS-IRSG Symposium on Future Directions in Information Access  
In Information Retrieval, the assessment of relevance is affected by multiple criteria.  ...  This doctoral research aims to understand which relevance criteria or dimensions can affect the effectiveness of Microblog search systems.  ...  assess relevance.  ... 
dblp:conf/fdia/Putri19 fatcat:4uk4fajh7jfqvk55hoebp6umlm

The concept of relevance in IR

Pia Borlund
2003 Journal of the American Society for Information Science and Technology  
This article introduces the concept of relevance as viewed and applied in the context of IR evaluation, by presenting an overview of the multidimensional and dynamic nature of the concept.  ...  The literature on relevance reveals how the relevance concept, especially in regard to the multidimensionality of relevance, is many faceted, and does not just refer to the various relevance criteria users  ...  Acknowledgments The author thanks Associate Professor Morten Hertzum (Roskilde University, Denmark) for the fruitful exchange of views with reference to the concept of relevance in IR. The  ... 
doi:10.1002/asi.10286 fatcat:7hohvvrkcfbwxmcppff6l3gmzm

Quality Assessment Criteria in Conference Interpreting from the Perspective of Loyalty Principle

2017 DEStech Transactions on Social Science Education and Human Science  
and come up with a multidimensional dynamic quality assessment mode to evaluate CI quality parameters.  ...  process, which requires interpreters to take various factors into consideration, that is, initiators, target listeners, original speakers and their respective purposes as well as the characteristics of  ...  Acknowledgements This research is sponsored by the Key Program of the English Language and Literature of Guangdong Province, 2016.  ... 
doi:10.12783/dtssehs/hsmet2017/16558 fatcat:uost7sju7nay3jlxvmyjyh6pky

Understandability Biased Evaluation for Information Retrieval [chapter]

Guido Zuccon
2016 Lecture Notes in Computer Science  
Although relevance is known to be a multidimensional concept, information retrieval measures mainly consider one dimension of relevance: topicality.  ...  In this paper we propose a method to integrate multiple dimensions of relevance in the evaluation of information retrieval systems.  ...  health search [1, 12, 13, 26, 27] ; resources exist that allow us to assess the impact of evaluating multidimensional relevance when considering understandability, both through simulations and explicit  ... 
doi:10.1007/978-3-319-30671-1_21 fatcat:t7wage5ve5a2bi5btkqatz6hae

Multidimensional relevance: Prioritized aggregation in a personalized Information Retrieval setting

Célia da Costa Pereira, Mauro Dragoni, Gabriella Pasi
2012 Information Processing & Management  
A new model for aggregating multiple criteria evaluations for relevance assessment is proposed.  ...  An Information Retrieval context is considered, where relevance is modeled as a multidimensional property of documents.  ...  The main aim of this paper is to propose and evaluate the role of prioritized aggregation schemes for multidimensional relevance assessment.  ... 
doi:10.1016/j.ipm.2011.07.001 fatcat:ai6ds6klizg7zndlgg4jcoyeye

Experimental components for the evaluation of interactive information retrieval systems

Pia Borlund
2000 Journal of Documentation  
The experimental setting consists of three components: (1) the involvement of potential users as test persons; (2) the application of dynamic and individual information needs; and (3) the use of multidimensional  ...  and dynamic relevance judgements.  ...  whom there would not have been an evaluation to report on.  ... 
doi:10.1108/eum0000000007110 fatcat:gmki5v5tjfhg7hnudxpv2nuprm

Reinvigorating the scenario technique to expand uncertainty consideration

Evelina Trutnevyte, Céline Guivarch, Robert Lempert, Neil Strachan
2016 Climatic Change  
, (ii) to facilitate the process of scenario users capturing this space, and (iii) to 2 evaluate and iteratively revise the improvement progress.  ...  insights, as well as evaluation of both scenarios and scenario techniques.  ...  As the number of scenarios and scenario services proliferate, independent assessment of these scenarios and evaluation literature would prove useful.  ... 
doi:10.1007/s10584-015-1585-x fatcat:huykqglx6bd4hifldgv2y2knfy

Exploring Relevance in Microblog Search

Divi Galih Prasetyo Putri, Gabriella Pasi
2019 Italian Information Retrieval Workshop  
CCS CONCEPTS • Information systems → Evaluation of retrieval results; Relevance assessment; Web and social media search.  ...  Properties such as credibility, informativeness and interestingness of microblogs could be considered as relevance dimensions to be assessed during query processing.  ...  The concept of multidimensional relevance is widely used in the context of Web search, which implies that several relevance dimensions should be considered to assess the utility of an information item  ... 
dblp:conf/iir/PutriP19 fatcat:7wr6pyzawjdb7evvtkcjbbfdeu

Relevance & Assessment: Cognitively Motivated Approach toward Assessor-Centric Query-Topic Relevance Model

2018 Acta Polytechnica Hungarica  
In the literature, relevance can be considered from different perspectives: from the system (topicality matching), user satisfaction and relevance-feedback, multidimensionality of topicality utility and  ...  This paper intends to introduce a novel model for query-topic relevance assessment from assessor and cognitive point of view in the sense that relevance is a multidimensional cognitive and dynamic conception  ...  In connection to the meaning of the Human-Machine Interaction and user-based evaluation in establishing a relevance assessment, there is also related work.  ... 
doi:10.12700/aph.15.5.2018.5.8 fatcat:7knqqyr37rarrnqv55tdsfjf2q

Towards a multidimensional model for assessing e-government service gaps

Gilbert Mahlangu, Ephias Ruhode
2020 South African Journal of Information Management  
Results: Themes and constructs extracted from existing evaluation metrics resulted in the development of a multidimensional model that could be used for assessing e-government service gaps.  ...  Objective: The objective of this study was to explore dimensions or constructs that could contribute to the development of a multidimensional model for assessing e-government service gaps.  ...  of e-government metrics can be synthesised to form a multidimensional model for assessing e-government service gaps in the context of a developing country?  ... 
doi:10.4102/sajim.v22i1.1234 fatcat:ymy7ihe3d5egznrhw6dsbfq3qy

Toward a Personalized Approach for Combining Document Relevance Estimates [chapter]

Bilel Moulahi, Lynda Tamine, Sadok Ben Yahia
2014 Lecture Notes in Computer Science  
Our approach is empirically evaluated and relies on the standard TREC 1 contextual suggestion dataset involving 635 users and 50 contexts.  ...  The underlying complexity appears mainly from the fact that relevance is estimated by considering multiple dimensions and that most of them are subjective since they are user-dependent.  ...  The main outcome concerns the multidimensional nature of user relevance assessments that treats the IR process from a user-centered cognitive approach.  ... 
doi:10.1007/978-3-319-08786-3_14 fatcat:hfnonbodxjf5bcnsjjf5qxmh3q

Development of a Multidimensional App-Quality Assessment Tool for Health-Related Apps (AQUA)

Teresa O'Rourke, Rüdiger Pryss, Winfried Schlee, Thomas Probst
2020 Digital Psychology  
Conclusion AQUA is a brief multidimensional app-quality assessment tool that can be used for the quality assessment of health-related and mental health-related apps by experts and app-users.  ...  Objectives The objective of this paper is to introduce a new multidimensional criteria-based tool for the quality assessment of health-related apps.  ...  We therefore wanted to create a multidimensional mHealth app quality assessment tool that combines the strengths of the above-mentioned instruments by not only assessing further relevant quality criteria  ... 
doi:10.24989/dp.v1i2.1816 fatcat:denlkt5kebgphlurh4sdoqrq64

Multidimensional Evaluation of Virtual Reality Paradigms in Clinical Neuropsychology: Application of the VR-Check Framework

Stephan Krohn, Johanne Tromp, Eva M Quinque, Julia Belger, Felix Klotzsche, Sophia Rekers, Paul Chojecki, Jeroen de Mooij, Mert Akbal, Cade McCall, Arno Villringer, Michael Gaebler (+2 others)
2020 Journal of Medical Internet Research  
This framework rests on 10 main evaluation dimensions encompassing cognitive domain specificity, ecological relevance, technical feasibility, user feasibility, user motivation, task adaptability, performance  ...  To address this gap, we propose a multidimensional evaluation framework for VR applications in clinical neuropsychology, summarized as an easy-to-use checklist (VR-Check).  ...  In terms of assessing navigational abilities, the CMT was evaluated to be the most suitable starting point for the development of an immersive paradigm because of favorable ecological relevance, user feasibility  ... 
doi:10.2196/16724 pmid:32338614 pmcid:PMC7215516 fatcat:5zsq54s5jjevba4bopkxz3dotq
« Previous Showing results 1 — 15 out of 64,719 results