79,325 Hits in 7.1 sec

Using interview data to identify evaluation criteria for interactive, analytical question-answering systems

Diane Kelly, Nina Wacholder, Robert Rittman, Ying Sun, Paul Kantor, Sharon Small, Tomek Strzalkowski
2007 Journal of the American Society for Information Science and Technology  
The purpose of this work is to identify potential evaluation criteria for interactive, analytical question-answering (QA) systems by analyzing evaluative comments made by users of such a system.  ...  Results suggest potential evaluation criteria for interactive, analytical QA systems, which can be used to guide the development and design of future systems and evaluations.  ...  Acknowledgements This article is based on work supported in part by the Advanced Research and Development Activity (ARDA)'s Advanced Question Answering for Intelligence (AQUAINT) Program under a contract  ... 
doi:10.1002/asi.20575 fatcat:oz5tqliqsnarlobmmrosfjppzq

Time-line interviews and inductive content analysis: their effectiveness for exploring cognitive behaviors

Linda Schamber
2000 Journal of the American Society for Information Science  
This article describes advantages and disadvantages of the methods using examples from a study of users' criteria for evaluation in a multimedia context.  ...  Time-line interviewing and inductive content analysis are two research methods that, used together, have proven extremely useful for exploring and describing users' perceptions in various situational contexts  ...  An example is this response evaluating a dedicated weather information system: "Reputation" "Accurate" "up-to-date" "provide us updates" "update for us" "we could request at any time for them to send  ... 
doi:10.1002/(sici)1097-4571(2000)51:8<734::aid-asi60>;2-3 fatcat:vmux53tryne3fiutrkpq7b2qae

Focus Group Methodology for Evaluating Information Visualization Techniques and Tools

Riccardo Mazza, Alessandra Berre
2007 Information Visualisation  
Focus groups are particularly suitable for the collection of qualitative data from users, and allow researchers to uncover unexpected problems that cannot be identified through analytical evaluations or  ...  This paper proposes a structured methodology that uses focus group interviews to evaluate Information Visualization techniques and tools.  ...  Analytic evaluations usually occur during the system's design and are oriented to identify problems and guide modifications during the development of a system.  ... 
doi:10.1109/iv.2007.51 dblp:conf/iv/MazzaB07 fatcat:ohob4vfu65hqbkjvl6wchnfr3u

Evaluating the data visualization for demanding marine operations

Xu Zhuge, Hao Wang, Girts Strazdins
2016 2016 Techno-Ocean (Techno-Ocean)  
This work is an important part to complement the visual analytics for maritime operations.  ...  It's urgently needed to develop and implement new evaluation methods to assess the visualization of maritime data.  ...  ACKNOWLEDGEMENTS The authors would like to thank for the valuable inputs from other members from BDL and Houxiang Zhang and Guoyuan Li from the Faculty of Maritime Technology and Operations of NTNU Aalesund  ... 
doi:10.1109/techno-ocean.2016.7890700 fatcat:kiid6brlbbg55pydg2gxtm46oe

A model for quantitative evaluation of an end-to-end question-answering system

Nina Wacholder, Diane Kelly, Paul Kantor, Robert Rittman, Ying Sun, Bing Bai, Sharon Small, Boris Yamrom, Tomek Strzalkowski
2007 Journal of the American Society for Information Science and Technology  
We report on the development of material for an evaluation exercise designed to assess the overall design and usability of HITIQA, an interactive question-answering system for preparing broad ranging reports  ...  We used qualitative and quantitative tools to obtain data about analyst's comfort with the HITIQA system, especially its novel features such as the ability to answer complex questions and the interactive  ...  Acknowledgements This paper is based on work supported by the Advanced Research and Development Activity (ARDA)'s Advanced Question Answering for Intelligence (AQUAINT) Program under contract 2002-H790400  ... 
doi:10.1002/asi.20560 fatcat:3klz3smblfbv5g4qrket77mqxu

Review of Research on Student-Facing Learning Analytics Dashboards and Educational Recommender Systems

Robert Bodily, Katrien Verbert
2017 IEEE Transactions on Learning Technologies  
This article is a comprehensive literature review of student-facing learning analytics reporting systems that track learning analytics data and report it directly to students.  ...  Finally, observational study methods, such as propensity score matching, should be used to increase student access to these systems but still rigorously measure experimental effects.  ...  Once all articles had been identified, duplicates were removed because some Inclusion Criteria There were two main inclusion criteria used to narrow the pool of articles for this literature review.  ... 
doi:10.1109/tlt.2017.2740172 fatcat:hyb373z5vjewjotqffpskmjj4e

The Tech-Talk Balance: What Technical Interviewers Expect from Technical Candidates

Denae Ford, Titus Barik, Leslie Rand-Pickett, Chris Parnin
2017 2017 IEEE/ACM 10th International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE)  
Although candidates are able to answer technical questions, there is a mismatch of what candidates think interviewers assess versus what criteria is used in practice.  ...  To determine what criteria interviewers value, we conducted mock technical interviews with software engineer candidates at a university and collected evaluations from interviewers.  ...  ACKNOWLEDGMENTS We thank the Alt-Code research group for their support. This material is based upon work supported by the National Science Foundation under Grant No. DGE-1252376.  ... 
doi:10.1109/chase.2017.8 dblp:conf/icse/FordBRP17 fatcat:j4nrtmtuebhahmfxctrgppnmxi

Why do Situational Interviews Predict Job Performance? The Role of Interviewees' Ability to Identify Criteria

Pia V. Ingold, Martin Kleinmann, Cornelius J. König, Klaus G. Melchers, Chad H. Van Iddekinge
2014 Journal of business and psychology  
This approach enabled us to conduct the situational interviews under standardized conditions, to assess interviewees' Ability to Identify Criteria, and at the same time, to collect job performance data  ...  We examined an explanation based upon the importance of interviewees' Ability to Identify Criteria (i.e., to read the targeted interview dimensions) for situational interview performance.  ...  For each question, both interviewers rated interviewees' answers on a 5-point scale and we then averaged their ratings for each question.  ... 
doi:10.1007/s10869-014-9368-3 fatcat:ll544wbj5bhzdjowdygpzt7wze

Argumentation Models for Usability Problem Analysis in Individual and Collaborative Settings

Ebba Thora Hvannberg, Effie L.-C. Law, Gyda Halldorsdottir
2018 International Journal of Human-Computer Interaction  
Novice usability evaluators could identify predefined criteria for a usability problem when probed and this could be acknowledged as a backing to warrants.  ...  The data were analysed by using conventional content analysis and by creating argumentation models according to the Toulmin model.  ...  In this study, the analytical process entailed breaking down the text from participants' answers in the semi-structured interviews into raw data (quotes) and then coding the raw data.  ... 
doi:10.1080/10447318.2018.1454142 fatcat:k24rjau6vffvbcxogkcpv6vm3e

Adopt Big-Data Analytics to Explore and Exploit the New Value for Service Innovation

Nopsaran Thuethongchai, Tatri Taiphapoon, Achara Chandrachai, Sipat Triukose
2020 Social Sciences  
The principal objective of this research is to study the adoption of big-data analytics for service innovation.  ...  The result of the research found that organizations in the services industry are using big data analytics to build capabilities to gain competitive advantages as well as the ability to rapidly and accurately  ...  As for the research conducted and reported by N.T. All authors contributed to develop, review and revise the manuscript. All authors have read and agreed to the published version of the manuscript.  ... 
doi:10.3390/socsci9030029 fatcat:ba522tdeyvhg5orloccw4knkse

Discussing Relations Between Dynamic Business Environments and Big Data Analytics

Daniel Staegemann, Faculty of Computer Science, Otto-von-Guericke-University, Magdeburg, Germany, Matthias Volk, Christian Daase, Klaus Turowski, Faculty of Computer Science, Otto-von-Guericke-University, Magdeburg, Germany, Faculty of Computer Science, Otto-von-Guericke-University, Magdeburg, Germany, Faculty of Computer Science, Otto-von-Guericke-University, Magdeburg, Germany
2020 Complex Systems Informatics and Modeling Quarterly  
Relevant data sources as well as the questions that are supposed to be answered by their analysis may change rapidly and so do subsequently the requirements regarding the functionalities of the system.  ...  Therefore, this research aims to overcome this paucity by clarifying the relation between dynamic business environments and big data analytics (BDA), sensitizing researchers and practitioners for future  ...  new system is ready for use [67] .  ... 
doi:10.7250/csimq.2020-23.05 fatcat:wyb3b3ei2zcwdpqu2o5ff3gxee

A tool for assessing alignment of biomedical data repositories with open, FAIR, citation and trustworthy principles

Fiona Murphy, Michael Bar-Sinai, Maryann E Martone
2021 PLoS ONE  
The evaluation was performed from March to November 2020 through inspection of documentation and interaction with the sites by the authors.  ...  Increasing attention is being paid to the operation of biomedical data repositories in light of efforts to improve how scientific data is handled and made available for the long term.  ...  Acknowledgments The authors wish to thank Drs. Ko Wei Lin and Jeffrey Grethe for helpful comments. Author Contributions  ... 
doi:10.1371/journal.pone.0253538 pmid:34242248 pmcid:PMC8270168 fatcat:z4zder33hrenvfc5humqfqymbe

Map Evaluation under COVID-19 restrictions: A new visual approach based on think aloud interviews

Martin Knura, Jochen Schiewe
2021 Proceedings of the ICA  
This allows us to use the same visual methods as for eye-tracking studies, like attention maps or trajectory maps.  ...  method provides a useful substitute for eye-tracking user studies.  ...  Acknowledgements This research is part of the project Improvement of taskoriented visual interpretation of VGI point data (TOVIP), founded by the German Research Foundation (DFG) within the SPP 1894 Volunteered  ... 
doi:10.5194/ica-proc-4-60-2021 fatcat:utjbfhlfxfdwbgjxontf4vugoq

Evaluating quality in online asynchronous interactions between students and discussion facilitators

Dip Nandi, Margaret Hamilton, Shanton Chang, Sandrine Balbo
2012 Australasian Journal of Educational Technology  
We have devised a set of criteria for evaluating discussion forum activities.  ...  Currently, a major focus has been put onto the better use of discussion forums, but the way in which the quality of participation can be evaluated has yet to be adequately investigated.  ...  But the data revealed that students put most emphasis on the questions asked by the instructors, and used all their efforts to answer those questions.  ... 
doi:10.14742/ajet.835 fatcat:4gzbuwaq5jhr7dscwum2cyukme

Monitoring Academic Performance Based on Learning Analytics and Ontology: A Systematic Review

Laecio Araujo COSTA, Leandro Manuel PEREIRA SANCHES, Ricardo José ROCHA AMORIM, Laís do NASCIMENTO SALVADOR, Marlo Vieira dos SANTOS SOUZA
2020 Informatics in Education. An International Journal  
Objectives; In the second perspective, we seek to identify which models or methods have been used as an analytical tool for educational data.  ...  The results of this review suggest that: 1) few studies consider that student interactions in the Learning Management System can represent students' learning experiences; 2) most studies use ontologies  ...  Learning Analytics and Ontology In this section, we present an analysis of the identified aspects of Learning Analytics and Ontology in order to answer the research questions RQ1, RQ2 and RQ4.  ... 
doi:10.15388/infedu.2020.17 doaj:700e6c4fb13c46d087f32a0015b15198 fatcat:4kseaupfo5ch5obk6neke3feai
« Previous Showing results 1 — 15 out of 79,325 results