13,284 Hits in 3.9 sec

Replicability or reproducibility? On the replication crisis in computational neuroscience and sharing only relevant detail

Marcin Miłkowski, Witold M. Hensel, Mateusz Hohol
2018 Journal of Computational Neuroscience  
We claim that although both are undesirable, low model reproducibility poses more of a threat to long-term scientific progress than low model replicability.  ...  Replicability and reproducibility of computational models has been somewhat understudied by "the replication movement."  ...  Acknowledgements We would like to kindly thank Piotr Litwin (Department of Psychology, University of Warsaw, & Institute of Philosophy and Sociology, Polish Academy of Sciences) for helping us with the  ... 
doi:10.1007/s10827-018-0702-z pmid:30377880 pmcid:PMC6306493 fatcat:6me6trtcjnhedo3pl5ms5jmoom

Reproducibility and Forensic Science Talk - EAFS 2018 [article]

Christian Cole
2018 Figshare  
A core tenet of empirical science is that an experiment should be described in sufficient detail that another scientist can redo the experiment and get the same result.  ...  In this presentation we will highlight issues of lack of reproducibility that are currently affecting other areas of science and show how Forensic Science can learn to avoid the traps and pitfalls of irreproducible  ...  Replication in 2012 felt like an attack because it was so rare in science at the time. Now it's become normal." "Science is really a process of uncertainty reduction." -Brian Nosek (D.  ... 
doi:10.6084/m9.figshare.7097873.v1 fatcat:ke2gfen73fgxjmssecz6p32r34

A scientific galaxy lacking replications: on Ioannidis' In scientific method we don't just trust or why replication has more value than discovery

Alahí Bianchini, Alahí Bianchini
2019 Journal of Science Humanities and Arts - JOSHA  
In his talk, he argues for the importance of reproducibility in science and emphasizes the immense value of replication over discovery.  ...  In his talk, he argues for the importance of reproducibility in science and emphasizes the immense value of replication over discovery.  ...  in a recent survey in Nature agreed that there is a reproducibility crisis.  ... 
doi:10.17160/josha.6.7.579 fatcat:ihdfj2qgofa3jbrt3i32wzf4o4

A Guide to Event Data: Past, Present, and Future

Philip Schrodt, Jay Yonamine
2016 All Azimuth A journal of foreign policy and peace  
The goal of this paper is to provide a general overview of event data and its importance in the study of political conflict.  ...  In doing so, we illustrate how the level of methodological sophistication in the data collection, coding, and analyzing process has progressed from the earliest event-data projects in the 1970s to the  ...  However, most empirical models used in the social sciences are not equipped to handle this level of heterogeneity in data.  ... 
doi:10.20991/allazimuth.167312 fatcat:xiexvnr3nrfxjj7gtk4n34nhle

Sexual and Emotional Infidelity: Evolved Gender Differences in Jealousy Prove Robust and Replicable

David M. Buss
2018 Perspectives on Psychological Science  
Because of gender differences in some aspects of reproductive biology, such as internal female fertilization, the nature of these threats differs for men and women.  ...  It also heralded the newly emerging field of evolutionary psychology as a useful perspective that possesses the scientific virtues of testability, falsifiability, and heuristic value in discovering previously  ...  Given the current replication crisis in social psychology, these empirical success-stories are noteworthy.  ... 
doi:10.1177/1745691617698225 pmid:29592639 fatcat:mbum32nxevh6tdykvrs2slyfyy

Improving Social Science: Lessons from the Open Science Movement

Per Engzell, Julia M. Rohrer
2020 PS: Political Science and Politics  
) and/or replicability (i.e., ensuring that an empirical replication of a study leads to the same conclusions).  ...  Depending on whom you ask, the field underwent a "replication crisis" (Shrout and Rodgers 2018) or a "credibility revolution" (Vazire 2018 ) that might even climax in "psychology's renaissance" (Nelson  ... 
doi:10.1017/s1049096520000967 fatcat:vxss7yd2pzfvdh2tp2elnmpcfq

The values and challenges of 'openness' in addressing the reproducibility crisis and regaining public trust in social sciences and humanities

2019 European Science Editing  
of 18 experimental studies in economics were replicated, 6 while a more recent paper by Chang and Li (2018) showed that less than half of 67 studies' findings were reproducible. 7 In political science  ...  , Dafoe (2013) showed how the lack of replication files postponed the advancement of the field for three years in a recent famous case; 8 in 2015, a study of how canvassers can sway voters' opinions  ... 
doi:10.20316/ese.2019.45.17021 fatcat:oc76jmo5w5e3nio2yzbkmvoxci

The role and value of replication in empirical software engineering results

Martin Shepperd, Nemitari Ajienka, Steve Counsell
2018 Information and Software Technology  
Objective: We aim to better understand the value of replication studies, the level of confirmation between replication and original studies, what confirmation means in a statistical sense and what factors  ...  Method: We perform a systematic review to identify relevant replication experimental studies in the areas of (i) software project effort prediction and (ii) pair programming.  ...  Acknowledgements We would like to thank both the guest editors and the reviewers for their detailed and constructive comments on two earlier versions of this paper.  ... 
doi:10.1016/j.infsof.2018.01.006 fatcat:7jxzq4wxgnagjkexs3rllqg7ty

Mapping the discursive dimensions of the reproducibility crisis: A mixed methods analysis

Nicole C. Nelson, Kelsey Ichikawa, Julie Chung, Momin M. Malik, Sergi Lozano
2021 PLoS ONE  
To those involved in discussions about rigor, reproducibility, and replication in science, conversation about the "reproducibility crisis" appear ill-structured.  ...  We take a novel empirical, mixed methods approach to understanding variation in reproducibility discussions, using a combination of grounded theory and correspondence analysis to examine how a variety  ...  We also thank the Department of Medical History and Bioethics at the University of Wisconsin-Madison for providing publication fee assistance. Malik. Author Contributions  ... 
doi:10.1371/journal.pone.0254090 pmid:34242331 pmcid:PMC8270481 fatcat:wnntafybyjg5rfghkp4vw55tje

Using "Cinéma Vérité" (truthful cinema) to facilitate replication and accountability in psychological research†

Jerry Suls
2013 Frontiers in Psychology  
Making recordings of all research participants a standard practice would be a greater challenge because of threats to internal validity and ethical concerns, however it is feasible and merits a broad discussion  ...  more information about the procedures described in the research publication.  ...  This is a problem because replication not only helps to build a cumulative science, but also discourages fraudulent behavior.  ... 
doi:10.3389/fpsyg.2013.00872 pmid:24348437 pmcid:PMC3842020 fatcat:jvg7swyntfb4lcqmziwvrzilva

Are Costly Signals More Credible? Evidence of Sender-Receiver Gaps

Kai Quek
2016 Journal of Politics  
There is a sender-receiver gap in how the same deterrence interaction is perceived at the two ends of the signaling mechanism, contrary to what the theory of costly signaling automatically assumes.  ...  Causal evidence is elusive because the effect of a costly signal is almost always confounded with the effects of other previous or simultaneous information.  ...  However, this is less realistic in the case of an international crisis, where a failed deterrent signal can end the crisis in a war, with no further replay of the same crisis.  ... 
doi:10.1086/685751 fatcat:6pmsjsgulzh6bmfx76rfwn6abe

New Guidelines for Null Hypothesis Significance Testing in Hypothetico-Deductive IS Research

Willem Mertens, Self-employed data scientist, Belgium, Jan Recker, University of Cologne, Germany / Queensland University of Technology, Australia
2020 Journal of the AIS  
We discuss traditional and emergent threats associated with the application of NHST and examine how they manifest in recent IS scholarship.  ...  To encourage the development of new standards for NHST in hypothetico-deductive IS research, we develop a balanced account of possible actions that are implementable in the short-term or long-term and  ...  We thank participants at seminars at Queensland University of Technology and University of Cologne for providing feedback on our work. We also thank Christian Hovestadt for his help in coding papers.  ... 
doi:10.17705/1jais.00629 fatcat:eu5fsshr35dxvaoxu6urctgvsm

Ethics and Statistics: The AAA Tranche of Subprime Science

Andrew Gelman, Eric Loken
2014 CHANCE : New Directions for Statistics and Computing  
A recent article in the Economist asked whether science was self-correcting, focusing on failures to replicate and the widespread concern that many areas of the scientific literature are not as reliable  ...  There was a tremendous interest in these securities, not just among the most unscrupulous market manipulators, but in a world where a lot of money was looking for safe investments and investors were willing  ...  If we fail to respond to the current crisis, we might find ourselves facing a market correction in the perceived value of science and possibly a reduction in our collective capacity to generate further  ... 
doi:10.1080/09332480.2014.890872 fatcat:nlfueyb34fd4dhhm2awn5zxivy

Creative destruction in science

Warren Tierney, Jay H. Hardy, Charles R. Ebersole, Keith Leavitt, Domenico Viganola, Elena Giulia Clemente, Michael Gordon, Anna Dreber, Magnus Johannesson, Thomas Pfeiffer, Eric Luis Uhlmann
2020 Organizational Behavior and Human Decision Processes  
A B S T R A C T Drawing on the concept of a gale of creative destruction in a capitalistic economy, we argue that initiatives to assess the robustness of findings in the organizational literature should  ...  In effect, we advocate for a Replication 2.0 movement in which the goal shifts from checking on the reliability of past findings to actively engaging in competitive theory testing and theory building.  ...  Funding acknowledgments Eric Luis Uhlmann is grateful for an R&D grant from INSEAD in support of this research.  ... 
doi:10.1016/j.obhdp.2020.07.002 fatcat:ptmksopafrfwjkszxnum45kuo4

Revisiting the Alexander UFO Religious Crisis Survey (AUFORCS): Is There Really a Crisis?

Jeff Levin
2012 Journal of Scientific Exploration  
The present analysis is based on data collected as a part of the Alexander UFO Religious Crisis Survey (AUFORCS), a private study of Protestant, Roman Catholic, and Jewish clergy (N = 229) conducted in  ...  Findings from the AUFORCS data confirm that disclosure would not precipitate much of a religious crisis.  ...  He would also like to acknowledge the assistance of Daniel Jang, who handled the computer data entry of the AUFORCS questionnaires.  ... 
doaj:3aca2b93d9a34ac980bfe03b75877273 fatcat:eqpz7dyhwjgupis26cuqr5o4i4
« Previous Showing results 1 — 15 out of 13,284 results