On the assumptions behind metacognitive measurements: Implications for theory and practice [post]

Kiyofumi Miyoshi, Yosuke Sakamoto, Shin'ya Nishida
2021 unpublished
Theory of visual confidence has largely been grounded in the gaussian signal detection framework. This framework is so dominant that people could be rather ignorant of idiosyncratic consequences from this distributional assumption. By contrasting gaussian and logistic signal detection models, this paper systematically evaluates the consequences of auxiliary distributional assumptions in the measurement of metacognitive accuracy and its theoretical implications. We found that these models can
more » ... d to opposing conclusions regarding the efficiency of confidence rating relative to objective decision (whether meta-d' is larger or smaller than d') as well as the metacognitive efficiency along the internal evidence continuum (whether meta-d' is larger or smaller for higher levels of confidence). These demonstrations may call for reconsideration of hitherto established theories of metacognition that are critically dependent on auxiliary modeling assumptions. We deem there is no instant solution for this matter as our quantitative model comparisons on a large dataset did not decide on a clear victor between gaussian and logistic metacognitive models. Yet, being aware of the hidden modeling assumptions and their systematic consequences would facilitate cumulative development of the science of metacognition.
doi:10.31234/osf.io/3vxg5 fatcat:qe4khbiauvb53nq4ffhh2i26vi