How Hard Will this Task Be? Developments in Analyzing and Predicting Question Difficulty in the Bebras Challenge

Willem van der VEGT
Predicting the difficulty level of a task on the concepts of computer science or computational thinking, like in the Bebras Challenge, proves to be really hard. Question difficulty breaks down in content difficulty, stimulus difficulty and task difficulty. Several instruments are suggested to predict the overall difficulty level, like using a questionnaire or a rubric; these instruments are applied on the data of a recent contest and proved useful. Relative scoring could also turnout helpful.
more » ... turnout helpful. Especially on content difficulty easy applicable solutions are lacking.
doi:10.15388/ioi.2018.10 fatcat:eyrp25wkrjcilkewga4bdsxatm