The Development of the HOTS Test of Physics Based on Modern Test Theory: Question Modeling through E-learning of Moodle LMS

Sri Wahyu Widyaningsih, Asst. Prof., corresponding author, Faculty of Teacher Training and Education, Universitas Papua, Indonesia, s.widyaningsih@unipa.ac.id, Irfan Yusuf, Zuhdan Kun Prasetyo, Edi Istiyono, Asst. Prof., Faculty of Teacher Training and Education, Universitas Papua, Indonesia, i.yusuf@unipa.ac.id, Prof., Faculty of Mathematics and Natural Sciences, Universitas Negeri Yogyakarta, Indonesia, zuhdan@uny.ac.id, Prof., Faculty of Mathematics and Natural Sciences, Universitas Negeri Yogyakarta, Indonesia, edi_istiyono@uny.ac.id
2021 International Journal of Instruction  
This research aims to develop HOTS physics questions based on Modern Test Theory designed and presented with LMS Moodle on e-learning, which can be accessed online. This study also serves as one of the efforts to expand students' HOTS by applying a variety of HOTS-based learning sources. Further, this research employed the ADDIE model with analysis, design, development, implementation, and evaluation stages. The instrument consisted of 24 multiplechoice physics questions; the questions were
more » ... gned by following the aspects and sub-aspects of HOTS and validated by the assessment of physics experts, physicists, and lecturers. Moreover, the validity analysis was based on Aiken's V formula, in which every aspect was confirmed to be valid. The instrument had been tested on 34 students of the Physics Education Department, Universitas Papua. Dichotomy data analysis used the Rasch Model (RM) 1-PL through the Quest program, and the test characteristics comprised item fitness, reliability, and difficulty. The trial result obtained the criteria of INFIT MNSQ mean and standard deviation of 1.0 and 0.0, respectively, indicating that the items fitted the RM1-PL. In addition, the value of item reliability based on the item estimate summary arrived at 0.66; meanwhile, the case reliability under the summary of the case estimate accounted for 0.85. Analysis The analysis stage was a process of needs analysis to determine test objectives, identify problems, analyze tasks, and determine question formats to be applied. It was shown that the problems were related to the needs of HOTS instrument design for students at the Department of Physics Education, Universitas Papua. Design This stage comprised the process of designing HOTS questions to be used; the design process encompassed creating a question matrix and outline that covered question distribution in every aspect and sub-aspect of HOTS.
doi:10.29333/iji.2021.1444a fatcat:2d2eb3lmtjearcu5zt5fhfv2ty