NEPS Technical Report for Mathematics – Scaling Results of Starting Cohort 3 in Fifth Grade

Christoph Duchhardt, Annkathrin Gerdes
2012
The National Educational Panel Study (NEPS) aims at investigating the development of competences across the whole life span and designs tests for assessing these different competence domains. In order to evaluate the quality of the competence tests, a wide range of analyses have been performed based on item response theory (IRT). This paper describes the data on mathematical competence for starting cohort 3 -fifth grade. Besides presenting descriptive statistics for the data, the scaling model
more » ... the scaling model applied to estimate competence scores and analyses performed to investigate the quality of the scale, as well as the results of these analyses are also explained. The mathematics test in fifth grade consisted of 25 items which represented different content areas as well as different cognitive components and used different response formats. The test was administered to 5,208 students. A partial credit model was used for scaling the data. Item fit statistics, differential item functioning, Raschhomogeneity, and the tests' dimensionality were evaluated to ensure the quality of the test. The results show that the items exhibited good item fit and measurement invariance across various subgroups. Moreover, the test showed a high reliability. As the correlations between the four content areas are very high in a multidimensional model, the assumption of unidimensionality seems adequate. Among the challenges of this test are the relatively high omission rates in some items and the lack of very difficult items. But overall, the results revealed good psychometric properties of the mathematics test, thus supporting the estimation of a reliable mathematics competence score. This paper describes the data available in the Scientific Use File and provides ConQuest-Syntax for scaling the data.
doi:10.5157/neps:wp19:1.0 fatcat:yu7sijc7mrhmxm5g3d3gkgzmbe