Item parameter drift in computerized adaptive testing: Study with eCAT
Deterioro de parámetros de los ítems en tests adaptativos informatizados: estudio con eCAT

Francisco J Abad, Julio Olea, David Aguado, Vicente Ponsoda, Juan R Barrada
2010 Psicothema  
This study describes the parameter drift analysis conducted on eCAT (a Computerized Adaptive Test to assess the written English level of Spanish speakers). The original calibration of the item bank (N = 3224) was compared to a new calibration obtained from the data provided by most eCAT operative administrations (N = 7254). A Differential Item Functioning (DIF) study was conducted between the original and the new calibrations. The impact that the new parameters have on the trait level estimates
more » ... ait level estimates was obtained by simulation. Results show that parameter drift is found especially for a and c parameters, an important number of bank items show DIF, and the parameter change has a moderate impact on high-level-English ? estimates. It is then recommended to replace the original estimates by the new set.
pmid:20423641 fatcat:wkpws5gfzbe4fid2ob36376dey