PROFICIENCY SCALING BASED ON CONDITIONAL PROBABILITY FUNCTIONS FOR ATTRIBUTES

Kikumi K. Tatsuoka, Menucha Birenbaum, Charles Lewis, Kathleen M. Sheehan
1993 ETS Research Report Series  
This study introduces procedures for constructing a proficiency scale for a large-scale test by applying Tatsuoka's Rule Space Model. The SAT Mathematics (SAT M) Section 2 is used for illustrating the process and the results. A task analysis is summarized in a mapping sentence, and then 14 processes and content attributes are identified for explaining the underlying cognitive aspects of the examinees' performance on tl..e SAT M. Analysis results show 'chat almost 98 percent of 2,334 examinees
more » ... e successfully classified into one of 468 cognitive states. The cognitive states are characterized by mastery or non-mastery of the 14 attributes. Attribute Characteristic Curves, which are conditional probability functions defined on the SAT Scale, are introduced and used for interpreting an examinee's proficiency. Prototypes of a student's performance report and a group performance report are given as examples of possible ways for summarizing the analysis results. The study contains 19 tables and 1 figure. One appendix (two tables) introduces the Rule Space Model. (Contains 38 references.) (Author)
doi:10.1002/j.2333-8504.1993.tb01561.x fatcat:edvkw5pfdja3xikn3ftt7cyrm4