A battery of tests for assessing a number of cognitive skills relevant to conceptual design is being developed. Tests on divergent thinking (DT), visual thinking (VT), and qualitative reasoning (QR) are fully developed and validated. This paper focuses on the development of a test on the problem formulation (PF) skill. Indicators of problem formulation are identified and categorized as: insight, setting priorities, expanding, bounding, and structuring the design space. Unlike the previous tests

more »

... which were developed and taken solely on pen and paper, this test can be developed with Problem Maps-data that is collected with the web-based Problem Formulator tool. A set of metrics for measuring skill levels are proposed with respect to which a class of graduate students have been graded. Candidate test items are discussed based on a number of design tasks which have been given to the students.