Cockpit/crew resource management (CRM) training within the military has grown rapidly despite the paucity of empirical data linking CRM to mission performance. CRM training objectives (and course content) are often too vague to allow meaningful training evaluation within the context of traditional transfer-of-training paradigms. A multimeasure methodology that exploits all sources of archival and observational data within a training organization has the potential to advance training evaluation,

more »

... particularly for crew-based skills such as CRM. This article discusses a variety of CRM data sources and presents findings using 2 ofthese sources: instructor comments in student training folders and over-the-shoulder observations ofcrews in tactical simulators. Instructor comments revealed that CRM problems early in training most frequently involve decision making and communication among crew members. Over-the-shoulder observations ofexperienced crews showed high correlations between independent ratings ofCRM proficiency and mission performance. The most effective crews exhibited such characteristic CRM behaviors as the presence ofa single leader and willingness to change plans based on changing mission situations. The article closes by describing how these study data can be used to restructure CRM training into a set of behavior-based objectives that will enable meaningful evaluation of its effectiveness in improving the performance levels of all student crews. Requests for reprints should be sent to Robert T. Nullmeyer, Public reporting burden for the collection of information is estimated to average 1 hour per response, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden, to Washington Headquarters Services, Directorate for Information Operations and Reports, 1215 Jefferson Davis Highway, Suite 1204, Arlington VA 22202-4302. Respondents should be aware that notwithstanding any other provision of law, no person shall be subject to a penalty for failing to comply with a collection of information if it does not display a currently valid OMB control number.