|
Cognitive Impact Evaluation
Problem Statement and Objectives
Additional methods are needed to evaluate the cognitive impact new technologies have on warfighters. Cognitive impact, how a system will influence the users ways of thinking about the problem and solutions, is hard to evaluate especially early in the development cycle. Too many systems are developed that focus on technological possibility and not what the impact will be on the people and organizations that have to make use of the technology.
The objectives for this project were to produce a method that
- Allowed risk management throughout the development lifecycle
- Provided effective feedback Is supportable with usable software tool
Results and Benefits
In order to support warfighter evaluations, ARA tracked created a management method called the Cognitive Performance Case, based upon the safety case concept. This method provides integrated risk management for cognitive performance throughout the development lifecycle. It provides a mechanism for integrating both the new techniques developed in this project as well as existing human factors evaluation techniques. To provide design-relevant feedback through the lifecycle, we specified four assessment techniques based on Cognitive Systems Engineering, Human Factors, and Software Engineering process research and best practices. To assist in these techniques and make them available to a wide range technologist, we distilled Cognitive Systems Engineering research into a usable form for assessment. We have created a concept prototype for a software tool to support expert review. We will grow this seed into a system that supports the entire Cognitive Performance Case. Our expert review technique has been used successfully in both government and commercial settings, providing validation for our approach.
|
Four assessment techniques for coverage of the lifecycle.
Related
|
