Aerospace Engineering, Industrial and Manufacturing Systems Engineering, Human Computer Interaction, Virtual Reality Applications Center
Journal or Book Title
Workshop Proceedings: Approaches and Challenges in Team Tutoring
Research Focus Area(s)
Operations Research, Ergonomics and Human Factors
Approaches and Challenges in Team Tutoring Workshop (TTW-AIED 2019)
June 29, 2019
In this paper we introduce a conceptual framework for the design of automated team evaluation processes (FATE), inspired by lessons learned from multiple intelligent team tutoring experiences. The framework consists of five phases. The first, Team Construct, defines the theoretical basis of the evaluation and therefore the end goal of the evaluation process. The second, Behavioral Markers, defines a method for identifying the otherwise unobservable constructs. The third, Raw Data, defines the data to be captured and recorded. The fourth, Enriched State Representation, defines a method for making the data directly relevant for team evaluation. The fifth, Team Metric, is the end goal of the evaluation defined by team constructs and derived from the enriched state representation. The framework is organized in a “V” shape to act both as a hierarchical model relating teaming theory to scenario-specific data and as a sequential process flow diagram representing the steps recommended to design an ideal team evaluation process. Each phase of the framework is described in detail, and its use is demonstrated with a hypothetical emergency response training scenario.
Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.
Ostrander, Alec; Gilbert, Stephen B.; and Dorneich, Michael C., "Team Data Analysis Using FATE: Framework for Automated Team Evaluation" (2019). Industrial and Manufacturing Systems Engineering Conference Proceedings and Posters. 192.