Team Data Analysis Using FATE: Framework for Automated Team Evaluation

Thumbnail Image
Date
2019-01-01
Authors
Gilbert, Stephen
Dorneich, Michael
Major Professor
Advisor
Committee Member
Journal Title
Journal ISSN
Volume Title
Publisher
Authors
Person
Dorneich, Michael
Professor
Person
Gilbert, Stephen
Associate Professor
Research Projects
Organizational Units
Organizational Unit
Organizational Unit
Organizational Unit
Psychology
The Department of Psychology may prepare students with a liberal study, or for work in academia or professional education for law or health-services. Graduates will be able to apply the scientific method to human behavior and mental processes, as well as have ample knowledge of psychological theory and method.
Organizational Unit
Industrial and Manufacturing Systems Engineering
The Department of Industrial and Manufacturing Systems Engineering teaches the design, analysis, and improvement of the systems and processes in manufacturing, consulting, and service industries by application of the principles of engineering. The Department of General Engineering was formed in 1929. In 1956 its name changed to Department of Industrial Engineering. In 1989 its name changed to the Department of Industrial and Manufacturing Systems Engineering.
Journal Issue
Is Version Of
Versions
Series
Department
Aerospace EngineeringVirtual Reality Applications CenterPsychologyIndustrial and Manufacturing Systems EngineeringPsychologyGerontology
Abstract

In this paper we introduce a conceptual framework for the design of automated team evaluation processes (FATE), inspired by lessons learned from multiple intelligent team tutoring experiences. The framework consists of five phases. The first, Team Construct, defines the theoretical basis of the evaluation and therefore the end goal of the evaluation process. The second, Behavioral Markers, defines a method for identifying the otherwise unobservable constructs. The third, Raw Data, defines the data to be captured and recorded. The fourth, Enriched State Representation, defines a method for making the data directly relevant for team evaluation. The fifth, Team Metric, is the end goal of the evaluation defined by team constructs and derived from the enriched state representation. The framework is organized in a “V” shape to act both as a hierarchical model relating teaming theory to scenario-specific data and as a sequential process flow diagram representing the steps recommended to design an ideal team evaluation process. Each phase of the framework is described in detail, and its use is demonstrated with a hypothetical emergency response training scenario.

Comments

This proceeding is published as Ostrander, Alec, Stephen Gilbert, and Michael Dorneich. "Team Data Analysis Using FATE: Framework for Automated Team Evaluation." In Workshop Proceedings: Approaches and Challenges in Team Tutoring. Proceedings of the Approaches and Challenges in Team Tutoring Workshop held in conjunction with the 20th Artificial Intelligence in Education Conference (AIED 2019). Chicago, IL, USA, June 29, 2019. (Anne M. Sinatra and Jeanine A. DeFalco, eds.) (2019): 5-14. Posted with permission.

Description
Keywords
Citation
DOI
Source
Copyright
Tue Jan 01 00:00:00 UTC 2019