Research

introduction TO DISSERTATION RESEARCH

The challenge of autonomy is not replacing humans but designing systems that allow humans and machines to work together effectively.

The following projects represent a set of research investigations into HUMAN PERFORMANCE AND human autonomy teaming. Each project approaches the problem from a different perspective, examining how trust develops, how coordination emerges between humans and autonomous systems, and how these interactions influence team performance.

This work was conducted in the Cyber-Human-Physical Systems Lab at UC Davis. I had the privilege of working for the NASA HOME STRI.

Real-Time Inference and Prediction of Trust in Human-Autonomy Teaming

My research examines how trust evolves during interactions between humans and autonomous systems. As people observe system behavior, they continually update their expectations about reliability, capability, and intent. Understanding these dynamics requires objective and unobtrusive methods for inferring trust as it changes over time.

This project develops embedded and physiological measures, together with predictive models, to assess trust dynamics within individual interactions in human autonomy teams. The goal is to enable real time inference of trust states and support adaptive system behaviors that promote effective human autonomy teaming.

This work is conducted in collaboration with Dr. Allie Anderson and Dr. Torin Clark at the University of Colorado Boulder.

Overview of the experiment

publications

Yimin Qin, Gregory Bales, Sarah Leary, Allison Hayman, Torin Clark, Zhaodan Kong: Real-time EEG-based Trust Inference in Human Autonomy Teaming by Using Dynamic State-space Models. In: IEEE Access, vol. x, no. xxx, pp. 1–25, 2026, ISSN: xxx.
Gregory Bales, Allison P. A. Hayman, Torin K. Clark, Jason Dekarske, Sanjay Joshi, Zhaodan Kong: An EEG-network-metric based approach to real-time trust inference in human-autonomy teaming. In: Frontiers in Neuroergonomics, vol. Volume 6 – 2025, 2025, ISSN: 2673-6195.

HUMAN-ROBOT INTERACTION

Human–autonomy teams are increasingly expected to operate in demanding environments such as search and rescue, hazard response, and space exploration. In these settings, autonomous agents coordinate their actions with human operators to achieve shared goals. While autonomous technologies continue to advance, the effectiveness of these teams often depends on the human operator’s ability to apply knowledge and expertise in dynamic and uncertain conditions.

A central challenge in human autonomy teaming is developing systems that can support operators during complex tasks. One important step toward this goal is the ability to estimate changes in human cognitive state in real time.

In this project, we examined both behavioral and neurophysiological responses as participants piloted a team of robots in a target identification and acquisition task. The primary experimental factor was the difficulty of estimating the kinematic state of the robot group. In addition to gaze behavior and pilot inputs, we analyzed EEG spectral power and measures of functional connectivity to investigate how cognitive state relates to performance during human–robot team coordination.

Setup of the Robot Driving Experiment
Gaze behavior of the subject as they pilot a robotic group

publications

Gregory Bales, Zhaodan Kong: Neurophysiological and Behavioral Differences in Human-Multiagent Tasks: An EEG Network Perspective. In: ACM Transactions on Human-Robot Interaction, vol. 11, no. 4, pp. 1–25, 2022, ISSN: 2573-9522.

Data Driven Personalized Training of Next Generation Workforce

Humans will continue to play a central role in future manufacturing as operators, designers, and decision makers. At the same time, the systems they interact with are becoming increasingly complex with the growth of industrial cyber physical systems and the Industrial Internet of Things. This project developed a data driven approach for modeling and analyzing human manual expertise during a grinding task. The goal is to support more effective collaboration between humans and machines and to help preserve and transfer skilled knowledge across generations. This work was conducted in collaboration with Dr. Barbara Linke.

In this study, we examined how behavior and performance relate during a manual grinding task performed by participants with different skill levels. The results revealed distinct sensorimotor patterns associated with different techniques, and these techniques were shown to influence task performance.

Setup of the grinding experiment
Gaze Data of Novice Subject
Gaze Data of Expert Subject

publications

Jayanti Das, Gregory L. Bales, Zhaodan Kong, Barbara Linke: Integrating Operator Information for Manual Grinding and Characterization of Process Performance Based on Operator Profile. In: Journal of Manufacturing Science and Engineering, vol. 140, no. 8, 2018, ISSN: 1528-8935.
Gregory L. Bales, Jayanti Das, Jason Tsugawa, Barbara Linke, Zhaodan Kong: Digitalization of Human Operations in the Age of Cyber Manufacturing: Sensorimotor Analysis of Manual Grinding Performance. In: Journal of Manufacturing Science and Engineering, vol. 139, no. 10, 2017, ISSN: 1087-1357.
Gregory Bales, Jayanti Das, Barbara Linke, Zhaodan Kong: Recognizing Gaze-Motor Behavioral Patterns in Manual Grinding Tasks. In: Procedia Manufacturing, vol. 5, pp. 106–121, 2016, ISSN: 2351-9789.