Dr. Beau G. Schelble
Principal Investigator
06ARCS Lab — Research Area · Methods
Evaluation & Validation.
Rigorous science requires rigorous methods. We develop and apply novel experimental frameworks to test the effectiveness, safety, and reliability of AI teammates in both controlled and naturalistic settings.
- Publications
- 18
- Lab Authors
- 2
Research focus
- Mixed-methods experimental designs for human-AI team research
- Behavioral and physiological measures of team performance
- Validated survey instruments for trust, SA, and team cognition
- Wizard-of-Oz and simulation platforms for AI teammate evaluation
- Longitudinal and within-subjects team dynamics studies
Methods
Like all ARCS Lab research, this area is mixed-methods: Quantitative Qualitative Computational
How we work06 · Selected Work
Representative publications
HFES, 2024
A Comparative Evaluation of Ad Hoc Team Performance in Modern Collaborative Technology
Schelble (ARCS Lab member), Lancaster, Mallick et al.
IJHCI, 2022
Investigating the Effects of Perceived Teammate Artificiality
Schelble (ARCS Lab member) et al.
Computers in Human Behavior, 2021
What Happens When Humans Believe Their Teammate is an AI?
Musick, O'Neill, Schelble (ARCS Lab member) et al.
Publications
18 papers in Evaluation & Validation
- 2026Bridging Human–AI Interaction and Human–Robot Interaction: Shared Challenges, Converging FuturesConference Paper · HFES
- 2026A Mixed Methods Approach to Analyzing the Role of AI Teammates in Transition PhasesJournal Article · PACM HCIFree PDF
- 2026Modeling Human Behavior in Cybersecurity: Leveraging Structural Equation Modeling to Address Cognitive Biases and Enhance Defense StrategiesBook Chapter · Springer
- 2025Leveraging Generative AI to Create Lightweight Simulations for Far-Future Autonomous TeammatesConference Paper · HFESFree PDF
- 2024Understanding the Influence of AI Autonomy on AI Explainability in Human-AI Teams Using a Mixed Methods ApproachJournal Article · Cogn. Tech. WorkFree PDF
- 2024A Comment on "Can You Outsmart the Robot?" — Calling for a Different Path for the Future of Human–Robot TeamingJournal Article · AMDFree PDF
- 2024A Comparative Evaluation of Ad Hoc Team Performance, Effectiveness, and Interactions in Modern Collaborative TechnologyConference Paper · HFESFree PDF
- 2023Understanding the Impact and Design of AI Teammate EtiquetteJournal Article · HCIFree PDF
- 2023Refocusing Human-AI Interaction Through a Teamwork LensBook Chapter · Edward ElgarFree PDF
- 2023Intelligent Sharing is Caring: Toward the Design of an Intelligent System to Facilitate Team SharingConference Paper · HICSSFree PDF
- 2022Exploring the Relationship Between Ethics and Trust in Human-AI Teaming: A Mixed Methods ApproachJournal Article · JCEDMAwardFree PDF
- 2021What Happens When Humans Believe Their Teammate is an AI? An Investigation into Humans Teaming with AutonomyJournal Article · CHBFree PDF
- 2021Understanding Human-AI Cooperation Through Game Theory and Reinforcement Learning ModelsConference Paper · HICSSAwardFree PDF
- 2021Reducing Bias by Prioritizing Multi-Cultural Human-Agent TeamsWorkshop Paper · CSCW '21 Workshop
- 2020Human–Autonomy Teaming: A Review and Analysis of the Empirical LiteratureJournal Article · Human FactorsFree PDF
- 2020Designing Human-Autonomy Teaming Experiments Through Reinforcement LearningConference Paper · HFESFree PDF
- 2020Invoking Principles of Groupware to Develop and Evaluate Present and Future Human-Agent TeamsConference Paper · HAIAwardFree PDF
- 2020Towards Meaningfully Integrating Human-Autonomy Teaming in Applied SettingsConference Paper · HAIFree PDF
People
Lab members in this area
ARCS Lab members who have authored publications in Evaluation & Validation.
Yayun Tian
PhD Student, Industrial & Systems Engineering