TY - GEN
T1 - To Trust or Distrust AI
T2 - 8th Annual ACM Conference on Fairness, Accountability, and Transparency, FAccT 2025
AU - Scharowski, Nicolas
AU - Perrig, Sebastian A.C.
AU - Von Felten, Nick
AU - Aeschbach, Lena Fanya
AU - Opwis, Klaus
AU - Wintersberger, Philipp
AU - Brühlmann, Florian
N1 - Publisher Copyright:
© 2025 Copyright held by the owner/author(s).
PY - 2025/6/23
Y1 - 2025/6/23
N2 - Despite the importance of trust in human-AI interactions, researchers must often rely on questionnaires adapted from other fields, which lack validation in the AI context. Motivated by the need for reliable and valid measures, we investigated the psychometric quality of the most commonly used trust questionnaire in the context of AI by Jian, Bisantz, and Drury (2000). In a pre-registered online experiment (N = 1485), participants observed interactions with both trustworthy and untrustworthy AI and rated their trust. Our results did not support the originally proposed single-factor structure for the questionnaire, but instead suggested a two-factor solution that distinguishes between trust and distrust. Based on our findings, we provide recommendations for future studies on how to use the questionnaire. Finally, we present arguments for considering trust and distrust as two distinct constructs, emphasizing the opportunities of considering and measuring both in human-AI interactions.
AB - Despite the importance of trust in human-AI interactions, researchers must often rely on questionnaires adapted from other fields, which lack validation in the AI context. Motivated by the need for reliable and valid measures, we investigated the psychometric quality of the most commonly used trust questionnaire in the context of AI by Jian, Bisantz, and Drury (2000). In a pre-registered online experiment (N = 1485), participants observed interactions with both trustworthy and untrustworthy AI and rated their trust. Our results did not support the originally proposed single-factor structure for the questionnaire, but instead suggested a two-factor solution that distinguishes between trust and distrust. Based on our findings, we provide recommendations for future studies on how to use the questionnaire. Finally, we present arguments for considering trust and distrust as two distinct constructs, emphasizing the opportunities of considering and measuring both in human-AI interactions.
KW - AI
KW - Distrust
KW - human-AI interaction
KW - Measurement
KW - Psychometrics
KW - Questionnaires
KW - Survey scale
KW - Trust
KW - Validation
KW - XAI
UR - https://www.scopus.com/pages/publications/105010833773
U2 - 10.1145/3715275.3732025
DO - 10.1145/3715275.3732025
M3 - Conference contribution
AN - SCOPUS:105010833773
T3 - ACMF AccT 2025 - Proceedings of the 2025 ACM Conference on Fairness, Accountability,and Transparency
SP - 361
EP - 374
BT - ACMF AccT 2025 - Proceedings of the 2025 ACM Conference on Fairness, Accountability,and Transparency
PB - Association for Computing Machinery, Inc
Y2 - 23 June 2025 through 26 June 2025
ER -