Theory of trust and acceptance of artificial intelligence technology (TrAAIT): An instrument to assess clinician trust and acceptance of artificial intelligence Journal Article
| Authors: | Stevens, A. F.; Stetson, P. |
| Article Title: | Theory of trust and acceptance of artificial intelligence technology (TrAAIT): An instrument to assess clinician trust and acceptance of artificial intelligence |
| Abstract: | Background: Artificial intelligence and machine learning (AI/ML) technologies like generative and ambient AI solutions are proliferating in real-world healthcare settings. Clinician trust affects adoption and impact of these systems. Organizations need a validated method to assess factors underlying trust and acceptance of AI for clinical workflows in order to improve adoption and the impact of AI. Objective: Our study set out to develop and assess a novel clinician-centered model to measure and explain trust and adoption of AI technology. We hypothesized that clinicians’ system-specific Trust in AI is the primary predictor of both Acceptance (i.e., willingness to adopt), and post-adoption Trusting Stance (i.e., general stance towards any AI system). We validated the new model at an urban comprehensive cancer center. We produced an easily implemented survey tool for measuring clinician trust and adoption of AI. Methods: This survey-based, cross-sectional, psychometric study included a model development phase and validation phase. Measurement was done with five-point ascending unidirectional Likert scales. The development sample included N = 93 clinicians (physicians, advanced practice providers, nurses) that used an AI-based communication application. The validation sample included N = 73 clinicians that used a commercially available AI-powered speech-to-text application for note-writing in an electronic health record (EHR). Analytical procedures included exploratory factor analysis (EFA), confirmatory factor analysis (CFA), and partial least squares structural equation modeling (PLS-SEM). The Johnson-Neyman (JN) methodology was used to determine moderator effects. Results: In the fully moderated causal model, clinician trust explained a large amount of variance in their acceptance of a specific AI application (56%) and their post-adoption general trusting stance towards AI in general (36%). Moderators included organizational assurances, length of time using the application, and clinician age. The final validated instrument has 20 items and takes 5 min to complete on average. Conclusions: We found that clinician acceptance of AI is determined by their degree of trust formed via information credibility, perceived application value, and reliability. The novel model, TrAAIT, explains factors underlying AI trustworthiness and acceptance for clinicians. With its easy-to-use instrument and Summative Score Dashboard, TrAAIT can help organizations implementing AI to identify and intercept barriers to clinician adoption in real-world settings. © 2023 Elsevier Inc. |
| Keywords: | adult; reproducibility; reproducibility of results; analytic method; health care; cancer center; artificial intelligence; scoring system; predictor variable; cross-sectional study; cross-sectional studies; multivariant analysis; health personnel attitude; technology; psychometry; factor analysis; trust; machine learning; human computer interaction; moderators; humans; human; male; female; article; likert scale; electronic health record; least squares approximations; machine-learning; e-learning; urban hospital; artificial intelligence technologies; ai/ml adoption; clinician trust; digital healthcare; technology acceptance; trustworthy artificial intelligence/machine learning (ai/ml); artificial intelligence learning; artificial intelligence/machine learning adoption; post adoptions; trustworthy artificial intelligence/machine learning; causal model; summative score dashboard |
| Journal Title: | Journal of Biomedical Informatics |
| Volume: | 148 |
| ISSN: | 1532-0464 |
| Publisher: | Elsevier Inc. |
| Date Published: | 2023-12-01 |
| Start Page: | 104550 |
| Language: | English |
| DOI: | 10.1016/j.jbi.2023.104550 |
| PUBMED: | 37981107 |
| PROVIDER: | scopus |
| PMCID: | PMC10815802 |
| DOI/URL: | |
| Notes: | Article -- MSK Cancer Center Support Grant (P30 CA008748) acknowledged in PDF -- MSK corresponding author is Alexander Stevens -- Source: Scopus |
Altmetric
Citation Impact
BMJ Impact Analytics
Related MSK Work