Optimization of alert notifications in electronic patient-reported outcome (ePRO) remote symptom monitoring systems (AFT-39) Journal Article


Authors: Mazza, G. L.; Dueck, A. C.; Ginos, B.; Jansen, J.; Deal, A. M.; Carr, P.; Blinder, V. S.; Thanarajasingam, G.; Jonsson, M.; Lee, M. K.; Rogak, L. J.; Mody, G. N.; Schrag, D.; Basch, E.
Article Title: Optimization of alert notifications in electronic patient-reported outcome (ePRO) remote symptom monitoring systems (AFT-39)
Abstract: Purpose: Clinical benefits result from electronic patient-reported outcome (ePRO) systems that enable remote symptom monitoring. Although clinically useful, real-time alert notifications for severe or worsening symptoms can overburden nurses. Thus, we aimed to algorithmically identify likely non-urgent alerts that could be suppressed. Methods: We evaluated alerts from the PRO-TECT trial (Alliance AFT-39) in which oncology practices implemented remote symptom monitoring. Patients completed weekly at-home ePRO symptom surveys, and nurses received real-time alert notifications for severe or worsening symptoms. During parts of the trial, patients and nurses each indicated whether alerts were urgent or could wait until the next visit. We developed an algorithm for suppressing alerts based on patient assessment of urgency and model-based predictions of nurse assessment of urgency. Results: 593 patients participated (median age = 64 years, 61% female, 80% white, 10% reported never using computers/tablets/smartphones). Patients completed 91% of expected weekly surveys. 34% of surveys generated an alert, and 59% of alerts prompted immediate nurse actions. Patients considered 10% of alerts urgent. Of the remaining cases, nurses considered alerts urgent more often when patients reported any worsening symptom compared to the prior week (33% of alerts with versus 26% without any worsening symptom, p = 0.009). The algorithm identified 38% of alerts as likely non-urgent that could be suppressed with acceptable discrimination (sensitivity = 80%, 95% CI [76%, 84%]; specificity = 52%, 95% CI [49%, 55%]). Conclusion: An algorithm can identify remote symptom monitoring alerts likely to be considered non-urgent by nurses, and may assist in fostering nurse acceptance and implementation feasibility of ePRO systems. © The Author(s), under exclusive licence to Springer Nature Switzerland AG 2024.
Keywords: adult; controlled study; aged; middle aged; major clinical study; neoplasm; neoplasms; prevalence; practice guideline; oncology; algorithms; prediction; health service; questionnaire; symptom; algorithm; caregiver; patient reported outcome measures; supportive care; online system; patient-reported outcome; clinician; interactive voice response system; remote monitoring; humans; human; male; female; article; surveys and questionnaires; remote sensing; malignant neoplasm; alert notification; electronic patient-reported outcome; symptom report
Journal Title: Quality of Life Research
Volume: 33
Issue: 7
ISSN: 0962-9343
Publisher: Springer  
Date Published: 2024-07-01
Start Page: 1985
End Page: 1995
Language: English
DOI: 10.1007/s11136-024-03675-3
PUBMED: 38771558
PROVIDER: scopus
PMCID: PMC11825061
DOI/URL:
Notes: Source: Scopus
Altmetric
Citation Impact
BMJ Impact Analytics
MSK Authors
  1. Deborah Schrag
    229 Schrag
  2. Victoria Susana Blinder
    111 Blinder