False alarms thwart remote patient monitoring early warnings

By Nick Taylor

- Last updated on GMT

(Igor Alecsander/iStock via Getty Images Plus)
(Igor Alecsander/iStock via Getty Images Plus)

Related tags Wearables Remote patient monitoring Decentralized trials Patient centricity Clinical trials

A study out of Israel's Sheba Medical Center found wearables used to monitor patients can provide early warnings of deterioration, as well as false alarms.

According to a recent clinical trial, wearable remote patient monitoring devices can provide early warnings of the deterioration of patients but also cause a high rate of false alarms.

The trial, details of which were published in JMIR Formative Research Journal,​ enrolled 410 patients at high risk of deterioration at Sheba Medical Center in Israel. Participants wore Biobeat Technologies’ wireless, noninvasive reflective photoplethysmography-based sensor, allowing the investigators to record variables such as heart rate and blood oxygen saturation every five minutes.

Using the data, the researchers calculated early warning scores every five minutes using three methods: the National Early Warning Score (NEWS), the Airway, Breathing, Circulation, Neurology, and Other (ABCNO) score, and deterioration criteria defined by the clinical team as a “wish list” score.

Among the 217 patients included in the final analysis, there were 24 cases of clinical deterioration. NEWS indicated a high alert for 16 of the patients. On average, the system provided the alert 29 hours before the clinical deterioration of the patient.

The ABCNO score indicated high alert in 18 of the patients, on average 38 hours before deterioration. The earliest, most comprehensive detection was achieved by the wish list scoring criteria, which detected all 24 cases of clinical deterioration 40 hours before medical staff, on average.

However, false positives were common. Across the analysis, 193 of the participants did not suffer clinical deterioration. NEWS provided early warning alerts for 150 of the patients. ABCNO delivered alerts for 162 of the patients. The wish list criteria delivered early warning alerts for all 193 of the patients.

The early warning systems, therefore, achieved high sensitivity but low specificity. In the case of the wish list criteria, the most extreme example, the sensitivity was 100% and the specificity was 0%, leading the authors of the paper to caution that the systems could lead to “provider fatigue​” in real-world settings.

This clearly shows that the ‘wish list’ criteria cannot be used for early warning​,” wrote the authors of the paper. “However, it seems that by further improving these EWS systems, sensitivity could be kept high, while specificity would be higher. This was not achieved yet, but preliminary data from various studies implementing big data analysis of multiple physiologic parameters collected automatically and frequently already show promise in early detection of clinically significant changes​.”

Potential areas for improvement include the adjustment of the early warning systems to provide tailored scores for different medical conditions.  

Related news

Show more

Related products

show more

How a Clinical MDR Helps with Data Quality

How a Clinical MDR Helps with Data Quality

Formedix | 16-Jan-2023 | Technical / White Paper

This article covers the many ways a clinical metadata repository helps with data quality in the clinical trial process, and how it ultimately helps to...

Optimizing Adherence in DCTs

Optimizing Adherence in DCTs

PPD - Decentralized Clinical Trials | 12-Jan-2023 | Technical / White Paper

Prioritizing greater patient-centricity and creating an opportunity to reach unprecedented patient groups, decentralized and hybrid clinical trials are...

PPD is Supporting Complex EU DCTs

PPD is Supporting Complex EU DCTs

PPD - Decentralized Clinical Trials | 05-Jan-2023 | Technical / White Paper

PPD supports European DCTs and clinical trial sponsors with a holistic and comprehensive approach

What should a clinical metadata repository do?

What should a clinical metadata repository do?

Formedix | 14-Dec-2022 | Technical / White Paper

Choosing a clinical metadata repository (MDR) software can be a tough task as the capabilities and features of your chosen MDR could make or break your...

Related suppliers

Follow us


View more