Developing a Protocol for the External Validation of a Clinical Prediction Model for the Diagnosis of Immune Thrombocytopenia

Abstract

Defined as a platelet count <100x109/L with no known cause, immune thrombocytopenia (ITP) is a diagnosis of exclusion, meaning other thrombocytopenic conditions must be ruled out before establishing the ITP diagnosis. This can lead to errors, unnecessary exposures to expensive and harmful treatments, and increased patient anxiety and distress. In the absence of a standardized diagnostic test, a clinical prediction model, called the Predict-ITP tool, was developed to aid hematologists in establishing the ITP diagnosis among patients who present with thrombocytopenia. Based on a cohort of 839 patients referred to an academic hematology clinic and using penalized logistic regression, the following predictor variables for the ITP diagnosis were identified: 1) high platelet variability index; 2) lowest platelet count; 3) highest mean platelet volume; and 4) history of a major bleed. Internal validation was completed using bootstrap resampling, and showed good discrimination and excellent calibration. Following internal validation and prior to implementation, the Predict-ITP Tool must undergo external validation by evaluating the tool’s performance in a different cohort. A study protocol was developed with the objective of externally validating the Predict-ITP Tool by collecting data from 960 patients from 11 clinics across Canada. The tool will compute the probability of ITP using information available at the time of the initial consultation, and results will be compared with either the local hematologist’s diagnosis at the end of follow-up or the adjudicated diagnosis. Discrimination (the ability to differentiate between patients with and without ITP) and calibration (the agreement between predicted and actual classifications) of the tool will be assessed. The Predict-ITP Tool must demonstrate good discrimination (c-statistic ≥ 0.8) and excellent calibration (calibration-in-the-large close to 0; calibration slope close to 1) to achieve external validation. If implemented, this tool will improve diagnostic accuracy and reduce delays in diagnosis and unnecessary treatments and investigations.