Skip to main content

Development and validation of a risk prediction nomogram for in-stent restenosis in patients undergoing percutaneous coronary intervention

Abstract

Background

This study aimed to develop and validate a nomogram to predict probability of in-stent restenosis (ISR) in patients undergoing percutaneous coronary intervention (PCI).

Methods

Patients undergoing PCI with drug-eluting stents between July 2009 and August 2011 were retrieved from a cohort study in a high-volume PCI center, and further randomly assigned to training and validation sets. The least absolute shrinkage and selection operator (LASSO) regression model was used to screen out significant features for construction of nomogram. Multivariable logistic regression analysis was applied to build a nomogram-based predicting model incorporating the variables selected in the LASSO regression model. The area under the curve (AUC) of the receiver operating characteristics (ROC), calibration plot and decision curve analysis (DCA) were performed to estimate the discrimination, calibration and utility of the nomogram model respectively.

Results

A total of 463 patients with DES implantation were enrolled and randomized in the development and validation sets. The predication nomogram was constructed with five risk factors including prior PCI, hyperglycemia, stents in left anterior descending artery (LAD), stent type, and absence of clopidogrel, which proved reliable for quantifying risks of ISR for patients with stent implantation. The AUC of development and validation set were 0.706 and 0.662, respectively, indicating that the prediction model displayed moderate discrimination capacity to predict restenosis. The high quality of calibration plots in both datasets demonstrated strong concordance performance of the nomogram model. Moreover, DCA showed that the nomogram was clinically useful when intervention was decided at the possibility threshold of 9%, indicating good utility for clinical decision-making.

Conclusions

The individualized prediction nomogram incorporating 5 commonly clinical and angiographic characteristics for patients undergoing PCI can be conveniently used to facilitate early identification and improved screening of patients at higher risk of ISR.

Peer Review reports

Background

Coronary heart disease severely threatens the health of individuals worldwide with a rising incidence and a leading cause of mortality. Revascularization with percutaneous coronary intervention (PCI) is a well-established and effective therapeutic strategy for advanced coronary heart disease, particularly following the introduction of drug-eluting stents (DES) [1]. While the incidence of in-stent restenosis (ISR) and target lesion revascularization is substantially reduced by DES compared with the bare-metal stents (BMS), they are not eliminated. ISR after DES implantation with an incidence of 3–20% remains a pervasive clinical problem which should not be neglected [2,3,4]. Hence, tools for the identification of individual patients at higher risk for ISR with stent implantation are especially needed.

Although several prior studies have analyzed potential predictive factors associated with a high incidence of ISR based on patient and procedure-related factors, there are still some limitations that confine their clinical application. Prediction model for ISR is yet to be fully developed and validated [5,6,7]. Of note, most studies have only focused on comprehensively identifying the predictors of ISR or developing prediction models without an individual risk prediction tool, while the simplicity and ease of use for the clinicians and patients were not well considered [7,8,9]. Thus, a more solid, well-validated and easy-to-use clinical ISR prediction model for all patients with stent implantation, especially for clinical decision in primary prevention, is urgently needed for accurate prognostication of future events.

The nomogram-based predicting model has been widely implemented in clinical studies. Featured by the advantage of visualization, a well-developed nomogram based on statistical regression models is a cogent tool to make clinical decision for clinicians and to assess straightforward the probability of disease for individual patients without complex formula, thus could benefit both doctors and patients.

Based on these premises, this study aimed to identify factors correlated to the risk of ISR for individual patients undergoing PCI, using data from an observational single-center registry study. These factors were used to develop and validate a nomogram-based clinical prediction model. This model could help clinicians discern high-risk ISR patients, optimize treatment strategy, and improve prognosis of these patients.

Methods

Study population

This study was a secondary analysis of an observational cohort study conducted between July 2009 and August 2011, in a high-volume PCI center, in Henan Province, China [10]. A total of 2,533 patients undergoing PCI with DES were enrolled and the median follow-up time was 29.8 months. The protocol was approved by the ethical committee in accordance with local regulations. The original work was in accordance with the Creative Commons Attribution Non-Commercial (CC BY-NC 3.0) license. The datasets analyzed during the current study are available in the Dryad data repository, https://0-doi-org.brum.beds.ac.uk/10.5061/dryad.13d31 [11]. Dyrad is a non-profit membership organization that is committed to making data available for research and educational reuse. Informed consent was waived because this is a post-hoc study using existing research data.

The goal of this study was to identify factors associated with ISR in the patients with DES implantation, considering individual patient characteristics and their independent connection with ISR events. Generally, binary angiographic restenosis is defined as ≥ 50% luminal narrowing at follow-up angiography. Thus, we excluded 1,930 patients who were lost to angiographic follow-up and 116 patients with missing data. In addition, 24 patients with > 1 type of stent but the location of stents unknown were also screened out. After these exclusions, 463 patients were at last randomized and analyzed (Fig. 1).

Fig. 1
figure 1

Study flow diagram for developing and validating the ISR risk model

Risk factors

A total of 36 candidate variables, based on clinical plausibility and previous studies, were identified for further processing. The variables considered in this study were clinical characteristics (age, gender, presentation, old myocardial infarction, prior PCI, heart failure, atrial fibrillation, hypertension, diabetes mellitus, smoking), laboratory tests (systolic BP, diastolic BP, glycemia, uric acid, LDL-C), lesion and procedure characteristics (acute occlusion lesions, chronic total occlusions, restenotic lesions, location of stents, number of treated vessels, stent type, stent number, total stent length, stent diameter), and use of medications (aspirin, clopidogrel, statins, β-receptor blockers, ACEIs/ARBs, calcium channel blockers).

Statistical analysis

To facilitate ease of use, all independent variables were transformed into categorical variables and expressed as count (%) based on confirmation that the gradient of effect was maintained. Statistical analysis was performed using the R software version 3.6.3, and two-tailed analysis with P < 0.05 was considered statistically significant.

We randomly designated 70% of the study population as the development set, while the rest were divided into the validation set. Patients in the development and validation set were compared using Chi-square test. The LASSO-penalized regression analysis, which is competent to estimate the parameters in high-dimensional regression, was applied to select predictors of ISR using the R package Glmnet [12, 13]. After the ISR predictors were confirmed, multivariable logistic regression analysis was used in the development set to evaluate the predictors and construct a nomogram predicting model along with their associated odds ratios (OR), 95% confidence intervals (CI), β-coefficients, and P-value.

The nomogram model performance was evaluated in terms of discrimination and calibration. The discrimination of the model was assessed by calculating the area under the curve (AUC) of the receiver operating characteristics (ROC), which indicated the predictive accuracy of the nomogram. Generally, the diagnostic accuracy with an AUC equal or above 0.6 is considered acceptable [14, 15]. Calibration plots were used for the comparison between the predicted and observed probabilities in both sets, and a significant difference implies the poor calibration of the prediction model. Furthermore, decision curve analysis (DCA) plotted net benefit (NB) at a range of clinically reasonable risk thresholds, helping assess the clinical usefulness of the model for decision making [16].

Results

Patient characteristics

A total of 463 patients undergoing PCI with DES were enrolled and randomized in this study, including 325 in the development set and 138 in the validation set. Table 1 lists 36 variables including the following aspects: clinical characteristics, laboratory findings, lesion and procedure characteristics, and use of medications for all randomized patients. Of these, 111 patients (77 in the development set and 34 in the validation set) developed in-stent restenosis. Comparisons between the development and validation sets showed no significant differences in all ISR risk-related variables (all P > 0.05).

Table 1 Baseline characteristics of the development set and validation set

Predictors of ISR

Thirty-six variables were reduced to five potential predictors on the basis of 463 patients with the 1-SE of the minimum criteria and nonzero coefficients in the lasso-penalized regression model (Fig. 2a and b). These predictors associated with the ISR of patients included the history of prior PCI, glycemia, stent in LAD, the type of stent, and absence of clopidogrel (Table 2).

Fig. 2
figure 2

Risk factor selection using the LASSO regression model. Notes: a Optimal parameter (lambda) selection in the lasso model with the 1 SE of the minimum criteria (the 1-SE criteria). Dotted vertical lines were drawn at the optimal values by using the minimum criteria and the 1-SE criteria. b LASSO coefficient profiles of the 36 features. A coefficient profile plot was produced against the log (lambda) sequence. Vertical line was drawn at the value selected, where optimal lambda resulted in five features with nonzero coefficients

Table 2 Prediction factors for ISR

Construction of nomogram

Features screened from the lasso-penalized regression analysis were included in the binary multivariate logistic regression in the development set. The five factors of prior PCI, glycemia, stents in LAD, the type of stent, and absence of clopidogrel were independent risk factors of ISR (Table 2) (all P < 0.05). Collinearity diagnostic test did not indicate significant collinearity between independent variables in the regression model, and the variance inflation factors (VIFs) were 1.032, 1.016, 1.063, 1.053 and 1.013, respectively (all VIFs < 10). We then established an individualized nomogram that incorporated the five significant predictive factors based on the logistic multivariate regression analysis (Fig. 3).

Fig. 3
figure 3

Nomogram to predict the probability of ISR in the patient with stent implantation. Note: The risk prediction nomogram was developed in the development set, with prior PCI, glycemia, stent in LAD, stent type and use of clopidogrel

Validation of nomogram

The ISR nomogram was assessed for internal validation by measuring discrimination, calibration, and clinical usefulness in the development and validation sets. The AUC associated with the ISR nomogram in the development set was 0.706 and was confirmed to be 0.662 in the validation set (Fig. 4a and b), indicating the nomogram prediction model has moderate discrimination. Meanwhile, high quality of calibration plots in both datasets showed that the nomogram model had strong concordance performance compared with an ideal model (P = 0.943, and P = 0.417, respectively) (Fig. 5a and b), which suggested no significant deviation between predicted and actual probability in both sets.

Fig. 4
figure 4

ROC curves for validating the discrimination power of the nomogram. Note: a Development set. b Validation set (AUC = 0.706 vs. 0.662)

Fig. 5
figure 5

Calibration plots of the nomogram for the probability of PCI patients with in-stent restenosis in the development set and validation set. a Development set. b Validation set. (All P > 0.05)

The decision curve analysis for the ISR nomogram is presented in Fig. 6. The results indicated that using the nomogram to predict ISR could acquire much more benefit if the threshold probability is > 9%. Therefore, it could be used to predict the risk of ISR in patients undergoing PCI with high accuracy and a wider range of threshold probabilities, and it might have potentially great significance in clinical application.

Fig. 6
figure 6

Decision curve analysis for the ISR prediction nomogram in the development set. Notes: The y-axis measures the net benefit. The red line represents the ISR risk nomogram. The thin solid line represents the assumption that all patients suffer from ISR. The thick solid line represents the assumption that no patients suffer from ISR. The decision curve analysis indicated that using this ISR prediction nomogram could gain net benefit when the threshold probabilities > 5%

Discussion

Stent implantation is an effective therapy for coronary artery disease. However, ISR has always been one of the most common complications, even in the era of DES. Thus, establishing a predication model of ISR for risk-tailored screening and preventive measure implementation may be pivotal to improve clinical outcomes of patients undergoing PCI. In the present study, five clinical and angiographic characteristics including the history of prior PCI, glycemia, stents in LAD, the type of stent, and absence of clopidogrel were found to independently predict ISR in DES recipients. Moreover, the nomogram prediction model based on these independent factors was constructed and validated, which could provide clinicians with an easy-to-use clinical tool for individualized assessments of patients with high-risk of ISR. Notably, visually and prospectively informing patients of the benefits of risk factor control may improve the patient's understanding of treatment and compliance of therapies, which has great significance for reducing the risk of ISR after stent implantation.

Patients undergoing PCI are exposed to an increased risk of ischemic and bleeding events. Risk models to predict the risk of bleeding events, ischemic events and mortality after PCI have been widely reported. The PRAISE score was a machine learning-based model for the prediction of all-cause death, myocardial infarction, and major bleeding in patients after an acute coronary syndrome [17]. The leading predictors of both myocardial infarction and major bleeding in this model was hemoglobin level, age, left ventricular ejection fraction (LVEF), and estimated glomerular filtration rate (EGFR). The ARC-HBR score is a criterion used for identifying PCI patients with high risk of bleeding events. Risk factors in this criterion includes age, oral anticoagulation, chronic kidney disease, hemoglobin, prior bleeding, thrombocytopenia, chronic bleeding diathesis, liver cirrhosis with portal hypertension, use of NSAIDs or Steroids, active malignancy, prior stroke, and surgery or trauma within 30 days [18]. The PRECISE-DAPT score was also a model to predict bleeding risks for patients after coronary stenting [19], which was based on five factors: integrating age, hemoglobin, white-blood-cell count, creatinine clearance, and prior bleeding. Age, hemoglobin and renal function are the common risk factors in these models. However, these factors were not found in our models for the prediction of ISR in DES, revealing that ISR was associated with different mechanisms, compared with bleeding events, myocardial infarction or death.

Although the exact mechanism of ISR in DES is unclear and probably multifactorial, it is currently accepted that factors including biological, mechanical, and technical issues can facilitate the adverse neointimal hyperplasia and contribute to ISR after stent implantation [2]. Several studies have attempted to identify the independent predictors of ISR. Stolker et al. [20] developed a risk model for predicting restenosis of DES from the EVENT registry and identified age < 60, prior PCI, unprotected left main PCI, saphenous vein graft PCI, minimum stent diameter ≤ 2.5 mm, and total stent length ≥ 40 mm as the predictors of ISR. In another study evaluating the incidence and predictors of target vessel revascularization among 27,107 patients undergoing implantation of BMS or DES, significant predictors of restenosis included prior PCI, emergency or salvage PCI, prior coronary artery bypass grafting (CABG), peripheral vascular disease, diabetes mellitus (DM), and angiographic characteristics [8]. Lately, Zheng et al. [21] analyzed 944 stented lesions from 394 patients with 2nd-generation DES implantation. Factors including DM, previous PCI, postprocedural diameter stenosis and CRP levels were found to independently predict target lesion revascularization. A large patient data pooled analysis from 6 prospective and randomized trials, which included 10,072 patients undergoing DES implantation, suggested that vessel diameter, DM, prior CABG, and prior PCI were patient- and lesion-related predictors of target lesion failure [22].

Individual predictors likely vary between different studies on account of difference in the complexity of patients and candidate variables. However, the overlap in predictive factors, such as prior PCI, prior CABG, and DM, are strongly interlinked with accelerated ISR and repeated target lesion revascularization. Similar to those found in previous studies identifying predictors of ISR, our study also indicates that patient populations with prior PCI and history of DM are prone to ISR.

A history of PCI, which was a consistent and independent predictor of ISR, is closely related to the primary risk factors of atherosclerosis and represents the overall risk of severe coronary lesions requiring further intervention. It is also reported that repeated revascularization is more likely to occur for culprit lesions at a site of previous restenosis [9]. As for DM, patients have a higher risk of developing ISR due to the higher inflammatory response, endothelial dysfunction, platelet hyperreactivity and more aggressive neointimal hyperplasia accompanied by elevated plasma glucose levels [23, 24]. Generally, DM is associated with complicated coronary artery disease characterized by multivessel lesions and diffuse lesions in small vessels, which requires multiple stents with small diameter during PCI. Thus, it can explain at least partly why variables like the total length and minimum diameter of stents were not included in the prediction model in this study. In addition, a noteworthy finding of our study is that uncontrolled glycemia in patients with DM has more predictive value for ISR rather than DM itself. Hyperglycemia itself is reported to be the major cause of diabetic angiopathy [25]. High glucose could increase the expression of monocyte chemoattractant protein-1 (MCP1) and vascular cell adhesion molecule-1 (VCAM-1), thus enhance the monocyte-endothelial cell interaction and promote the atherogenic process and endothelial dysfunction [25]. Endothelial dysfunction is associated with smooth muscle cell proliferation after vascular injury, e.g., restenosis after PCI [26]. Moreover, the formations of advanced glycation end-products (AGE) and AGE-modified low-density lipoproteins (AGE-LDL), which are associated with hyperglycemia, can directly affect the cells of the vascular wall, through mechanisms including the upregulation of MCP1 in both vascular smooth muscle cells and endothelial cells [27, 28]. In addition, Marfella et al. [29] have found that hyperglycemia could increase oxidative damage and may reduce the regenerative potential of ischemic myocardium, while tight glycemic control showed protective effects.

Although several factors associated with ISR in our study are concordant with previous findings, some key predictors including stents in LAD, type of stent, and absence of clopidogrel have not been reported consistently in literature. Most studies suggested that coronary artery intervention restenosis was more frequent for lesions in the LAD than other native coronary arteries, confirming that the LAD may be another potential risk factor for ISR [30,31,32]. However, different opinions have also been proposed. To the contrary, lesions located in the LAD were reported to have a decreased restenosis rate [33, 34]. In fact, in the present study the results observed after stent implantation for LAD lesions were very similar to those observed in most studies and we believe that stents located in the LAD were associated with an elevated incidence of ISR. For lesions in LAD and other complicated lesions, intravascular ultrasound (IVUS), optical coherence tomography (OCT) and other coronary imaging techniques are recommended for optimizing the treatment strategy. In addition, our findings figured out that sirolimus-eluting stent (SES) was associated with a lower risk of ISR than paclitaxel-eluting stent (PES). Sirolimus and its analogs have a cytostatic effect on coronary artery endothelial cells, while paclitaxel has a cytotoxic effect. Several studies have also indicated that use of SES has a less late luminal loss [7, 35, 36] and a lower rate of late stent thrombosis [37], as compared with use of PES, suggesting a better performance of SES in reducing restenosis. Finally, drugs and polymers of DES can inhibit the excessive neointimal hyperplasia. However, it delays the repair of endothelial cells. Therefore, antiplatelet drugs are still the cornerstone in the treatment of coronary heart disease, especially after PCI. Gianluca et al. [38] investigated the clinical outcome of patients undergoing PCI for ISR with short (6 months) or long (24 months) dual antiplatelet therapy (DAPT). The main findings of this study were that patients receiving revascularization for ISR may benefit from long-term administration of aspirin plus clopidogrel. Similarly, our study showed that the absence of clopidogrel increased the risk of ISR after PCI, suggesting the benefit of appropriately prolonged DAPT duration for patients with high risk of ISR after DES implantation.

Predictor identification and risk assessment are essential and important to an effective medical decision making for preventing restenosis. Multifactorial intervention has shown remarkable benefits on the risks of major cardiovascular events and mortality in patients with diabetic kidney disease [39]. It is expectable that treatments targeting related risk factors will help to lower the incidence of ISR in patients receiving PCI. However, the levels of prognostic utility of prediction models of ISR in prior studies remained less than totally satisfying with c-statistic below 0.7 [8, 9, 20, 40]. In the present study, the best c-statistic derived from the nomogram model in the development set was 0.706 and was confirmed to be 0.662 in the validation set as well, suggesting that the distinct predictors improved the overall discrimination of the models. Moreover, calibration plots and decision curve analysis for the nomogram-based predication model were also performed well, making our findings more convincing and providing broad applicability in clinical practice.

Limitations

There are several limitations in this study. First, the conclusions drawn from this study are limited by the relatively small sample size. Although the Hosmer–Lemeshow goodness of fit tests were performed and indicated evidence of good fit (Chi-squared = 2.7855, P-value = 0.7330), a larger-scale study is warranted to further verify our findings. Second, although we applied strict criteria for inclusion and exclusion to truly reflect the actual condition of disease occurrence in the population underwent PCI as much as possible, it was inevitable to suffer potential selection bias in the screening procedure. The patients with asymptomatic ISR for whom angiographic follow-up is not routinely performed may have been missed. Third, the moderate c-statistic (0.706) of the ISR nomogram indicates that this prediction model remains suboptimal using included candidate variables. Some potential variables unmeasured were not thoroughly informed such as stent gap, stent under-expansion, lesion complexity and other procedure details. In addition, as a single-center study, it may not be enough to exam the robustness of the nomogram. Evidence from other centers is required for further external validation and generalizability evaluation.

Conclusions

Our study has developed and validated a robust and individualized nomogram for predicting the risk of ISR among PCI patients. This nomogram consists of five common clinical and angiographic characteristics that are easy to obtain and offers clinicians a simple-to-use clinical tool with relatively good accuracy for the early identification and screening of high-risk patients for ISR. With an estimate of individual risk, clinicians and patients can pay more attention to early and reasonable interventions for risk factors.

Availability of data and materials

The datasets analyzed during the current study are available in the Dryad data repository, https://0-doi-org.brum.beds.ac.uk/10.5061/dryad.13d31.

Abbreviations

ISR:

In-stent restenosis

PCI:

Percutaneous coronary intervention

LASSO:

Least absolute shrinkage and selection operator

AUC:

Area under the curve

ROC:

Receiver operating characteristics

DCA:

Decision curve analysis

LAD:

Left anterior descending artery

LM:

Left main stem

LCX:

Left circumflex coronary artery

RCA:

Right coronary artery

DES:

Drug-eluting stent

BMS:

Bare-metal stent

BP:

Blood pressure

LDL-C:

Low-density lipoprotein

NSTE-ACS:

Non-ST elevation acute coronary syndromes

OMI:

Old myocardial infarction

STEMI:

ST-elevation myocardial infarction

SA:

Stable angina

ACEIs:

Angiotensin-converting enzyme inhibitors

ARBs:

Angiotensin receptor blockers

OR:

Odds ratio

CI:

Confidence interval

NB:

Net benefit

SE:

Standard error

VIFs:

Variance inflation factors

LVEF:

Left ventricular ejection fraction

EGFR:

Estimated glomerular filtration rate

CABG:

Coronary artery bypass grafting

DM:

Diabetes mellitus

CRP:

C-reactive protein

MCP1:

Monocyte chemoattractant protein-1

VCAM-1:

Vascular cell adhesion molecule-1

AGE:

Advanced glycation end-products

IVUS:

Intravascular ultrasound

OCT:

Optical coherence tomography

SES:

Sirolimus-eluting stent

PES:

Paclitaxel-eluting stent

DAPT:

Dual antiplatelet therapy

References

  1. Serruys PW, Kutryk MJB, Ong ATL. Coronary-artery stents. N Engl J Med. 2006;354(5):483–95.

    Article  CAS  Google Scholar 

  2. Dangas GD, Claessen BE, Caixeta A, Sanidas EA, Mintz GS, Mehran R. In-stent restenosis in the drug-eluting stent era. J Am Coll Cardiol. 2010;56(23):1897–907.

    Article  Google Scholar 

  3. Stolker JM, Cohen DJ, Kennedy KF, Pencina MJ, Lindsey JB, Mauri L, et al. Repeat revascularization after contemporary percutaneous coronary intervention: an evaluation of staged, target lesion, and other unplanned revascularization procedures during the first year. Circ Cardiovasc Interv. 2012;5(6):772–82.

    Article  Google Scholar 

  4. Nakano M, Otsuka F, Yahagi K, Sakakura K, Kutys R, Ladich ER, et al. Human autopsy study of drug-eluting stents restenosis: histomorphological predictors and neointimal characteristics. Eur Heart J. 2013;34(42):3304–13.

    Article  CAS  Google Scholar 

  5. Cassese S, Byrne RA, Tada T, Pinieck S, Joner M, Ibrahim T, et al. Incidence and predictors of restenosis after coronary stenting in 10 004 patients with surveillance angiography. Heart (British Cardiac Soc). 2014;100(2):153–9.

    Google Scholar 

  6. Kim C, Kim B, Lee S, Shin D, Kim J, Ko Y, et al. Incidence, clinical presentation, and predictors of early neoatherosclerosis after drug-eluting stent implantation. Am Heart J. 2015;170(3):591–7.

    Article  Google Scholar 

  7. Kastrati A, Dibra A, Mehilli J, Mayer S, Pinieck S, Pache J, et al. Predictive factors of restenosis after coronary implantation of sirolimus- or paclitaxel-eluting stents. Circulation. 2006;113(19):2293–300.

    Article  Google Scholar 

  8. Yeh RW, Normand SL, Wolf RE, Jones PG, Ho KK, Cohen DJ, et al. Predicting the restenosis benefit of drug-eluting versus bare metal stents in percutaneous coronary intervention. Circulation. 2011;124(14):1557–64.

    Article  Google Scholar 

  9. Stolker JM, Cohen DJ, Kennedy KF, Pencina MJ, Arnold SV, Kleiman NS, et al. Combining clinical and angiographic variables for estimating risk of target lesion revascularization after drug eluting stent placement. Cardiovasc Revasc Med. 2017;18(3):169–76.

    Article  Google Scholar 

  10. Yao H, Wan Y, Zhang X, Shen D, Zhang J, Li L, et al. Long-term follow-up results in patients undergoing percutaneous coronary intervention (PCI) with drug-eluting stents: results from a single high-volume PCI centre. BMJ Open. 2014;4(8):e4892.

    Google Scholar 

  11. Yao H, Wan Y, Zhang X, Shen D, Zhang J, Li L et al. Data from: Long-term follow-up results in patients undergoing percutaneous coronary intervention (PCI) with drug-eluting stents: results from a single high-volume PCI center. Dryad, Dataset. 2014. https://0-doi-org.brum.beds.ac.uk/10.5061/dryad.13d31.

  12. Sauerbrei W, Royston P, Binder H. Selection of important variables and determination of functional form for continuous predictors in multivariable model building. Stat Med. 2007;26(30):5512–28.

    Article  Google Scholar 

  13. Friedman J, Hastie T, Tibshirani R. Regularization paths for generalized linear models via coordinate descent. J Stat Softw. 2010;33(1):1–22.

    Article  Google Scholar 

  14. Hayward RA, Kent DM, Vijan S, Hofer TP. Multivariable risk prediction can greatly enhance the statistical power of clinical trial subgroup analysis. BMC Med Res Methodol. 2006;6(18).

  15. Kent DM, Rothwell PM, Ioannidis JPA, Altman DG, Hayward RA. Assessing and reporting heterogeneity in treatment effects in clinical trials: a proposal. Trials. 2010;11(85).

  16. Van Calster B, Wynants L, Verbeek JFM, Verbakel JY, Christodoulou E, Vickers AJ, et al. Reporting and interpreting decision curve analysis: a guide for investigators. Eur Urol. 2018;74(6):796–804.

    Article  Google Scholar 

  17. D’Ascenzo F, De Filippo O, Gallone G, Mittone G, Deriu MA, Iannaccone M, et al. Machine learning-based prediction of adverse events following an acute coronary syndrome (PRAISE): a modelling study of pooled datasets. Lancet (Lond Engl). 2021;397(10270):199–207.

    Article  Google Scholar 

  18. Corpataux N, Spirito A, Gragnano F, Vaisnora L, Galea R, Svab S, et al. Validation of high bleeding risk criteria and definition as proposed by the academic research consortium for high bleeding risk. Eur Heart J. 2020;41(38):3743–9.

    Article  Google Scholar 

  19. Gragnano F, Heg D, Franzone A, McFadden EP, Leonardi S, Piccolo R, et al. PRECISE-DAPT score for bleeding risk prediction in patients on dual or single antiplatelet regimens: insights from the GLOBAL LEADERS and GLASSY. Eur Heart J Cardiovasc Pharmacother. 2020;9(17):pvaa106.

    Article  Google Scholar 

  20. Stolker JM, Kennedy KF, Lindsey JB, Marso SP, Pencina MJ, Cutlip DE, et al. Predicting restenosis of drug-eluting stents placed in real-world clinical practice: derivation and validation of a risk model from the EVENT registry. Circ Cardiovasc Interv. 2010;3(4):327–34.

    Article  CAS  Google Scholar 

  21. Zheng C, Kang J, Park KW, Han J, Yang H, Kang H, et al. The predictors of target lesion revascularization and rate of in-stent restenosis in the second-generation drug-eluting stent era. J Interv Cardiol. 2019;2019:3270132.

    Article  Google Scholar 

  22. Konigstein M, Madhavan MV, Ben-Yehuda O, Rahim HM, Srdanovic I, Gkargkoulas F, et al. Incidence and predictors of target lesion failure in patients undergoing contemporary DES implantation-Individual patient data pooled analysis from 6 randomized controlled trials. Am Heart J. 2019;213:105–11.

    Article  Google Scholar 

  23. Smith SCJ, Faxon D, Cascio W, Schaff H, Gardner T, Jacobs A, et al. Prevention conference VI: diabetes and cardiovascular disease: writing Group VI: revascularization in diabetic patients. Circulation. 2002;105(18):e165–9.

    Article  Google Scholar 

  24. Oktay AA, Akturk HK, Esenboğa K, Javed F, Polin NM, Jahangir E. Pathophysiology and prevention of heart disease in diabetes mellitus. Curr Prob Cardiol. 2018;43(3):68–110.

    Article  Google Scholar 

  25. Panee J. Monocyte chemoattractant protein 1 (MCP-1) in obesity and diabetes. Cytokine. 2012;60(1):1–12.

    Article  CAS  Google Scholar 

  26. Sasso FC, Rinaldi L, Lascar N, Marrone A, Pafundi PC, Adinolfi LE, et al. Role of tight glycemic control during acute coronary syndrome on CV outcome in type 2 diabetes. J Diabetes Res. 2018;2018:3106056.

    Article  Google Scholar 

  27. Sima AV, Botez GM, Stancu CS, Manea A, Raicu M, Simionescu M. Effect of irreversibly glycated LDL in human vascular smooth muscle cells: lipid loading, oxidative and inflammatory stress. J Cell Mol Med. 2010;14(12):2790–802.

    Article  CAS  Google Scholar 

  28. Toma L, Stancu CS, Botez GM, Sima AV, Simionescu M. Irreversibly glycated LDL induce oxidative and inflammatory state in human endothelial cells; added effect of high glucose. Biochem Bioph Res Co. 2009;390(3):877–82.

    Article  CAS  Google Scholar 

  29. Marfella R, Sasso FC, Cacciapuoti F, Portoghese M, Rizzo MR, Siniscalchi M, et al. Tight glycemic control may increase regenerative potential of myocardium during acute infarction. J Clin Endocrinol Metab. 2012;97(3):933–42.

    Article  CAS  Google Scholar 

  30. Singh M, Gersh BJ, McClelland RL, Ho KKL, Willerson JT, Penny WF, et al. Predictive factors for ischemic target vessel revascularization in the prevention of restenosis with tranilast and its outcomes (PRESTO) trial. J Am Coll Cardiol. 2005;45(2):198–203.

    Article  CAS  Google Scholar 

  31. Calais F, Lagerqvist B, Leppert J, James SK, Fröbert O. Proximal coronary artery intervention: stent thrombosis, restenosis and death. Int J Cardiol. 2013;170(2):227–32.

    Article  Google Scholar 

  32. Roy P, Okabe T, Pinto Slottow TL, Steinberg DH, Smith K, Torguson R, et al. Correlates of clinical restenosis following intracoronary implantation of drug-eluting stents. Am J Cardiol. 2007;100(6):965–9.

    Article  Google Scholar 

  33. Lemos PA, Hoye A, Goedhart D, Arampatzis CA, Saia F, van der Giessen WJ, et al. Clinical, angiographic, and procedural predictors of angiographic restenosis after sirolimus-eluting stent implantation in complex patients: an evaluation from the rapamycin-eluting stent evaluated at rotterdam cardiology hospital (research) study. Circulation. 2004;109(11):1366–70.

    Article  Google Scholar 

  34. Abdel-Wahab M, Neumann F, Serruys P, Silber S, Leon M, Mauri L, et al. Incidence and predictors of unplanned non-target lesion revascularisation up to three years after drug-eluting stent implantation: insights from a pooled analysis of the resolute global clinical trial program. EuroIntervention. 2016;12(4):465–72.

    Article  Google Scholar 

  35. Mehilli J, Dibra A, Kastrati A, Pache J, Dirschinger J, Schömig A. Randomized trial of paclitaxel- and sirolimus-eluting stents in small coronary vessels. Eur Heart J. 2006;27(3):260–6.

    Article  CAS  Google Scholar 

  36. Dibra A, Kastrati A, Mehilli J, Pache J, Schühlen H, von Beckerath N, et al. Paclitaxel-eluting or sirolimus-eluting stents to prevent restenosis in diabetic patients. N Engl J Med. 2005;353(7):663–70.

    Article  CAS  Google Scholar 

  37. Daemen J, Wenaweser P, Tsuchida K, Abrecht L, Vaina S, Morger C, et al. Early and late coronary stent thrombosis of sirolimus-eluting and paclitaxel-eluting stents in routine clinical practice: data from a large two-institutional cohort study. Lancet. 2007;369(9562):667–78.

    Article  CAS  Google Scholar 

  38. Campo G, Tebaldi M, Vranckx P, Biscaglia S, Tumscitz C, Ferrari R, et al. Short- versus long-term duration of dual antiplatelet therapy in patients treated for in-stent restenosis: a PRODIGY trial substudy (prolonging dual antiplatelet treatment after grading stent-induced intimal hyperplasia). J Am Coll Cardiol. 2014;63(6):506–12.

    Article  Google Scholar 

  39. Sasso FC, Pafundi PC, Simeon V, De Nicola L, Chiodini P, Galiero R, et al. Efficacy and durability of multifactorial intervention on mortality and MACEs: a randomized clinical trial in type-2 diabetic kidney disease. Cardiovasc Diabetol. 2021;20(1):145.

    Article  Google Scholar 

  40. Singh M, Gersh BJ, McClelland RL, Ho KKL, Willerson JT, Penny WF, et al. Clinical and angiographic predictors of restenosis after percutaneous coronary intervention: insights from the prevention of restenosis with tranilast and its outcomes (presto) trial. Circulation. 2004;109(22):2727–31.

    Article  Google Scholar 

Download references

Acknowledgements

Thanks are due to Haimu Yao et al. for uploading their meaningful datasets and to Dryad for its contribution to making research data available for reuse.

Funding

None.

Author information

Authors and Affiliations

Authors

Contributions

WBH and CWX drafted the manuscript and revised it for intellectual content, contributed equally to this work. XYW, JYL, QFQ and YYH performed data analysis and/or interpreted the data for the work. DL contributed to the conception and design of the study and helped to draft the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Da Luo.

Ethics declarations

Ethics approval and consent to participate

This study was a secondary analysis of an observational cohort study. The original work in accordance with the Creative Commons Attribution Non-Commercial (CC BY-NC 3.0) license was approved by the Ethics Committee of The First Affiliated Hospital of Zhengzhou University. Informed consent was waived because this is a post-hoc study using available data.

Consent for publication

Not applicable.

Competing interests

The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

He, W., Xu, C., Wang, X. et al. Development and validation of a risk prediction nomogram for in-stent restenosis in patients undergoing percutaneous coronary intervention. BMC Cardiovasc Disord 21, 435 (2021). https://0-doi-org.brum.beds.ac.uk/10.1186/s12872-021-02255-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12872-021-02255-4

Keywords