Background Missed fractures are a common cause of diagnostic discrepancy between initial radiographic interpretation and the final read by board-certified radiologists. Purpose To assess the effect ...of assistance by artificial intelligence (AI) on diagnostic performances of physicians for fractures on radiographs. Materials and Methods This retrospective diagnostic study used the multi-reader, multi-case methodology based on an external multicenter data set of 480 examinations with at least 60 examinations per body region (foot and ankle, knee and leg, hip and pelvis, hand and wrist, elbow and arm, shoulder and clavicle, rib cage, and thoracolumbar spine) between July 2020 and January 2021. Fracture prevalence was set at 50%. The ground truth was determined by two musculoskeletal radiologists, with discrepancies solved by a third. Twenty-four readers (radiologists, orthopedists, emergency physicians, physician assistants, rheumatologists, family physicians) were presented the whole validation data set (
= 480), with and without AI assistance, with a 1-month minimum washout period. The primary analysis had to demonstrate superiority of sensitivity per patient and the noninferiority of specificity per patient at -3% margin with AI aid. Stand-alone AI performance was also assessed using receiver operating characteristic curves. Results A total of 480 patients were included (mean age, 59 years ± 16 standard deviation; 327 women). The sensitivity per patient was 10.4% higher (95% CI: 6.9, 13.9;
< .001 for superiority) with AI aid (4331 of 5760 readings, 75.2%) than without AI (3732 of 5760 readings, 64.8%). The specificity per patient with AI aid (5504 of 5760 readings, 95.6%) was noninferior to that without AI aid (5217 of 5760 readings, 90.6%), with a difference of +5.0% (95% CI: +2.0, +8.0;
= .001 for noninferiority). AI shortened the average reading time by 6.3 seconds per examination (95% CI: -12.5, -0.1;
= .046). The sensitivity by patient gain was significant in all regions (+8.0% to +16.2%;
< .05) but shoulder and clavicle and spine (+4.2% and +2.6%;
= .12 and .52). Conclusion AI assistance improved the sensitivity and may even improve the specificity of fracture detection by radiologists and nonradiologists, without lengthening reading time. Published under a CC BY 4.0 license.
See also the editorial by Link and Pedoia in this issue.
There is a vast amount of conflicting literature evaluating the anatomic, biomechanical, and clinical outcomes of combined anterior cruciate ligament (ACL) and anterolateral complex injury. This has ...become—and remains—one of the most controversial topics in the ACL-deficient knee literature, thus requiring further inquiry with clear and systematic approaches to biomechanical analysis, indications, graft selection, surgical technique, and clinical outcome evaluation. The considerable variety of procedures to address anterolateral rotatory instability in the setting of ACL deficiency described in the literature strongly suggests the lack of a reliable and reproducible technique. Anterolateral complex reconstruction may provide protection to the ACL-reconstructed knee without detrimental overconstraint.
INTRODUCTION:The purpose of this investigation is to assess the current utilization of telehealth capabilities at academic orthopaedic departments in the United States and to determine how practice ...patterns have been directly influenced by the coronavirus disease 19 (COVID-19) pandemic.
METHODS:Orthopaedic surgery programs participating in the Electronic Residency Application Service were identified. One hundred seventy-five (175) programs were presented with a seven-item questionnaire addressing whether each program is using telehealth services in response to the COVID-19 pandemic.
RESULTS:Of the 175 Electronic Residency Application Service participant orthopaedic programs, 168 responded for a total response rate of 96%. Of the 106 institutions using telehealth services, 88 (83%) cited the COVID-19 pandemic as the impetus for implementation of telehealth services. Institutions located in the Northeast and South regions were markedly more likely to offer telehealth services. Heat map analysis demonstrates an associative overlap of regional “hot spots” with direct comparison of COVID-19 cases in the United States and orthopaedic departments providing telehealth services.
DISCUSSION:This study demonstrates the impressive measures academic orthopaedic institutions are taking to meet the needs of our patients by identifying a notable increase in new telehealth offerings throughout the United States with a positive correlation with COVID-19 disease burden.
Background:
The practice of evidence-based medicine relies on objective data to guide clinical decision-making with specific statistical thresholds conveying study significance.
Purpose:
To determine ...the utility of applying the fragility index (FI) and the fragility quotient (FQ) analysis to randomized controlled trials (RCTs) evaluating the utilization of platelet-rich plasma (PRP) in rotator cuff repairs (RCRs).
Study Design:
Systematic review and meta-analysis.
Methods:
RCTs pertaining to the utilization of PRP in surgical RCRs published in 13 peer-reviewed journals from 2000 to 2020 were evaluated. The FI was determined by manipulating each reported outcome event until a reversal of significance was appreciated. The associated FQ was determined by dividing the FI by the sample size.
Results:
Of the 9746 studies screened, 19 RCTs were ultimately included for analysis. The overall FI incorporating all 19 RCTs was only 4, suggesting that the reversal of only 4 events is required to change study significance. The associated FQ was determined as 0.092. Of the 43 outcome events reporting lost to follow-up data, 13 (30.2%) represented lost to follow-up >4.
Conclusion:
Our analysis suggests that RCTs evaluating PRP for surgical RCRs may lack statistical stability with only a few outcome events required to alter trial significance. Therefore, we recommend the reporting of an FI and an FQ in conjunction with P value analysis to carefully interpret the integrity of statistical stability in future comparative trials.
Clinical Relevance:
Clinical decisions are often informed by statistically significant results. Thus, a true understanding of the robustness of the statistical findings informing clinical decision-making is of critical importance.
The purpose of this study was to apply both the fragility index (FI) and fragility quotient (FQ) to evaluate the degree of statistical fragility in the distal fibular fracture (DFF) literature. We ...hypothesized that the dichotomous outcomes within the DFF literature are statistically fragile.
We performed a PubMed search for distal fibular fractures clinical trials from 2000 to 2022 reporting dichotomous outcomes. The FI of each outcome was calculated through the reversal of a single outcome event until significance was reversed. The FQ was calculated by dividing each fragility index by study sample size. The interquartile range (IQR) was also calculated for the FI and FQ.
Of the 1158 articles screened, 23 met the search criteria, with six RCTs included for analysis. Forty-five outcome events with 5 significant (p < 0.05) outcomes and 40 nonsignificant (p ≥ 0.05) outcomes were identified. The overall FI and FQ was 5 (IQR 4–6) and 0.089 (IQR 0.061–0.107), respectively.
The randomized controlled trials in the peer-reviewed distal fibular fracture literature may not be as robust as previously thought, as incorporating statistical analyses solely on a P value threshold is misleading. Standardized reporting of the P value, FI and FQ can help the clinician reliably draw conclusions based on the fragility of outcome measures.
Background:
The coronavirus disease 2019 (COVID-19) pandemic has caused the cancellation or postponement of virtually every sporting event, resulting in training disruptions, income loss, and career ...uncertainties for athletes around the world. At present, the effect of the COVID-19 pandemic on the mental and emotional health of athletes is not well understood.
Purpose:
To investigate the effect of the COVID-19 pandemic on the mental and emotional health of athletes and to identify risk factors associated with poor mental health outcomes.
Study Design:
Systematic review; Level of evidence, 4.
Methods:
The PubMed, Embase, and Cochrane Library databases were searched to identify all articles reporting on athletes’ mental and emotional health during the COVID-19 pandemic. Articles were selected based on relevant inclusion and exclusion criteria. Study characteristics, athlete demographics, and COVID-19 mental health data (sex-, type of sport—, and level of play—specific differences) were collected from each included article and analyzed.
Results:
A total of 35 studies were included in the final analysis, comprising athletes around the world and across numerous sports and levels of play. Most studies utilized at least 1 validated mental health questionnaire and assessed for outcomes such as depression, anxiety, stress, motivation, and athletic identity. Overall, athletes reported worse mental and emotional health during the COVID-19 pandemic, although these effects were attenuated by home training programs and quarantine training camps. Female sex and more elite levels of play were associated with an increased risk for poor mental health outcomes. Type of sport was associated with mixed results, with individual and team sports carrying different increased risks for poor mental and emotional health. Nearly all studies recommended the need for increased psychological support of athletes during the COVID-19 pandemic.
Conclusion:
The effect of the COVID-19 pandemic on the mental and emotional health of athletes is complex and multifaceted. Increased social interactions with coaches and teammates, continued access to training facilities and mental health professionals, and active utilization of healthy coping mechanisms can improve mental health outcomes for athletes in the era of COVID-19.
Dichotomous outcomes are frequently reported in orthopaedic research and have substantial clinical implications. This study utilizes the fragility index (FI) and fragility quotient (FQ) metrics to ...determine the statistical stability of outcomes reported in total joint arthroplasty randomized controlled trials (RCTs) relating to periprosthetic joint infection (PJI).
The RCTs that reported dichotomous data related to PJI published between January 1, 2010, and December 31, 2022, were evaluated. The FI and reverse FI (RFI) were defined as the number of outcome event reversals required to reverse the significance of significant and nonsignificant outcomes, respectively. The FQ was determined by dividing the FI or RFI by the respective sample size. There were 108 RCTs screened, and 17 studies included for analysis.
A total of 58 outcome events were identified, with a median FI of 4 (interquartile range IQR 2 to 5) and associated FQ of 0.0417 (IQR 0.0145 to 0.0602). The 13 statistically significant outcomes had a median FI of 1 (IQR 1 to 2) and FQ of 0.00935 (IQR 0.00629 to 0.01410). The 45 nonsignificant outcomes had a median RFI of 4 (IQR 3 to 5) and FQ of 0.05 (IQR 0.0361 to 0.0723). The number of patients lost to follow-up was greater than or equal to the FI in 46.6% of outcomes.
Statistical outcomes in RCTs analyzing PJI are fragile and may lack statistical integrity. We recommend a comprehensive fragility analysis, with the reporting of FI and FQ metrics, to aid in the interpretation of outcomes in the total joint arthroplasty literature.
Background:
An increasing reliance on patient-reported outcomes has led to greater emphasis on minimal clinically important difference (MCID), substantial clinical benefit (SCB), and Patient ...Acceptable Symptom State (PASS) thresholds in assessing rotator cuff repairs.
Purpose:
To review the MCID, SCB, and PASS thresholds reported for patient-reported outcome measures (PROMs) after rotator cuff repair.
Study Design:
Systematic review; Level of evidence, 4.
Methods:
The PubMed, Embase, Ovid, Cochrane, and Google Scholar databases were queried for full-text journal articles in English published between January 1, 2000, and May 31, 2022. Studies with MCID, SCB, and PASS thresholds reported for patients with rotator cuff repair and a minimum of 12 months of follow-up were included. Reported MCID, SCB, and PASS thresholds and associated calculation methods were extracted.
Results:
There were 41 unique studies (6331 shoulders) that met the inclusion criteria. Of these, 37 (90%) reported MCID; 16 (39%), PASS; and 11 (27%), SCB values. The most common PROMs were the American Shoulder and Elbow Surgeons score and the Constant-Murley score. In total, 71% (29/41) of these studies referenced values in the literature, usually studies of patients undergoing rotator cuff repair (21/29). Twelve studies calculated MCID, SCB, or PASS thresholds using anchor-based approaches, whereas 6 studies also calculated thresholds using distribution-based methods. The use of MCID, SCB, and PASS in the rotator cuff repair literature is increasing, with half of the included studies published within the final 17 months of the studied period.
Conclusion:
Significant variability was seen in the reporting of MCID, SCB, and PASS threshold values after rotator cuff repair. Researchers should prioritize studies that report clinical outcome thresholds calculated using anchor-based methods and should critically review both the anchor question and its response choices. Standardization of MCID, SCB, and PASS values and calculation methods will allow for a more reliable assessment of PROMs in rotator cuff repair moving forward.
Hypothesis Lateral ulnar collateral ligament (LUCL) reconstruction is a commonly used surgical approach for the treatment of posterolateral rotatory instability (PLRI). We hypothesized that favorable ...clinical results could be obtained using the docking technique. Materials and methods Between 1996 and 2009, the docking technique was used for surgical reconstruction of the LUCL in 8 patients with purely ligamentous posterolateral rotatory instability of the elbow. The clinical results of these patients were retrospectively reviewed. Results At a mean follow-up of 7.1 years (range, 5.2-9.4 years), 6 patients (75%) demonstrated complete resolution of lateral elbow instability, and 2 (25%) reported occasional instability with activities of daily living. The mean Mayo Elbow Performance Score was 87.5 (range, 75-100). Subjective assessment revealed that all patients were satisfied with their clinical outcome. Conclusion LUCL reconstruction using the docking technique facilitates simple graft tensioning and excellent graft fixation. Clinical results are comparable with previously reported studies with a low complication rate.
Objectives: The purpose of this study was to determine the stability of statistical findings among sham surgery randomized controlled trials (RCTs) in orthopaedic surgery using fragility analysis. ...Methods: PubMed systematic review was conducted to include studies reporting dichotomous outcomes pertaining to sham surgery. The final review included eight RCTs involving only partial meniscectomies and vertebroplasties from 2009 to 2020. With a fixed sample size with dichotomous outcome measures (events versus non-events), the Total Fragility Index (TFI), which is composed of the fragility index (FI) and reverse fragility index (RFI), was calculated by altering the ratio of events to non-events in an iterative fashion until results were reversed from significant to nonsignificant findings (FI) or vice versa (RFI). The TFI, FI, and RFI were divided by their sample sizes to obtain the respective total fragility quotient, fragility quotient (FQ), and reverse fragility quotient. Median fragility indices and quotients were reported for all studies. Results: The eight RCTs included 50 dichotomous outcomes involving either partial meniscectomies or vertebroplasties, with a median TFI and total fragility quotient of 5 interquartile range (IQR) 4 to 6 and 0.035 (IQR 0.028 to 0.048), respectively, indicating that a median of five total patients or 3.5 per 100 patients would need to experience a different outcome to reverse significant or insignificant findings for each of the eight trials. Among the 8 statistically significant ( P < 0.05) outcome events (16%), the respective FI and FQ were 2 (IQR 1 to 5) and 0.018 (IQR 0.010 to 0.044). Among the 42 statistically insignificant outcome events (84%), the respective RFI and reverse fragility quotient were 5 (IQR 4 to 6) and 0.04 (IQR 0.034 to 0.048). The median number of patients lost to follow-up was 1.5 (IQR 0.5 to 2). Conclusion: The unstable findings in partial meniscectomy and vertebroplasty sham surgical RCTs undermine their study conclusions and recommendations. We recommend using fragility analysis in future sham surgical RCTs to contextualize statistical findings. Level of evidence: Level IV; Systematic Review.
PDF
