Objective
To examine whether incorrect AI results impact radiologist performance, and if so, whether human factors can be optimized to reduce error.
Methods
Multi-reader design, 6 radiologists ...interpreted 90 identical chest radiographs (follow-up CT needed: yes/no) on four occasions (09/20–01/22). No AI result was provided for session 1. Sham AI results were provided for sessions 2–4, and AI for 12 cases were manipulated to be incorrect (8 false positives (FP), 4 false negatives (FN)) (0.87 ROC-AUC). In the Delete AI (No Box) condition, radiologists were told AI results would not be saved for the evaluation. In Keep AI (No Box) and Keep AI (Box), radiologists were told results would be saved. In Keep AI (Box), the ostensible AI program visually outlined the region of suspicion. AI results were constant between conditions.
Results
Relative to the No AI condition (FN = 2.7%, FP = 51.4%), FN and FPs were higher in the Keep AI (No Box) (FN = 33.0%, FP = 86.0%), Delete AI (No Box) (FN = 26.7%, FP = 80.5%), and Keep AI (Box) (FN = to 20.7%, FP = 80.5%) conditions (all
p
s < 0.05). FNs were higher in the Keep AI (No Box) condition (33.0%) than in the Keep AI (Box) condition (20.7%) (
p
= 0.04). FPs were higher in the Keep AI (No Box) (86.0%) condition than in the Delete AI (No Box) condition (80.5%) (
p
= 0.03).
Conclusion
Incorrect AI causes radiologists to make incorrect follow-up decisions when they were correct without AI. This effect is mitigated when radiologists believe AI will be deleted from the patient’s file or a box is provided around the region of interest.
Clinical relevance statement
When AI is wrong, radiologists make more errors than they would have without AI. Based on human factors psychology, our manuscript provides evidence for two AI implementation strategies that reduce the deleterious effects of incorrect AI.
Key Points
•
When AI provided incorrect results, false negative and false positive rates among the radiologists increased.
•
False positives decreased when AI results were deleted, versus kept, in the patient’s record.
•
False negatives and false positives decreased when AI visually outlined the region of suspicion.
Purpose To evaluate the performance of the radius, exophytic or endophytic, nearness to collecting system or sinus, anterior or posterior, and location relative to polar lines (RENAL) nephrometry and ...preoperative aspects and dimensions used for anatomic classification (PADUA) scoring systems and other tumor biometrics for prediction of local tumor recurrence in patients with renal cell carcinoma after thermal ablation. Materials and Methods This HIPAA-compliant study was performed with a waiver of informed consent after institutional review board approval was obtained. A retrospective evaluation of 207 consecutive patients (131 men, 76 women; mean age, 71.9 years ± 10.9) with 217 biopsy-proven renal cell carcinoma tumors treated with thermal ablation was conducted. Serial postablation computed tomography (CT) or magnetic resonance (MR) imaging was used to evaluate for local tumor recurrence. For each tumor, RENAL nephrometry and PADUA scores were calculated by using imaging-derived tumor morphologic data. Several additional tumor biometrics and combinations thereof were also measured, including maximum tumor diameter. The Harrell C index and hazard regression techniques were used to quantify associations with local tumor recurrence. Results The RENAL (hazard ratio, 1.43; P = .003) and PADUA (hazard ratio, 1.80; P < .0001) scores were found to be significantly associated with recurrence when regression techniques were used but demonstrated only poor to fair discrimination according to Harrell C index results (C, 0.68 and 0.75, respectively). Maximum tumor diameter showed the highest discriminatory strength of any individual variable evaluated (C, 0.81) and was also significantly predictive when regression techniques were used (hazard ratio, 2.98; P < .0001). For every 1-cm increase in diameter, the estimated rate of recurrence risk increased by 198%. Conclusion Maximum tumor diameter demonstrates superior performance relative to existing tumor scoring systems and other evaluated biometrics for prediction of local tumor recurrence after renal cell carcinoma ablation.
RSNA, 2016.
Purpose
To evaluate the relationship between prospectively generated ablative margin estimates and local tumor progression (LTP) among patients undergoing microwave ablation (MWA) of small renal ...masses (SRMs).
Materials and Methods
Between 2017 and 2020, patients who underwent MWA for SRM were retrospectively identified. During each procedure, segmented kidney and tumor shapes were coregistered with intraprocedural helical CT images obtained after microwave antenna placement. Predicted ablation zone shape and size were then overlaid onto the resultant model, and a model-to-model distance algorithm was employed to calculate multiple ablative margin estimates. LTP was modeled as a function of each margin estimate by hazard regression. Models were evaluated using hazard ratios and Akaike information criterion. Receiver operating characteristic curve area under the curve was also estimated using Harrell’s and Uno’s C indices (HI and UI, respectively).
Results
One hundred and twenty-eight patients were evaluated (median age 72.1 years). Mean tumor diameter was 2.4 ± 0.9 cm. LTP was observed in nine (7%) patients. Analysis showed that decreased estimated margin size as measured by first quartile (Q1; 25th percentile), maximum, and average ablative margin metrics was significantly associated with risk of LTP. For every one millimeter increase in Q1, maximum, and mean ablative margin, the hazard of LTP increased 67% (HR: 1.67; 95% CI = 1.25–2.20, UI = 0.93, HI = 0.77), 32% (HR: 1.32; 95% CI 1.09–1.60; UI = 0.93; HI = 0.76), and 48% (HR: 1.48; 95% CI 1.18–1.85; UI = 0.83; HI = 0.75), respectively.
Conclusion
Prospectively generated ablative margin estimates can be used to predict the risk of local tumor progression following microwave ablation of small renal masses.
Level of Evidence 3
Retrospective cohort study.
Graphical Abstract
This study evaluated the feasibility of measuring patient recovery after locoregional therapies (LRTs) using a wearable activity tracker (WAT). Twenty adult patients with cancer were provided with a ...WAT device to wear for a minimum of 7 days prior to their procedure (baseline) and for up to 30 days after their procedure (recovery). Daily step counts were continuously recorded. Patient responses to the Short Form 36-Item Health Survey (SF-36) were also collected before and after LRT. Analysis of WAT data demonstrated a mean of 4,850 daily steps taken at baseline, which decreased to 2,000 immediately after LRT and then rapidly increased to approximately 4,300 daily steps over an average of 10 days (P < .001). No significant changes were observed in SF-36 responses between baseline and follow-up assessments (P > .10). These results suggest that WAT devices capture dynamic periprocedural data not reflected in survey-based assessments and may be used to monitor patient recovery after interventional oncologic procedures.
The promiscuous protein retinoid X receptor (RXR) displays essential allosteric regulation of several members in the nuclear hormone receptor superfamily via heterodimerization and (anti)cooperative ...binding of cognate ligands. Here, the structural basis of the positive allostery of RXR and constitutive androstane receptor (CAR) is revealed. In contrast, a similar computational approach had previously revealed the mechanism for negative allostery in the complex of RXR and thyroid receptor (TR). By comparing the positive and negative allostery of RXR complexed with CAR and TR respectively, we reported the promiscuous allosteric control involving RXR. We characterize the allosteric mechanism by expressing the correlated dynamics of selected residue–residue contacts which was extracted from atomistic molecular dynamics simulation and statistical analysis. While the same set of residues in the binding pocket of RXR may initiate the residue–residue interaction network, RXR uses largely different sets of contacts (only about one-third identical) and allosteric modes to regulate TR and CAR. The promiscuity of RXR control may originate from multiple factors, including (1) the frustrated fit of cognate ligand 9c to the RXR binding pocket and (2) the different ligand-binding features of TR (loose) versus CAR (tight) to their corresponding cognate ligands.
The anatomy and pathogenesis of spondylolysis has been widely studied; however, the microanatomy of spondylolysis of the lumbar vertebra has not been well described. Therefore, we aim to better ...elucidate this anatomy. Twenty dry bone specimens of healed and unhealed spondylolysis of the L5 vertebra were collected from human skeletal remains. Twelve L5 vertebrae were examples of unhealed spondylolysis and eight specimens exhibited a healed (i.e., bony fusion of the lesion) spondylolysis lesion. The specimens underwent macro and microanatomical analysis followed by CT and microCT imaging. Finally, selected healed and unhealed lesions were submitted for histological analysis using Mason Trichrome staining. The pars interarticularis of two L5 vertebrae without signs of healed/unhealed spondylolysis were evaluated histologically as controls. Of the 12 unhealed L5 pars defects, three were unilateral on left side. Of the eight healed pars defects, all were unilateral and seven of these were on left sides. One unilateral pars defect also had spina bifida occulta. Both on imaging and histological analysis, healed pars defects were only so superficially and not at deeper levels. Histologically, unhealed edges were made up of dense cortical bone while healed edges were made up primarily of trabecular bone. Based on our anatomical findings, the so‐called healed spondylolysis lesions, although externally fused, are not thoroughly fused internally. Moreover, the anterior and posterior edges of the unhealed spondylosysis lesions are irregular and show signs of long‐term disarticulation. Taken together, these data suggest that such ‘healed’ lesions might not be as stable as the normal L5 pars interarticularis.
Neural crest cells (NCCs) are a migratory, transient, and multipotent stem cell population essential to vertebrate embryonic development, contributing to numerous cell lineages in the adult organism. ...While great strides have been made in elucidating molecular and cellular events that drive NCC specification, comprehensive knowledge of the genetic factors that orchestrate NCC developmental programs is still far from complete. We discovered that elevated Hoxb5b levels promoted an expansion of zebrafish NCCs, which persisted throughout multiple stages of development. Correspondingly, elevated Hoxb5b also specifically expanded expression domains of the vagal NCC markers
and
. Increases in NCCs were most apparent after pulsed ectopic Hoxb5b expression at early developmental stages, rather than later during differentiation stages, as determined using a novel transgenic zebrafish line. The increase in vagal NCCs early in development led to supernumerary Phox2b
enteric neural progenitors, while leaving many other NCC-derived tissues without an overt phenotype. Surprisingly, these NCC-derived enteric progenitors failed to expand properly into sufficient quantities of enterically fated neurons and stalled in the gut tissue. These results suggest that while Hoxb5b participates in vagal NCC development as a driver of progenitor expansion, the supernumerary, ectopically localized NCC fail to initiate expansion programs in timely fashion in the gut. All together, these data point to a model in which Hoxb5b regulates NCCs both in a tissue specific and temporally restricted manner.
Ground-based measurement of the spatial distribution of soil moisture can be difficult because sampling is essentially made at a point and the choice of both sample depth and sample spacing affects ...the interpretation of the measurements.
Hydrological interest has generally been in soil moisture of the root zone. Microwave Remote Sensing methods are now available that allow the interpretation of spatial distributions of soil moisture, however, their signals respond to moisture in the upper few centimetres of soil. These instruments are still being developed, but one of the questions surrounding their application is how to interpret the surface moisture in a hydrological context. In this study we compare measurements of soil moisture in 0–30
cm of soil with those in 0–6
cm to examine how representative this surface measure is with regard to the root zone.
Detailed spatial measurements of soil moisture were conducted at three pasture sites in the 50
km
2 Mahurangi River catchment of northern New Zealand as part of a comprehensive hydrology project; MARVEX (MAhurangi River Variability EXperiment). In three field sites, on each of three occasions, field measurements were made using both 30 and 6
cm dielectric-based instruments. Spatial grids of several hundred moisture measurements were collected over 0–30
cm and compared with those collected simultaneously over 0–6
cm.
Results indicate that temporal and spatial issues interfere with correlation of the two sets of series. Rapid wetting of 0–6
cm compared with 0–30
cm is seen following storm activity. Some evidence of the decoupling of moisture content response is also evident when sites are measured on days following a storm. Rapid, but not unrealistic, response to intense rainfall was also observed.
Implications are that detailed and accurate knowledge of local soil conditions and a sound model of soil water redistribution are required before surface soil moisture measurements can be used to infer root zone behaviour. Such knowledge was not available in this study, from either published data or field observation. In this study, without suitable a priori knowledge, soil property information was found via calibration.