Background
Modern chemotherapy achieves the shrinking of colorectal cancer liver metastases (CRLM) to such extent that they may disappear from radiological imaging. Disappearing CRLM rarely ...represents a complete pathological remission and have an important risk of recurrence. Augmented reality (AR) consists in the fusion of real-time patient images with a computer-generated 3D virtual patient model created from pre-operative medical imaging. The aim of this prospective pilot study is to investigate the potential of AR navigation as a tool to help locate and surgically resect missing CRLM.
Methods
A 3D virtual anatomical model was created from thoracoabdominal CT-scans using customary software (VR RENDER
®
, IRCAD). The virtual model was superimposed to the operative field using an Exoscope (VITOM
®
, Karl Storz, Tüttlingen, Germany). Virtual and real images were manually registered in real-time using a video mixer, based on external anatomical landmarks with an estimated accuracy of 5 mm. This modality was tested in three patients, with four missing CRLM that had sizes from 12 to 24 mm, undergoing laparotomy after receiving pre-operative oxaliplatin-based chemotherapy.
Results
AR display and fine registration was performed within 6 min. AR helped detect all four missing CRLM, and guided their resection. In all cases the planned security margin of 1 cm was clear and resections were confirmed to be R0 by pathology. There was no postoperative major morbidity or mortality. No local recurrence occurred in the follow-up period of 6–22 months.
Conclusions
This initial experience suggests that AR may be a helpful navigation tool for the resection of missing CRLM.
Introduction
Near-infrared fluorescence cholangiography (NIRF-C) is a popular application of fluorescence image-guided surgery (FIGS). NIRF-C requires near-infrared optimized laparoscopes and the ...injection of a fluorophore, most frequently Indocyanine Green (ICG), to highlight the biliary anatomy. It is investigated as a tool to increase safety during cholecystectomy. The European registry on FIGS (EURO-FIGS:
www.euro-figs.eu
) aims to obtain a snapshot of the current practices of FIGS across Europe. Data on NIRF-C are presented.
Methods
EURO-FIGS is a secured online database which collects anonymized data on surgical procedures performed using FIGS. Data collected for NIRF-C include gender, age, Body Mass Index (BMI), pathology, NIR device, ICG dose, ICG timing of administration before intraoperative visualization, visualization (Y/N) of biliary structures such as the cystic duct (CD), the common bile duct (CBD), the CD-CBD junction, the common hepatic duct (CHD), Visualization scores, adverse reactions to ICG, operative time, and surgical complications.
Results
Fifteen surgeons (12 European surgical centers) uploaded 314 cases of NIRF-C during cholecystectomy (cholelithiasis
n
= 249, cholecystitis
n
= 58, polyps
n
= 7), using 4 different NIR devices. ICG doses (mg/kg) varied largely (mean 0.28 ± 0.17, median 0.3, range: 0.02–0.62). Similarly, injection-to-visualization timing (minutes) varied largely (mean 217 ± 357; median 57), ranging from 1 min (direct intragallbladder injection in 2 cases) to 3120 min (
n
= 2 cases). Visualization scores before dissection were significantly correlated, at univariate analysis, with ICG timing (all structures), ICG dose (CD-CBD), device (CD and CD-CBD), surgeon (CD and CD-CBD), and pathology (CD and CD-CBD). BMI was not correlated. At multivariate analysis, pathology and timing remained significant factors affecting the visualization scores of all three structures, whereas ICG dose remained correlated with HD visualization only.
Conclusions
The EURO-FIGS registry has confirmed a wide disparity in ICG dose and timing in NIRF-C. EURO-FIGS can represent a valuable tool to promote and monitor FIGS-related educational and consensus activities in Europe.
Iatrogenic ureteral injuries (IUI) occur in 0.5-1.3% of cases during abdominal surgery. If not recognized intraoperatively, IUI increase morbidity/mortality. A universally accepted method to prevent ...IUI is lacking. Near-infrared fluorescent imaging (NIRF), penetrating deeper than normal light within the tissue, might be useful, therefore ureter visualization combining NIRF with special dyes (i.e. IRDye 800BK) is promising. Aim of this work is to evaluate the detection of ureters using stents coated with a novel biocompatible fluorescent material (NICE: near-infrared coating of equipment), during laparoscopy. female pigs underwent placement of NICE-coated stents (NS). NIRF was performed, and fluorescence intensity (FI) was computed. Successively, 0.15 mg/kg of IRDye 800BK was administered intravenously, and FI was computed at different timepoints. Ureter visualization using NS only was further assessed in a human cadaver. Both methods allowed in vivo ureter visualization, with equal FI. However, NS were constantly visible whereas IRDye 800BK allowed visualization exclusively during the ureteral peristaltic phases. In the human cadaver, NS provided excellent ureter visualization in its natural anatomical position. NS provided continuous ureteral visualization with similar FI as the IRDye 800BK, which exclusively allowed intermittent visualization, dependent on ureteral peristalsis. NS might prove useful to visualize ureters intraoperatively, potentially preventing IUI.
Most patients who undergo Roux-en-Y gastric bypass (RYGB) experience rapid resolution of type 2 diabetes. Prior studies indicate that this results from more than gastric restriction and weight loss, ...implicating the rearranged intestine as a primary mediator. It is unclear, however, if diabetes improves because of enhanced delivery of nutrients to the distal intestine and increased secretion of hindgut signals that improve glucose homeostasis, or because of altered signals from the excluded segment of proximal intestine. We sought to distinguish between these two mechanisms.
Goto-Kakizaki (GK) type 2 diabetic rats underwent duodenal-jejunal bypass (DJB), a stomach-preserving RYGB that excludes the proximal intestine, or a gastrojejunostomy (GJ), which creates a shortcut for ingested nutrients without bypassing any intestine. Controls were pair-fed (PF) sham-operated and untreated GK rats. Rats that had undergone GJ were then reoperated to exclude the proximal intestine; and conversely, duodenal passage was restored in rats that had undergone DJB. Oral glucose tolerance (OGTT), food intake, body weight, and intestinal nutrient absorption were measured.
There were no differences in food intake, body weight, or nutrient absorption among surgical groups. DJB-treated rats had markedly better oral glucose tolerance compared with all control groups as shown by lower peak and area-under-the-curve glucose values (P < 0.001 for both). GJ did not affect glucose homeostasis, but exclusion of duodenal nutrient passage in reoperated GJ rats significantly improved glucose tolerance. Conversely, restoration of duodenal passage in DJB rats reestablished impaired glucose tolerance.
This study shows that bypassing a short segment of proximal intestine directly ameliorates type 2 diabetes, independently of effects on food intake, body weight, malabsorption, or nutrient delivery to the hindgut. These findings suggest that a proximal intestinal bypass could be considered for diabetes treatment and that potentially undiscovered factors from the proximal bowel might contribute to the pathophysiology of type 2 diabetes.
Purpose
Automatic segmentation and classification of surgical activity is crucial for providing advanced support in computer-assisted interventions and autonomous functionalities in robot-assisted ...surgeries. Prior works have focused on recognizing either coarse activities, such as phases, or fine-grained activities, such as gestures. This work aims at jointly recognizing two complementary levels of granularity directly from videos, namely phases and steps.
Methods
We introduce two correlated surgical activities, phases and steps, for the laparoscopic gastric bypass procedure. We propose a multi-task multi-stage temporal convolutional network (MTMS-TCN) along with a multi-task convolutional neural network (CNN) training setup to jointly predict the phases and steps and benefit from their complementarity to better evaluate the execution of the procedure. We evaluate the proposed method on a large video dataset consisting of 40 surgical procedures (
Bypass40
).
Results
We present experimental results from several baseline models for both phase and step recognition on the
Bypass40
. The proposed MTMS-TCN method outperforms single-task methods in both phase and step recognition by 1-2% in accuracy, precision and recall. Furthermore, for step recognition, MTMS-TCN achieves a superior performance of 3-6% compared to LSTM-based models on all metrics.
Conclusion
In this work, we present a multi-task multi-stage temporal convolutional network for surgical activity recognition, which shows improved results compared to single-task models on a gastric bypass dataset with multi-level annotations. The proposed method shows that the joint modeling of phases and steps is beneficial to improve the overall recognition of each type of activity.
Radiomics is an emerging field which extracts quantitative radiology data from medical images and explores their correlation with clinical outcomes in a non-invasive manner. This review aims to ...assess whether radiomics is a useful and reproducible method for clinical management of hepatocellular carcinoma (HCC) by reviewing the strengths and weaknesses of current radiomics literature pertaining specifically to HCC. From an initial set of 48 articles recovered through database searches, 23 articles were retained to be included in this review after full screening. Among these 23 studies, 7 used a radiomics approach in magnetic resonance imaging (MRI). Only two studies applied radiomics to positron emission tomography–computed tomography (PET–CT). In the remaining 14 articles, a radiomics analysis was performed on computed tomography (CT). Eight studies dealt with the relationship between biological signatures and imaging findings, and can be classified as radiogenomic studies. For each study included in our review, we computed a Radiomics Quality Score (RQS) as proposed by Lambin et al. We found that the RQS (mean ± standard deviation) was 8.35 ± 5.38 (out of a possible maximum value of 36). Although these scores are fairly low, and radiomics has not yet reached clinical utility in HCC, it is important to underscore the fact that these early studies pave the way for the radiomics field with a focus on HCC. Radiomics is still a very young field, and is far from being mature, but it remains a very promising technology for the future for developing adequate personalized treatment as a non-invasive approach, for complementing or replacing tumor biopsies, as well as for developing novel prognostic biomarkers in HCC patients.
Background
HSI is an optical technology allowing for a real-time, contrast-free snapshot of physiological tissue properties, including oxygenation. Hyperspectral imaging (HSI) has the potential to ...quantify the gastrointestinal perfusion intraoperatively. This experimental study evaluates the accuracy of HSI, in order to quantify bowel perfusion, and to obtain a superposition of the hyperspectral information onto real-time images.
Methods
In 6 pigs, 4 ischemic bowel loops were created (A, B, C, D) and imaged at set time points (from 5 to 360 min). A commercially available HSI system provided pseudo-color maps of the perfusion status (StO2, Near-InfraRed perfusion) and the tissue water index. An ad hoc software was developed to superimpose HSI information onto the live video, creating the HYPerspectral-based Enhanced Reality (HYPER). Seven regions of interest (ROIs) were identified in each bowel loop according to StO2 ranges, i.e., vascular (VASC proximal and distal), marginal vascular (MV proximal and distal), marginal ischemic (MI proximal and distal), and ischemic (ISCH). Local capillary lactates (LCL), reactive oxygen species (ROS), and histopathology were measured at the ROIs. A machine-learning-based prediction algorithm of LCL, based on the HSI-StO2%, was trained in the 6 pigs and tested on 5 additional animals.
Results
HSI parameters (StO2 and NIR) were congruent with LCL levels, ROS production, and histopathology damage scores at the ROIs discriminated by HYPER. The global mean error of LCL prediction was 1.18 ± 1.35 mmol/L. For StO2 values > 30%, the mean error was 0.3 ± 0.33.
Conclusions
HYPER imaging could precisely quantify the overtime perfusion changes in this bowel ischemia model.
Background
In laparoscopic cholecystectomy (LC), achievement of the Critical View of Safety (CVS) is commonly advocated to prevent bile duct injuries (BDI). However, BDI rates remain stable, probably ...due to inconsistent application or a poor understanding of CVS as well as unreliable reporting. Objective video reporting could serve for quality auditing and help generate consistent datasets for deep learning models aimed at intraoperative assistance. In this study, we develop and test a method to report CVS using videos.
Method
LC videos performed at our institution were retrieved and the video segments starting 60 s prior to the division of cystic structures were edited. Two independent reviewers assessed CVS using an adaptation of the doublet view 6-point scale and a novel binary method in which each criterion is considered either achieved or not. Feasibility to assess CVS in the edited video clips and inter-rater agreements were evaluated.
Results
CVS was attempted in 78 out of the 100 LC videos retrieved. CVS was assessable in 100% of the 60-s video clips. After mediation, CVS was achieved in 32/78(41.03%). Kappa scores of inter-rater agreements using the doublet view versus the binary assessment were as follows: 0.54 versus 0.75 for CVS achievement, 0.45 versus 0.62 for the dissection of the hepatocystic triangle, 0.36 versus 0.77 for the exposure of the lower part of the cystic plate, and 0.48 versus 0.79 for the 2 structures connected to the gallbladder.
Conclusions
The present study is the first to formalize a reproducible method for objective video reporting of CVS in LC. Minute-long video clips provide information on CVS and binary assessment yields a higher inter-rater agreement than previously used methods. These results offer an easy-to-implement strategy for objective video reporting of CVS, which could be used for quality auditing, scientific communication, and development of deep learning models for intraoperative guidance.
Introduction/objective
Gastric conduit (GC) is used for reconstruction after esophagectomy. Anastomotic leakage (AL) incidence remains high, given the extensive disruption of the gastric circulation. ...Currently, there is no reliable method to intraoperatively quantify gastric perfusion. Hyperspectral imaging (HSI) has shown its potential to quantify serosal StO
2
. Confocal laser endomicroscopy (CLE) allows for automatic mucosal microcirculation quantification as functional capillary density area (FCD-A). The aim of this study was to quantify serosal and mucosal GC’s microperfusion using HSI and CLE. Local capillary lactate (LCL) served as biomarker.
Methods
GC was formed in 5 pigs and serosal StO
2
% was quantified at 3 regions of interest (ROI) using HSI: fundus (ROI-F), greater curvature (ROI-C), and pylorus (ROI-P). After intravenous injection of sodium-fluorescein (0.5 g), CLE-based mucosal microperfusion was assessed at the corresponding ROIs, and LCLs were quantified via a lactate analyzer.
Results
StO
2
and FCD-A at ROI-F (41 ± 10.6%, 3.3 ± 3.8, respectively) were significantly lower than ROI-C (68.2 ± 6.7%,
p
value: 0.005; 18.4 ± 7,
p
value: 0.01, respectively) and ROI-P (72 ± 10.4%,
p
value: 0.005; 15.7 ± 3.2
p
value: 0.001). LCL value at ROI-F (9.6 ± 4.7 mmol/L) was significantly higher than at ROI-C (2.6 ± 1.2 mmol/L,
p
value: 0.04) and ROI-P (2.6 ± 1.3 mmol/L,
p
value: 0.04). No statistically significant difference was found in all metrics between ROI-C and ROI-P. StO
2
correlated with FCD-A (Pearson’s
r
= 0.67). The LCL correlated negatively with both FCD-A (Spearman’s
r
= − 0.74) and StO
2
(Spearman’s
r
= − 0.54).
Conclusions
GC formation causes a drop in serosal and mucosal fundic perfusion. HSI and CLE correlate well and might become useful intraoperative tools.
Virtual reality (VR) and augmented reality (AR) in complex surgery are evolving technologies enabling improved preoperative planning and intraoperative navigation. The basis of these technologies is ...a computer-based generation of a patient-specific 3-dimensional model from Digital Imaging and Communications in Medicine (DICOM) data. This article provides a state-of-the- art overview on the clinical use of this technology with a specific focus on hepatic surgery. Although VR and AR are still in an evolving stage with only some clinical application today, these technologies have the potential to become a key factor in improving preoperative and intraoperative decision making.