•A novel dynamic coronary roadmapping approach for X-ray fluoroscopy is proposed.•The approach can provide dynamic vessel visualization without using contrast agent.•The approach corrects the ...respiratory motion of vessels via catheter tip tracking.•Accurate catheter tip tracking relies on deep learning based Bayesian filtering.•The catheter tip tracking and dynamic coronary roadmapping both run in real-time.
Display omitted
Percutaneous coronary intervention (PCI) is typically performed with image guidance using X-ray angiograms in which coronary arteries are opacified with X-ray opaque contrast agents. Interventional cardiologists typically navigate instruments using non-contrast-enhanced fluoroscopic images, since higher use of contrast agents increases the risk of kidney failure. When using fluoroscopic images, the interventional cardiologist needs to rely on a mental anatomical reconstruction. This paper reports on the development of a novel dynamic coronary roadmapping approach for improving visual feedback and reducing contrast use during PCI. The approach compensates cardiac and respiratory induced vessel motion by ECG alignment and catheter tip tracking in X-ray fluoroscopy, respectively. In particular, for accurate and robust tracking of the catheter tip, we proposed a new deep learning based Bayesian filtering method that integrates the detection outcome of a convolutional neural network and the motion estimation between frames using a particle filtering framework. The proposed roadmapping and tracking approaches were validated on clinical X-ray images, achieving accurate performance on both catheter tip tracking and dynamic coronary roadmapping experiments. In addition, our approach runs in real-time on a computer with a single GPU and has the potential to be integrated into the clinical workflow of PCI procedures, providing cardiologists with visual guidance during interventions without the need of extra use of contrast agent.
A growing number of studies have reported a link between vascular damage and glaucoma based on optical coherence tomography angiography (OCTA) imaging. This multitude of studies focused on different ...regions of interest (ROIs) which offers the possibility to draw conclusions on the most discriminative locations to diagnose glaucoma. The objective of this work was to review and analyse the discriminative capacity of vascular density, retrieved from different ROIs, on differentiating healthy subjects from glaucoma patients. PubMed was used to perform a systematic review on the analysis of glaucomatous vascular damage using OCTA. All studies up to 21 April 2019 were considered. The ROIs were analysed by region (macula, optic disc and peripapillary region), layer (superficial and deep capillary plexus, avascular, whole retina, choriocapillaris and choroid) and sector (according to the Garway–Heath map). The area under receiver operator characteristic curve (AUROC) and the statistical difference (p‐value) were used to report the importance of each ROI for diagnosing glaucoma. From 96 screened studies, 43 were eligible for this review. Overall, the peripapillary region showed to be the most discriminative region with the highest mean AUROC (0.80 ± 0.09). An improvement of the AUROC from this region is observed when a sectorial analysis is performed, with the highest AUROCs obtained at the inferior and superior sectors of the superficial capillary plexus in the peripapillary region (0.86 ± 0.03 and 0.87 ± 0.10, respectively). The presented work shows that glaucomatous vascular damage can be assessed using OCTA, and its added value as a complementary feature for glaucoma diagnosis depends on the region of interest. A sectorial analysis of the superficial layer at the peripapillary region is preferable for assessing glaucomatous vascular damage.
To investigate the feasibility of using deformable registration in clinical practice to fuse MR and CT images of the head and neck for treatment planning.
A state-of-the-art deformable registration ...algorithm was optimized, evaluated, and compared with rigid registration. The evaluation was based on manually annotated anatomic landmarks and regions of interest in both modalities. We also developed a multiparametric registration approach, which simultaneously aligns T1- and T2-weighted MR sequences to CT. This was evaluated and compared with single-parametric approaches.
Our results show that deformable registration yielded a better accuracy than rigid registration, without introducing unrealistic deformations. For deformable registration, an average landmark alignment of approximatively 1.7 mm was obtained. For all the regions of interest excluding the cerebellum and the parotids, deformable registration provided a median modified Hausdorff distance of approximatively 1 mm. Similar accuracies were obtained for the single-parameter and multiparameter approaches.
This study demonstrates that deformable registration of head-and-neck CT and MR images is feasible, with overall a significanlty higher accuracy than for rigid registration.
Localization of the correct vertebral level for surgical entry during lumbar hernia surgery is not straightforward. In this paper, we develop and evaluate a solution using free-hand 2-D ultrasound ...(US) imaging in the operation room (OR). Our system exploits the difference in spinous process shapes of the vertebrae. The spinous processes are pre-operatively outlined and labeled in a lateral lumbar X-ray of the patient. Then, in the OR the spinous processes are imaged with 2-D sagittal US, and are automatically segmented and registered with the X-ray shapes. After a small number of scanned vertebrae, the system robustly matches the shapes, and propagates the X-ray label to the US images. The main contributions of our work are: we propose a deep convolutional neural network-based bone segmentation algorithm from US imaging that outperforms state of the art methods in both performance and speed. We present a matching strategy that determines the levels of the spinal processes being imaged. And lastly, we evaluate the complete procedure on 19 clinical data sets from two hospitals, and two observers. The final labeling was correct in 92% of the cases, demonstrating the feasibility of US-based surgical entry point detection for spinal surgeries.
CT-guided percutaneous ablation for liver cancer treatment is a relevant technique for patients not eligible for surgery and with tumors that are inconspicuous on US imaging. The lack of real-time ...imaging and the use of a limited amount of CT contrast agent make targeting the tumor with the needle challenging. In this study, we evaluate a registration framework that allows the integration of diagnostic pre-operative contrast enhanced CT images and intra-operative non-contrast enhanced CT images to improve image guidance in the intervention. The liver and tumor are segmented in the pre-operative contrast enhanced CT images. Next, the contrast enhanced image is registered to the intra-operative CT images in a two-stage approach. First, the contrast-enhanced diagnostic image is non-rigidly registered to a non-contrast enhanced image that is conventionally acquired at the start of the intervention. In case the initial registration is not sufficiently accurate, a refinement step is applied using non-rigid registration method with a local rigidity term. In the second stage, the intra-operative CT-images that are used to check the needle position, which often consist of only a few slices, are registered rigidly to the intra-operative image that was acquired at the start of the intervention. Subsequently, the diagnostic image is registered to the current intra-operative image, using both transformations, this allows the visualization of the tumor region extracted from pre-operative data in the intra-operative CT images containing needle. The method is evaluated on imaging data of 19 patients at the Erasmus MC. Quantitative evaluation is performed using the Dice metric, mean surface distance of the liver border and corresponding landmarks in the diagnostic and the intra-operative images. The registration of the diagnostic CT image to the initial intra-operative CT image did not require a refinement step in 13 cases. For those cases, the resulting registration had a Dice coefficient for the livers of 91.4%, a mean surface distance of 4.4 mm and a mean distance between corresponding landmarks of 4.7 mm. For the three cases with a refinement step, the registration result significantly improved (p<0.05) compared to the result of the initial non rigid registration method (DICE of 90.3% vs 71.3% and mean surface distance of 5.1 mm vs 11.3 mm and mean distance between corresponding landmark of 6.4 mm vs 10.2 mm). The registration of the preoperative data with the needle image in 16 cases yielded a DICE of 90.1% and a mean surface distance of 5.2 mm. The remaining three cases with DICE smaller than 80% were classified as unsuccessful registration. The results show that this is promising tool for liver image registration in interventional radiology.
Celotno besedilo
Dostopno za:
DOBA, IZUM, KILJ, NUK, PILJ, PNG, SAZU, SIK, UILJ, UKNU, UL, UM, UPUK
Augmented reality (AR) permits the visualization of pre-operative data in the surgical field of view of the surgeon. This requires the alignment of the AR device’s coordinate system with the used ...navigation/tracking system. We propose a multimodal marker approach to align an AR device with a tracking system: in our implementation, an electromagnetic tracking system (EMTS). The solution makes use of a calibration method which determines the relationship between a 2D pattern detected by an RGB camera and an electromagnetic sensor of the EMTS. This allowed the projection of a 3D skull model on its physical counterpart. This projection was evaluated using a monocular camera and an optical see-through device (HoloLens 2) (
https://www.microsoft.com/en-us/hololens/
) achieving an accuracy of less than 2.5 mm in the image plane of the HoloLens 2 (HL2). Additionally, 10 volunteers participated in a user study consisting of an alignment task of a pointer with 25 projections viewed through the HL2. The participants achieved a mean error of 2.7 1.3 mm and 2.9 2.9
∘
in positional and orientation error. This study showcases the feasibility of the approach, provides an evaluation of the alignment, and finally, discusses its advantages and limitations.
Augmented reality (AR) has shown potential in computer-aided surgery. It allows for the visualization of hidden anatomical structures as well as assists in navigating and locating surgical ...instruments at the surgical site. Various modalities (devices and/or visualizations) have been used in the literature, but few studies investigated the adequacy/superiority of one modality over the other. For instance, the use of optical see-through (OST) HMDs has not always been scientifically justified. Our goal is to compare various visualization modalities for catheter insertion in external ventricular drain and ventricular shunt procedures. We investigate two AR approaches: (1) 2D approaches consisting of a smartphone and a 2D window visualized through an OST (Microsoft HoloLens 2), and (2) 3D approaches consisting of a fully aligned patient model and a model that is adjacent to the patient and is rotationally aligned using an OST. 32 participants joined this study. For each visualization approach, participants were asked to perform five insertions after which they filled NASA-TLX and SUS forms. Moreover, the position and orientation of the needle with respect to the planning during the insertion task were collected. The results show that participants achieved a better insertion performance significantly under 3D visualizations, and the NASA-TLX and SUS forms reflected the preference of participants for these approaches compared to 2D approaches.
Purpose:
An automatic method for 3D prostate segmentation in magnetic resonance (MR) images is presented for planning image‐guided radiotherapy treatment of prostate cancer.
Methods:
A spatial prior ...based on intersubject atlas registration is combined with organ‐specific intensity information in a graph cut segmentation framework. The segmentation is tested on 67 axial T2‐weighted MR images in a leave‐one‐out cross validation experiment and compared with both manual reference segmentations and with multiatlas‐based segmentations using majority voting atlas fusion. The impact of atlas selection is investigated in both the traditional atlas‐based segmentation and the new graph cut method that combines atlas and intensity information in order to improve the segmentation accuracy. Best results were achieved using the method that combines intensity information, shape information, and atlas selection in the graph cut framework.
Results:
A mean Dice similarity coefficient (DSC) of 0.88 and a mean surface distance (MSD) of 1.45 mm with respect to the manual delineation were achieved.
Conclusions:
This approaches the interobserver DSC of 0.90 and interobserver MSD 0f 1.15 mm and is comparable to other studies performing prostate segmentation in MR.
Needle Tip Visibility in 3D Ultrasound Images Arif, Muhammad; Moelker, Adriaan; van Walsum, Theo
Cardiovascular and interventional radiology,
01/2018, Letnik:
41, Številka:
1
Journal Article
Recenzirano
Odprti dostop
Aim
Needle visibility is crucial for effective and safe ultrasound-guided interventional procedures. Several studies have investigated needle visibility in 2D ultrasound imaging, but less information ...is available for 3D ultrasound imaging, a modality that has great potential for image guidance interventions. We performed a prospective study, to quantitatively compare the echogenicity of various commercially available needles in 3D ultrasound images used in clinical practice under freehand needle introduction.
Materials and Methods
A set of seven needles, containing biopsy needles, a TIPS needle, an ablation needle and a puncture needle, were included in the study. A liver-mimicking phantom and cow liver were punctured by each needle. 3D sweeps and real-time 3D data were acquired at three different angles (20°, 55° and 90°). Needle visibility was quantified by calculating contrast-to-noise ratio.
Results
In the liver-mimicking phantom, all needles showed better visibility than in the cow liver. At large angles, contrast-to-noise ratio and needle visibility were almost similar in both cases, but at lower angles differences in visibility were observed with different types of needles.
Conclusion
The contrast-to-noise ratio increased with the increase in angle of insonation. The difference in visibility of different needles is more pronounced at 20° angle. The echogenic properties of inhomogeneous cow liver tissues make the needles visibility worse as compared to a homogenous phantom. The needle visibility becomes worse in 3D real-time data as compared to 3D ultrasound sweeps.
Purpose
In minimally invasive spring-assisted craniectomy, surgeons plan the surgery by manually locating the cranial sutures. However, this approach is prone to error. Augmented reality (AR) could ...be used to visualize the cranial sutures and assist in the surgery planning. The purpose of our work is to develop an AR-based system to visualize cranial sutures, and to assess the accuracy and usability of using AR-based navigation for surgical guidance in minimally invasive spring-assisted craniectomy.
Methods
An AR system was developed that consists of an electromagnetic tracking system linked with a Microsoft HoloLens. The system was used to conduct a study with two skull phantoms. For each phantom, five sutures were annotated and visualized on the skull surface. Twelve participants assessed the system. For each participant, model alignment using six anatomical landmarks was performed, followed by the participant delineation of the visualized sutures. At the end, the participants filled a system usability scale (SUS) questionnaire. For evaluation, an independent optical tracking system was used and the delineated sutures were digitized and compared to the CT-annotated sutures.
Results
For a total of 120 delineated sutures, the distance of the annotated sutures to the planning reference was
2.4
±
1.2
mm. The average delineation time per suture was
13
±
5
s. For the system usability questionnaire, an average SUS score of 73 was obtained.
Conclusion
The developed AR-system has good accuracy (average 2.4 mm distance) and could be used in the OR. The system can assist in the pre-planning of minimally invasive craniosynostosis surgeries to locate cranial sutures accurately instead of the traditional approach of manual palpation. Although the conducted phantom study was designed to closely reflect the clinical setup in the OR, further clinical validation of the developed system is needed and will be addressed in a future work.
PDF
