Raman spectroscopy is increasingly being used in biology, forensics, diagnostics, pharmaceutics and food science applications. This growth is triggered not only by improvements in the computational ...and experimental setups but also by the development of chemometric techniques. Chemometric techniques are the analytical processes used to detect and extract information from subtle differences in Raman spectra obtained from related samples. This information could be used to find out, for example, whether a mixture of bacterial cells contains different species, or whether a mammalian cell is healthy or not. Chemometric techniques include spectral processing (ensuring that the spectra used for the subsequent computational processes are as clean as possible) as well as the statistical analysis of the data required for finding the spectral differences that are most useful for differentiation between, for example, different cell types. For Raman spectra, this analysis process is not yet standardized, and there are many confounding pitfalls. This protocol provides guidance on how to perform a Raman spectral analysis: how to avoid these pitfalls, and strategies to circumvent problematic issues. The protocol is divided into four parts: experimental design, data preprocessing, data learning and model transfer. We exemplify our workflow using three example datasets where the spectra from individual cells were collected in single-cell mode, and one dataset where the data were collected from a raster scanning-based Raman spectral imaging experiment of mice tissue. Our aim is to help move Raman-based technologies from proof-of-concept studies toward real-world applications.
Deep learning a boon for biophotonics? Pradhan, Pranita; Guo, Shuxia; Ryabchykov, Oleg ...
Journal of biophotonics,
June 2020, 2020-06-00, 20200601, Volume:
13, Issue:
6
Journal Article
Peer reviewed
Open access
This review covers original articles using deep learning in the biophotonic field published in the last years. In these years deep learning, which is a subset of machine learning mostly based on ...artificial neural network geometries, was applied to a number of biophotonic tasks and has achieved state‐of‐the‐art performances. Therefore, deep learning in the biophotonic field is rapidly growing and it will be utilized in the next years to obtain real‐time biophotonic decision‐making systems and to analyze biophotonic data in general. In this contribution, we discuss the possibilities of deep learning in the biophotonic field including image classification, segmentation, registration, pseudostaining and resolution enhancement. Additionally, we discuss the potential use of deep learning for spectroscopic data including spectral data preprocessing and spectral classification. We conclude this review by addressing the potential applications and challenges of using deep learning for biophotonic data.
This review article describes the use of deep learning for biophotonic imaging and spectroscopic data.
Full text
Available for:
FZAB, GIS, IJS, KILJ, NLZOH, NUK, OILJ, SAZU, SBCE, SBMB, UL, UM, UPUK
Raman spectroscopy (RS) is a spectroscopic method which indirectly measures the vibrational states within samples. This information on vibrational states can be utilized as spectroscopic fingerprints ...of the sample, which, subsequently, can be used in a wide range of application scenarios to determine the chemical composition of the sample without altering it, or to predict a sample property, such as the disease state of patients. These two examples are only a small portion of the application scenarios, which range from biomedical diagnostics to material science questions. However, the Raman signal is weak and due to the label-free character of RS, the Raman data is untargeted. Therefore, the analysis of Raman spectra is challenging and machine learning based chemometric models are needed. As a subset of representation learning algorithms, deep learning (DL) has had great success in data science for the analysis of Raman spectra and photonic data in general. In this review, recent developments of DL algorithms for Raman spectroscopy and the current challenges in the application of these algorithms will be discussed.
Infrared (IR) spectroscopy has greatly improved the ability to study biomedical samples because IR spectroscopy measures how molecules interact with infrared light, providing a measurement of the ...vibrational states of the molecules. Therefore, the resulting IR spectrum provides a unique vibrational fingerprint of the sample. This characteristic makes IR spectroscopy an invaluable and versatile technology for detecting a wide variety of chemicals and is widely used in biological, chemical, and medical scenarios. These include, but are not limited to, micro-organism identification, clinical diagnosis, and explosive detection. However, IR spectroscopy is susceptible to various interfering factors such as scattering, reflection, and interference, which manifest themselves as baseline, band distortion, and intensity changes in the measured IR spectra. Combined with the absorption information of the molecules of interest, these interferences prevent direct data interpretation based on the Beer–Lambert law. Instead, more advanced data analysis approaches, particularly artificial intelligence (AI)-based algorithms, are required to remove the interfering contributions and, more importantly, to translate the spectral signals into high-level biological/chemical information. This leads to the tasks of spectral pre-processing and data modeling, the main topics of this review. In particular, we will discuss recent developments in both tasks from the perspectives of classical machine learning and deep learning.
Full text
Available for:
IZUM, KILJ, NUK, PILJ, PNG, SAZU, UL, UM, UPUK
Raman spectra of biological samples often exhibit variations originating from changes of spectrometers, measurement conditions, and cultivation conditions. Such unwanted variations make a ...classification extremely challenging, especially if they are more significant compared with the differences between groups to be separated. A classifier is prone to such unwanted variations (ie, intragroup variations) and can fail to learn the patterns that can help separate different groups (ie, intergroup differences). This often leads to a poor generalization performance and a degraded transferability of the trained model. A natural solution is to separate the intragroup variations from the intergroup differences and build the classifier based on merely the latter information, for example, by a well‐designed feature extraction. This forms the idea of this contribution. Herein, we modified two commonly applied feature extraction approaches, principal component analysis (PCA) and partial least squares (PLS), in order to extract merely the features representing the intergroup differences. Both of the methods were verified with two Raman spectral datasets measured from bacterial cultures and colon tissues of mice, respectively. In comparison to ordinary PCA and PLS, the modified PCA was able to improve the prediction on the testing data that bears significant difference to the training data, while the modified PLS could help avoid overfitting and lead to a more stable classification.
Two commonly applied feature extraction approaches, PCA and PLS, were modified in order to extract merely the features representing the inter group differences and hence improve the performance of subsequent classifiers. In comparison to ordinary PCA and PLS, the modified PCA was proven to improve the prediction of classifiers on the testing data that bears significant difference to the training data, while the modified PLS could help avoid overfitting and lead to a more stable classification.
Full text
Available for:
BFBNIB, FZAB, GIS, IJS, KILJ, NLZOH, NUK, OILJ, SAZU, SBCE, SBMB, UL, UM, UPUK
Data fusion aims to provide a more accurate description of a sample than any one source of data alone. At the same time, data fusion minimizes the uncertainty of the results by combining data from ...multiple sources. Both aim to improve the characterization of samples and might improve clinical diagnosis and prognosis. In this paper, we present an overview of the advances achieved over the last decades in data fusion approaches in the context of the medical and biomedical fields. We collected approaches for interpreting multiple sources of data in different combinations: image to image, image to biomarker, spectra to image, spectra to spectra, spectra to biomarker, and others. We found that the most prevalent combination is the image-to-image fusion and that most data fusion approaches were applied together with deep learning or machine learning methods.
Full text
Available for:
IZUM, KILJ, NUK, PILJ, PNG, SAZU, UL, UM, UPUK
Raman spectroscopy is an emerging technique in bioanalysis and imaging of biomaterials owing to its unique capability of generating spectroscopic fingerprints. Imaging cells and tissues by Raman ...microspectroscopy represents a nondestructive and label‐free approach. All components of cells or tissues contribute to the Raman signals, giving rise to complex spectral signatures. Resonance Raman scattering and surface‐enhanced Raman scattering can be used to enhance the signals and reduce the spectral complexity. Raman‐active labels can be introduced to increase specificity and multimodality. In addition, nonlinear coherent Raman scattering methods offer higher sensitivities, which enable the rapid imaging of larger sampling areas. Finally, fiber‐based imaging techniques pave the way towards in vivo applications of Raman spectroscopy. This Review summarizes the basic principles behind medical Raman imaging and its progress since 2012.
Owing to its unique ability to generate spectroscopic fingerprints, Raman spectroscopy is an emerging technique in bioanalysis and biomaterial imaging. The theory behind this method as well as instrumentation and data‐processing methods are discussed in this Review, and the progress in medical Raman imaging since 2012 is summarized.
Full text
Available for:
BFBNIB, FZAB, GIS, IJS, KILJ, NLZOH, NUK, OILJ, SAZU, SBCE, SBMB, UL, UM, UPUK
Microbial communities are essential to the function of virtually all ecosystems and eukaryotes, including humans. However, it is still a major challenge to identify microbial cells active under ...natural conditions in complex systems. In this study, we developed a new method to identify and sort active microbes on the single-cell level in complex samples using stable isotope probing with heavy water (D ₂O) combined with Raman microspectroscopy. Incorporation of D ₂O-derived D into the biomass of autotrophic and heterotrophic bacteria and archaea could be unambiguously detected via C-D signature peaks in single-cell Raman spectra, and the obtained labeling pattern was confirmed by nanoscale-resolution secondary ion MS. In fast-growing Escherichia coli cells, label detection was already possible after 20 min. For functional analyses of microbial communities, the detection of D incorporation from D ₂O in individual microbial cells via Raman microspectroscopy can be directly combined with FISH for the identification of active microbes. Applying this approach to mouse cecal microbiota revealed that the host-compound foragers Akkermansia muciniphila and Bacteroides acidifaciens exhibited distinctive response patterns to amendments of mucin and sugars. By Raman-based cell sorting of active (deuterated) cells with optical tweezers and subsequent multiple displacement amplification and DNA sequencing, novel cecal microbes stimulated by mucin and/or glucosamine were identified, demonstrating the potential of the nondestructive D ₂O-Raman approach for targeted sorting of microbial cells with defined functional properties for single-cell genomics.
Significance Measuring activity patterns of microbes in their natural environment is essential for understanding ecosystems and the multifaceted interactions of microorganisms with eukaryotes. In this study, we developed a technique that allows fast and nondestructive activity measurements of microbial communities on a single-cell level. Microbial communities were amended with heavy water (D ₂O), a treatment that does not change the available substrate pool. After incubation, physiologically active cells are rapidly identified with Raman microspectroscopy by measuring cellular D incorporation. Using this approach, we characterized the activity patterns of two dominant microbes in mouse cecum samples amended with different carbohydrates and discovered previously unidentified bacteria stimulated by mucin and/or glucosamine by combining Raman microspectroscopy and optical tweezer-based sorting.
Full text
Available for:
BFBNIB, NMLJ, NUK, PNG, SAZU, UL, UM, UPUK
Raman spectroscopy is an emerging method for the identification of bacteria. Nevertheless, a lot of different parameters need to be considered to establish a reliable database capable of identifying ...real-world samples such as medical or environmental probes. In this review, the establishment of such reliable databases with the proper design in microbiological Raman studies is demonstrated, shining a light into all the parts that require attention. Aspects such as the strain selection, sample preparation and isolation requirements, the phenotypic influence, measurement strategies, as well as the statistical approaches for discrimination of bacteria, are presented. Furthermore, the influence of these aspects on spectra quality, result accuracy, and read-out are discussed. The aim of this review is to serve as a guide for the design of microbiological Raman studies that can support the establishment of this method in different fields.
Full text
Available for:
IZUM, KILJ, NUK, PILJ, PNG, SAZU, UL, UM, UPUK