Visual inspection has been a common practice to determine the number of plants in orchards, which is a labor-intensive and time-consuming task. Deep learning algorithms have demonstrated great ...potential for counting plants on unmanned aerial vehicle (UAV)-borne sensor imagery. This paper presents a convolutional neural network (CNN) approach to address the challenge of estimating the number of citrus trees in highly dense orchards from UAV multispectral images. The method estimates a dense map with the confidence that a plant occurs in each pixel. A flight was conducted over an orchard of Valencia-orange trees planted in linear fashion, using a multispectral camera with four bands in green, red, red-edge and near-infrared. The approach was assessed considering the individual bands and their combinations. A total of 37,353 trees were adopted in point feature to evaluate the method. A variation of σ (0.5; 1.0 and 1.5) was used to generate different ground truth confidence maps. Different stages (T) were also used to refine the confidence map predicted. To evaluate the robustness of our method, we compared it with two state-of-the-art object detection CNN methods (Faster R-CNN and RetinaNet). The results show better performance with the combination of green, red and near-infrared bands, achieving a Mean Absolute Error (MAE), Mean Square Error (MSE), R2 and Normalized Root-Mean-Squared Error (NRMSE) of 2.28, 9.82, 0.96 and 0.05, respectively. This band combination, when adopting σ = 1 and a stage (T = 8), resulted in an R2, MAE, Precision, Recall and F1 of 0.97, 2.05, 0.95, 0.96 and 0.95, respectively. Our method outperforms significantly object detection methods for counting and geolocation. It was concluded that our CNN approach developed to estimate the number and geolocation of citrus trees in high-density orchards is satisfactory and is an effective strategy to replace the traditional visual inspection method to determine the number of plants in orchards trees.
A review on deep learning in UAV remote sensing Osco, Lucas Prado; Marcato Junior, José; Marques Ramos, Ana Paula ...
International journal of applied earth observation and geoinformation,
October 2021, 2021-10-00, 2021-10-01, Letnik:
102
Journal Article
Recenzirano
Odprti dostop
•Combining deep learning and UAV-based data is an emerging trend in remote sensing.•Most articles published rely on CNN-based methods.•Future perspectives in UAV-based data processing still have much ...to cover.
Deep Neural Networks (DNNs) learn representation from data with an impressive capability, and brought important breakthroughs for processing images, time-series, natural language, audio, video, and many others. In the remote sensing field, surveys and literature revisions specifically involving DNNs algorithms’ applications have been conducted in an attempt to summarize the amount of information produced in its subfields. Recently, Unmanned Aerial Vehicle (UAV)-based applications have dominated aerial sensing research. However, a literature revision that combines both “deep learning” and “UAV remote sensing” thematics has not yet been conducted. The motivation for our work was to present a comprehensive review of the fundamentals of Deep Learning (DL) applied in UAV-based imagery. We focused mainly on describing the classification and regression techniques used in recent applications with UAV-acquired data. For that, a total of 232 papers published in international scientific journal databases was examined. We gathered the published materials and evaluated their characteristics regarding the application, sensor, and technique used. We discuss how DL presents promising results and has the potential for processing tasks associated with UAV-based image data. Lastly, we project future perspectives, commentating on prominent DL paths to be explored in the UAV remote sensing field. This revision consisting of an approach to introduce, commentate, and summarize the state-of-the-art in UAV-based image applications with DNNs algorithms in diverse subfields of remote sensing, grouping it in the environmental, urban, and agricultural contexts.
The traditional method of measuring nitrogen content in plants is a time-consuming and labor-intensive task. Spectral vegetation indices extracted from unmanned aerial vehicle (UAV) images and ...machine learning algorithms have been proved effective in assisting nutritional analysis in plants. Still, this analysis has not considered the combination of spectral indices and machine learning algorithms to predict nitrogen in tree-canopy structures. This paper proposes a new framework to infer the nitrogen content in citrus-tree at a canopy-level using spectral vegetation indices processed with the random forest algorithm. A total of 33 spectral indices were estimated from multispectral images acquired with a UAV-based sensor. Leaf samples were gathered from different planting-fields and the leaf nitrogen content (LNC) was measured in the laboratory, and later converted into the canopy nitrogen content (CNC). To evaluate the robustness of the proposed framework, we compared it with other machine learning algorithms. We used 33,600 citrus trees to evaluate the performance of the machine learning models. The random forest algorithm had higher performance in predicting CNC than all models tested, reaching an R2 of 0.90, MAE of 0.341 g·kg−1 and MSE of 0.307 g·kg−1. We demonstrated that our approach is able to reduce the need for chemical analysis of the leaf tissue and optimizes citrus orchard CNC monitoring.
Immune evasion by tumors includes several different mechanisms, including the inefficiency of antigen presenting cells (APCs) to trigger anti-tumor T cell responses. B lymphocytes may display a ...pro-tumoral role but can also be modulated to function as antigen presenting cells to T lymphocytes, capable of triggering anti-cancer immune responses. While dendritic cells, DCs, are the best APC population to activate naive T cells, DCs or their precursors, monocytes, are frequently modulated by tumors, displaying a tolerogenic phenotype in cancer patients. In patients with cervical cancer, we observed that monocyte derived DCs are tolerogenic, inhibiting allogeneic T cell activation compared to the same population obtained from patients with precursor lesions or cervicitis. In this work, we show that B lymphocytes from cervical cancer patients respond to treatment with sCD40L and IL-4 by increasing the CD80+CD86+ population, therefore potentially increasing their ability to activate T cells. To test if B lymphocytes could actually trigger anti-tumor T cell responses, we designed an experimental model where we harvested T and B lymphocytes, or dendritic cells, from tumor bearing donors, and after APC stimulation, transplanted them, together with T cells into RAG1-/- recipients, previously injected with tumor cells. We were able to show that anti-CD40 activated B lymphocytes could trigger secondary T cell responses, dependent on MHC-II expression. Moreover, we showed that dendritic cells were resistant to the anti-CD40 treatment and unable to stimulate anti-tumor responses. In summary, our results suggest that B lymphocytes may be used as a tool for immunotherapy against cancer.
Celotno besedilo
Dostopno za:
DOBA, IZUM, KILJ, NUK, PILJ, PNG, SAZU, SIK, UILJ, UKNU, UL, UM, UPUK
Under ideal conditions of nitrogen (N), maize (Zea mays L.) can grow to its full potential, reaching maximum plant height (PH). As a rapid and nondestructive approach, the analysis of unmanned aerial ...vehicles (UAV)-based imagery may be of assistance to estimate N and height. The main objective of this study is to present an approach to predict leaf nitrogen concentration (LNC, g kg−1) and PH (m) with machine learning techniques and UAV-based multispectral imagery in maize plants. An experiment with 11 maize cultivars under two rates of N fertilization was carried during the 2017/2018 and 2018/2019 crop seasons. The spectral vegetation indices (VI) normalized difference vegetation index (NDVI), normalized difference red-edge index (NDRE), green normalized difference vegetation (GNDVI), and the soil adjusted vegetation index (SAVI) were extracted from the images and, in a computational system, used alongside the spectral bands as input parameters for different machine learning models. A randomized 10-fold cross-validation strategy, with a total of 100 replicates, was used to evaluate the performance of 9 supervised machine learning (ML) models using the Pearson’s correlation coefficient (r), mean absolute error (MAE), coefficient of regression (R²), and root mean square error (RMSE) metrics. The results indicated that the random forest (RF) algorithm performed better, with r and RMSE, respectively, of 0.91 and 1.9 g.kg−¹ for LNC, and 0.86 and 0.17 m for PH. It was also demonstrated that VIs contributed more to the algorithm’s performances than individual spectral bands. This study concludes that the RF model is appropriate to predict both agronomic variables in maize and may help farmers to monitor their plants based upon their LNC and PH diagnosis and use this knowledge to improve their production rates in the subsequent seasons.
This paper presents a framework based on machine learning algorithms to predict nutrient content in leaf hyperspectral measurements. This is the first approach to evaluate macro- and micronutrient ...content with both machine learning and reflectance/first-derivative data. For this, citrus-leaves collected at a Valencia-orange orchard were used. Their spectral data was measured with a Fieldspec ASD FieldSpec® HandHeld 2 spectroradiometer and the surface reflectance and first-derivative spectra from the spectral range of 380 to 1020 nm (640 spectral bands) was evaluated. A total of 320 spectral signatures were collected, and the leaf-nutrient content (N, P, K, Mg, S, Cu, Fe, Mn, and Zn) was associated with them. For this, 204,800 (320 × 640) combinations were used. The following machine learning algorithms were used in this framework: k-Nearest Neighbor (kNN), Lasso Regression, Ridge Regression, Support Vector Machine (SVM), Artificial Neural Network (ANN), Decision Tree (DT), and Random Forest (RF). The training methods were assessed based on Cross-Validation and Leave-One-Out. The Relief-F metric of the algorithms’ prediction was used to determine the most contributive wavelength or spectral region associated with each nutrient. This approach was able to return, with high predictions (R2), nutrients like N (0.912), Mg (0.832), Cu (0.861), Mn (0.898), and Zn (0.855), and, to a lesser extent, P (0.771), K (0.763), and S (0.727). These accuracies were obtained with different algorithms, but RF was the most suitable to model most of them. The results indicate that, for the Valencia-orange leaves, surface reflectance data is more suitable to predict macronutrients, while first-derivative spectra is better linked to micronutrients. A final contribution of this study is the identification of the wavelengths responsible for contributing to these predictions.
Accurately mapping croplands is an important prerequisite for precision farming since it assists in field management, yield-prediction, and environmental management. Crops are sensitive to planting ...patterns and some have a limited capacity to compensate for gaps within a row. Optical imaging with sensors mounted on Unmanned Aerial Vehicles (UAV) is a cost-effective option for capturing images covering croplands nowadays. However, visual inspection of such images can be a challenging and biased task, specifically for detecting plants and rows on a one-step basis. Thus, developing an architecture capable of simultaneously extracting plant individually and plantation-rows from UAV-images is yet an important demand to support the management of agricultural systems. In this paper, we propose a novel deep learning method based on a Convolutional Neural Network (CNN) that simultaneously detects and geolocates plantation-rows while counting its plants considering highly-dense plantation configurations. The experimental setup was evaluated in (a) a cornfield (Zea mays L.) with different growth stages (i.e. recently planted and mature plants) and in a (b) Citrus orchard (Citrus Sinensis Pera). Both datasets characterize different plant density scenarios, in different locations, with different types of crops, and from different sensors and dates. This scheme was used to prove the robustness of the proposed approach, allowing a broader discussion of the method. A two-branch architecture was implemented in our CNN method, where the information obtained within the plantation-row is updated into the plant detection branch and retro-feed to the row branch; which are then refined by a Multi-Stage Refinement method. In the corn plantation datasets (with both growth phases – young and mature), our approach returned a mean absolute error (MAE) of 6.224 plants per image patch, a mean relative error (MRE) of 0.1038, precision and recall values of 0.856, and 0.905, respectively, and an F-measure equal to 0.876. These results were superior to the results from other deep networks (HRNet, Faster R-CNN, and RetinaNet) evaluated with the same task and dataset. For the plantation-row detection, our approach returned precision, recall, and F-measure scores of 0.913, 0.941, and 0.925, respectively. To test the robustness of our model with a different type of agriculture, we performed the same task in the citrus orchard dataset. It returned an MAE equal to 1.409 citrus-trees per patch, MRE of 0.0615, precision of 0.922, recall of 0.911, and F-measure of 0.965. For the citrus plantation-row detection, our approach resulted in precision, recall, and F-measure scores equal to 0.965, 0.970, and 0.964, respectively. The proposed method achieved state-of-the-art performance for counting and geolocating plants and plant-rows in UAV images from different types of crops. The method proposed here may be applied to future decision-making models and could contribute to the sustainable management of agricultural systems.
Transcriptome studies have reported the dysregulation of cell cycle-related genes and the global inhibition of host mRNA translation in COVID-19 cases. However, the key genes and cellular mechanisms ...that are most affected by the severe outcome of this disease remain unclear. For this work, the RNA-seq approach was used to study the differential expression in buffy coat cells of two groups of people infected with SARS-CoV-2: (a) Mild, with mild symptoms; and (b) SARS (Severe Acute Respiratory Syndrome), who were admitted to the intensive care unit with the severe COVID-19 outcome. Transcriptomic analysis revealed 1009 up-regulated and 501 down-regulated genes in the SARS group, with 10% of both being composed of long non-coding RNA. Ribosome and cell cycle pathways were enriched among down-regulated genes. The most connected proteins among the differentially expressed genes involved transport dysregulation, proteasome degradation, interferon response, cytokinesis failure, and host translation inhibition. Furthermore, interactome analysis showed Fibrillarin to be one of the key genes affected by SARS-CoV-2. This protein interacts directly with the N protein and long non-coding RNAs affecting transcription, translation, and ribosomal processes. This work reveals a group of dysregulated processes, including translation and cell cycle, as key pathways altered in severe COVID-19 outcomes.
The geographical nature and environmental, operational, and socioeconomic factors involved in the complex task of selecting landfill sites require the use of Multi-Criteria Decision Analysis (MCDA) ...in a Geographic Information System (GIS) environment. Moreover, GIS-based route analysis can optimize the process of area selection for landfills that attend to more than one municipality, i.e., consortium landfills. This study presents a methodological approach integrating MCDA and logistical analysis to propose suitable areas for consortium landfills. The region of the Paraíba do Sul basin, southeast of Brazil, was selected as a case of study. The proposed method uses the Analytical Hierarchy Process (AHP) with fuzzy logic to select suitability areas to landfill. Additionally, a logistical method of municipalities clusters involving criteria based on localization, number of municipalities, distance, and the minimum area is applied to select suitable areas that serve more than one municipality. The findings demonstrated that 69% of the study area is inadequate to support a consortium landfill installation. From the remaining areas, 26.03% were considered highly suitable. Among these, a scenario with 11 areas was selected to be destined to consortium landfills to attend the region for 20 years. Selecting areas of high suitability and evaluating these areas for consortia formation contribute to the minimization of negative impacts resulting from the implementation and operation of landfills. It is concluded that the proposed approach can support this task efficiently and it is recommended that it be employed in other regions that also face the critical problem of defining areas for consortia formation.
Applying the climatological water balance (WB) concept to describe the relationship between climatic seasonality and surface water quality according to different forms of land use and land cover ...(LULC) is an important issue, but little explored in the literature. In this paper, we evaluate the influence of WB on surface water quality and its impacts when interacting with LULC. We monitored 11 sampling points during the four seasons of the year, from which we estimate WQI (water quality index) and TSI (trophic state index). We found an effect of the seasonality factor on both WQI values (
F
(3,30) = 12.472;
p
< 0.01) and in TSI values (
F
(3,30) = 6.967;
p
< 0.01). We noticed that LULC interferes in the way that the water balance influences the WQI and TSI values since in sampling points closest to higher urban density, with little or no riparian protection, the correlation between water balance and water quality was lower. In the stations that had the lowest water surplus and deficit, there was positive linearity between water balance and WQI. However, in the seasons when the surplus and water deficit recorded were extreme, there was no linearity. We conclude that water deficiency impairs the quality of surface water. In the extreme surplus water season, the homogeneity of WQI samples was lower, suggesting a higher interaction between rainwater and LULC. This study contributes to design management strategies of water resources, considering the climatic seasonality for optimization.
PDF
