Relative position encoding (RPE) is important for transformer to capture sequence ordering of input tokens. General efficacy has been proven in natural language processing. However, in computer ...vision, its efficacy is not well studied and even remains controversial, e.g., whether relative position encoding can work equally well as absolute position? In order to clarify this, we first review existing relative position encoding methods and analyze their pros and cons when applied in vision transformers. We then propose new relative position encoding methods dedicated to 2D images, called image RPE (iRPE). Our methods consider directional relative distance modeling as well as the interactions between queries and relative position embeddings in self-attention mechanism. The proposed iRPE methods are simple and lightweight. They can be easily plugged into transformer blocks. Experiments demonstrate that solely due to the proposed encoding methods, DeiT 21 and DETR 1 obtain up to 1.5% (top-1 Acc) and 1.3% (mAP) stable improvements over their original versions on ImageNet and COCO respectively, without tuning any extra hyperparameters such as learning rate and weight decay. Our ablation and analysis also yield interesting findings, some of which run counter to previous understanding. Code and models are open-sourced at https://github.com/microsoft/Cream/tree/main/iRPE.
To examine whether comprehensive chromosome screening (CCS) for preimplantation genetic screening (PGS) has an effect on improving in vitro fertilization/intracytoplasmic sperm injection (IVF/ICSI) ...outcomes compared to traditional morphological methods.
A literature search was conducted in PubMed, EMBASE, CNKI and ClinicalTrials.gov up to May 2015. Two reviewers independently evaluated titles and abstracts, extracted data and assessed quality. We included studies that compared the IVF/ICSI outcomes of CCS-based embryo selection with those of the traditional morphological method. Relative risk (RR) values with corresponding 95% confidence intervals (CIs) were calculated in RevMan 5.3, and subgroup analysis and Begg's test were used to assess heterogeneity and potential publication bias, respectively.
Four RCTs and seven cohort studies were included. A meta-analysis of the outcomes showed that compared to morphological criteria, euploid embryos identified by CCS were more likely to be successfully implanted (RCT RR 1.32, 95% CI 1.18-1.47; cohort study RR 1.74, 95% CI 1.35-2.24). CCS-based PGS was also related to an increased clinical pregnancy rate (RCT RR 1.26, 95% CI 0.83-1.93; cohort study RR 1.48, 95% CI 1.20-1.83), an increased ongoing pregnancy rate (RCT RR 1.31, 95% CI 0.64-2.66; cohort study RR 1.61, 95% CI 1.30-2.00), and an increased live birth rate (RCT RR 1.26, 95% CI 1.05-1.50; cohort study RR 1.35, 95% CI 0.85-2.13) as well as a decreased miscarriage rate (RCT RR 0.53, 95% CI 0.24-1.15; cohort study RR 0.31, 95% CI 0.21-0.46) and a decreased multiple pregnancy rate (RCT RR 0.02, 95% CI 0.00-0.26; cohort study RR 0.19, 95% CI 0.07-0.51). The results of the subgroup analysis also showed a significantly increased implantation rate in the CCS group.
The effectiveness of CCS-based PGS is comparable to that of traditional morphological methods, with better outcomes for women receiving IVF/ICSI technology. The transfer of both trophectoderm-biopsied and blastomere-biopsied CCS-euploid embryos can improve the implantation rate.
Celotno besedilo
Dostopno za:
DOBA, IZUM, KILJ, NUK, PILJ, PNG, SAZU, SIK, UILJ, UKNU, UL, UM, UPUK
The aim of this study is to evaluate the feasibility and safety of robot-assisted thoracic surgery (RATS) lobectomy versus video-assisted thoracic surgery (VATS) for lobectomy in patients with ...non-small cell lung cancer (NSCLC).
An electronic search of six electronic databases was performed to identify relevant comparative studies. Meta-analysis was performed by pooling the results of reported incidence of overall morbidity, mortality, prolonged air leak, arrhythmia, and pneumonia between RATS and VATS lobectomy. Subgroup analysis was also conducted based on matched and unmatched cohort studies, if possible. Relative risks (RR) with their 95% confidence intervals (CI) were calculated by means of Revman version 5.3.
Twelve retrospective cohort studies were included, with a total of 60,959 patients. RATS lobectomy significantly reduced the mortality rate when compared with VATS lobectomy (RR = 0.54, 95% CI 0.38-0.77; P = 0.0006), but this was not consistent with the pooled result of six matched studies (RR = 0.12, 95% CI 0.01-1.07; P = 0.06). There was no significant difference in morbidity between the two approaches (RR = 0.97, 95% CI 0.85-1.12; P = 0.70).
RATS lobectomy is a feasible and safe technique and can achieve an equivalent short-term surgical efficacy when compared with VATS, but its cost effectiveness also should be taken into consideration.
The present study aimed to undertake a review of available evidence assessing whether time-lapse imaging (TLI) has favorable outcomes for embryo incubation and selection compared with conventional ...methods in clinical in vitro fertilization (IVF).
Using PubMed, EMBASE, Cochrane library and ClinicalTrial.gov up to February 2017 to search for randomized controlled trials (RCTs) comparing TLI versus conventional methods. Both studies randomized women and oocytes were included. For studies randomized women, the primary outcomes were live birth and ongoing pregnancy, the secondary outcomes were clinical pregnancy and miscarriage; for studies randomized oocytes, the primary outcome was blastocyst rate, the secondary outcome was good quality embryo on Day 2/3. Subgroup analysis was conducted based on different incubation and embryo selection between groups.
Ten RCTs were included, four randomized oocytes and six randomized women. For oocyte-based review, the pool-analysis observed no significant difference between TLI group and control group for blastocyst rate relative risk (RR) 1.08, 95% CI 0.94-1.25, I2 = 0%, two studies, including 1154 embryos. The quality of evidence was moderate for all outcomes in oocyte-based review. For woman-based review, only one study provided live birth rate (RR 1,23, 95% CI 1.06-1.44,I2 N/A, one study, including 842 women), the pooled result showed no significant difference in ongoing pregnancy rate (RR 1.04, 95% CI 0.80-1.36, I2 = 59%, four studies, including 1403 women) between two groups. The quality of the evidence was low or very low for all outcomes in woman-based review.
Currently there is insufficient evidence to support that TLI is superior to conventional methods for human embryo incubation and selection. In consideration of the limitations and flaws of included studies, more well designed RCTs are still in need to comprehensively evaluate the effectiveness of clinical TLI use.
Celotno besedilo
Dostopno za:
DOBA, IZUM, KILJ, NUK, PILJ, PNG, SAZU, SIK, UILJ, UKNU, UL, UM, UPUK
Attention mechanisms have demonstrated great potential in improving the performance of deep convolutional neural networks (CNNs). However, many existing methods dedicate to developing channel or ...spatial attention modules for CNNs with lots of parameters, and complex attention modules inevitably affect the performance of CNNs. During our experiments of embedding Convolutional Block Attention Module (CBAM) in light-weight model YOLOv5s, CBAM does influence the speed and increase model complexity while reduce the average precision, but Squeeze-and-Excitation (SE) has a positive impact in the model as part of CBAM. To replace the spatial attention module in CBAM and offer a suitable scheme of channel and spatial attention modules, this paper proposes one Spatio-temporal Sharpening Attention Mechanism (SSAM), which sequentially infers intermediate maps along channel attention module and Sharpening Spatial Attention (SSA) module. By introducing sharpening filter in spatial attention module, we propose SSA module with low complexity. We try to find a scheme to combine our SSA module with SE module or Efficient Channel Attention (ECA) module and show best improvement in models such as YOLOv5s and YOLOv3-tiny. Therefore, we perform various replacement experiments and offer one best scheme that is to embed channel attention modules in backbone and neck of the model and integrate SSAM into YOLO head. We verify the positive effect of our SSAM on two general object detection datasets VOC2012 and MS COCO2017. One for obtaining a suitable scheme and the other for proving the versatility of our method in complex scenes. Experimental results on the two datasets show obvious promotion in terms of average precision and detection performance, which demonstrates the usefulness of our SSAM in light-weight YOLO models. Furthermore, visualization results also show the advantage of enhancing positioning ability with our SSAM.
The principal goal of rice (
L.) breeding is to increase the yield. In the past, hybrid rice was mainly
intra-subspecies hybrids, but its yield has been difficult to improve. The hybridization ...between the
and
subspecies has stronger heterosis; the utilization of inter-subspecies heterosis is important for long-term improvement of rice yields. However, the different diurnal flower-opening times (DFOTs) between the
and
subspecies seriously reduce the efficiency of cross-pollination and yield and increase the cost of
-
hybrid rice seeds, which has become one of the main constraints for the development of
-
hybrid rice breeding. The DFOT of plants is adapted to their growing environment and is also closely related to species stability and evolution. Herein, we review the structure and physiological basis of rice flower opening, the factors that affect DFOT, and the progress of cloning and characterization of DFOT genes in rice. We also analyze the problems in the study of DFOT and provide corresponding suggestions.
The restricted posture and unrestricted compliance brought by the controller during human-exoskeleton interaction (HEI) can cause patients to lose balance or even fall. In this article, a ...self-coordinated velocity vector (SCVV) double-layer controller with balance-guiding ability was developed for a lower-limb rehabilitation exoskeleton robot (LLRER). In the outer loop, an adaptive trajectory generator that follows the gait cycle was devised to generate a harmonious hip-knee reference trajectory on the non-time-varying (NTV) phase space. In the inner loop, velocity control was adopted. By searching the minimum L2 norm between the reference phase trajectory and the current configuration, the desired velocity vectors in which encouraged and corrected effects can be self-coordinated according to the L2 norm were obtained. In addition, the controller was simulated using an electromechanical coupling model, and relevant experiments were carried out with a self-developed exoskeleton device. Both simulations and experiments validated the effectiveness of the controller.
Since China's reform and opening-up in 1978, the income of rural residents has increased when compared with that of urban residents. However, the income growth rate of farmers is relatively low, and ...the income gap between urban and rural areas is widening. Using a sample of 1,325 large-scale farming households in Lin'an, this study constructs a theoretical path for how the level of vertical integration and an organization model affect farmers' income levels and empirically tests the path using a mediation effect analysis model. The results indicate that organization models and vertical integration are important factors that affect farmers' income levels. The total income and agricultural operation income of farmers who participate in agricultural operation organizations are greater than that of farmers who do not participate in an operation organization. In addition, the total income and agricultural operation income of farmers who produce and process and those who produce, process, and sell are higher than those of farmers who only produce. A farmers' organization model has both a direct and an indirect positive influence on their income level, with the indirect positive influence coming through the mediating variable of vertical integration. The application of the organizational model can promote the growth of rural households' total family income and agricultural income by 13.48% and 14.48% respectively, consisting of direct increases of 9.67% and 10.19%, and indirect increases of 3.81% and 4.29% through vertical integration. The results also show that access to credit, agricultural technology training, and the farmer's education level have significant positive impacts on farming income levels. The findings suggest ways to increase farmers' income by perfecting agricultural management organization systems, promoting agricultural industrialization, strengthening rural financial support, improving agricultural technical training for farmers, and increasing their level of education.
Celotno besedilo
Dostopno za:
DOBA, IZUM, KILJ, NUK, PILJ, PNG, SAZU, SIK, UILJ, UKNU, UL, UM, UPUK
In order to study the influence of freeze-thaw cycles on chloride ion corrosion resistance of RPC with copper slag (CS) instead of quartz sand (QS), the 28d uniaxial compressive strength (UCS) of ...CSRPC with a different CS substitution rate was investigated by unconfined compression tests. The electric flux test method was used to study the chloride ion diffusion resistance of CSRPC after freeze-thaw cycles, and the pore size distribution was obtained through the nuclear magnetic resonance (NMR) method. Then, a mathematical relationship between the chloride ion diffusion coefficient and the pore fractal characteristic parameter T was established to study the effect of freeze-thaw cycles on chloride ion diffusion. Finally, SEM/EDS, XRD, and DTG methods were combined to study the influence of the distribution of Friedel's salts generated after freeze-thaw cycles on chloride ion diffusion in CSRPC. The results indicate that CS has a micro aggregate effect and pozzolanic activity, which can effectively improve the chloride ion diffusion resistance of CSRPC after freeze-thaw cycles. In addition, the electric flux of CSRPC decreases with the increase in freeze-thaw cycles, and the chloride diffusion coefficient is closely related to the pore fractal dimension.
is a tropical plant and a wild relative of the food plant sweet potato (
), listed as one of the most invasive alien species in China. Recently, it has been reported that
had successfully invaded ...mangrove wetlands, indicating its high salt tolerance. Based on previous genetic studies,
offers a good model for characterizing stress-resistant genes. It has recently been identified that the SRO proteins (SIMILAR TO RCD-ONE) play important roles in a variety of stress and developmental responses. Radical-Induced Cell Death1 (RCD1) was the first identified plant SRO protein from
. As a typical SRO protein, IcSRO1 had a highly conservative WWE domain, a conserved PARP fold and protein C in the RST function area. The expression of IcSRO1 was induced by salt, drought, and the plant hormone ABA. The transgenic Arabidopsis overexpressing IcSRO1 showed higher tolerance against salt and drought stress along with lower accumulation of hydrogen peroxide (H
O
) and superoxide (O
) than the wild type. The IcSRO1 protein was localized in the nucleus after cultivation in the buffer. Our results indicated it could interact with
SALT OVERLY SENSITIVE 1 (AtSOS1), suggesting IcSRO1 may have similar functions. The pleiotropic effect of IcSRO1 on physiological processes contributes to the improvement of plant tolerance against diverse abiotic stresses, and may be associated with the adaptation of
to those environments with extreme saline and drought conditions. It therefore provides valuable gene resources for crop breeding enhancement.