In this work, the IRGAN model is revisited to tackle semi-supervised information retrieval (IR) problems, considering the premature convergence of IRGAN caused by mismatching the guidance information ...between the generator G and the discriminator D. A novel framework called COGAN is proposed, which adds a tutor T to enhance G for avoiding the ill-trained models. The COGAN model plays a collaborative minimax game among T, G and D by iteratively optimizing them in two cycles of generative adversarial networks, including a tutor-student cycle and a generator-discriminator cycle. COGAN has three compelling advantages over IRGAN: (i) alleviate the ill-trained problem, (ii) allow three models to play adversarial games, and (iii) prevent the model from overfitting. The COGAN framework is then applied in the web search task, and it shows significant improvement over other strong baselines. The improvements of COGAN over IRGAN in terms of NDCG@3 and MRR are 19.23% and 11.46%, respectively, on the largest semi-supervised learning to rank dataset MQ2008-semi.
●The COGAN framework is proposed for web search task.●A dual cycle enhanced strategy is proposed in two adversarial games.●The COGAN framework achieves significant improvements over IRGAN.
Full text
Available for:
GEOZS, IJS, IMTLJ, KILJ, KISLJ, NLZOH, NUK, OILJ, PNG, SAZU, SBCE, SBJE, UILJ, UL, UM, UPCLJ, UPUK, ZAGLJ, ZRSKP
Improving the efficiency of Transformer-based language pre-training is an important task in NLP, especially for the self-attention module, which is computationally expensive. In this paper, we ...propose a simple but effective solution, called \emph{LazyFormer}, which computes the self-attention distribution infrequently. LazyFormer composes of multiple lazy blocks, each of which contains multiple Transformer layers. In each lazy block, the self-attention distribution is only computed once in the first layer and then is reused in all upper layers. In this way, the cost of computation could be largely saved. We also provide several training tricks for LazyFormer. Extensive experiments demonstrate the effectiveness of the proposed method.
The Transformer architecture has become a dominant choice in many domains, such as natural language processing and computer vision. Yet, it has not achieved competitive performance on popular ...leaderboards of graph-level prediction compared to mainstream GNN variants. Therefore, it remains a mystery how Transformers could perform well for graph representation learning. In this paper, we solve this mystery by presenting Graphormer, which is built upon the standard Transformer architecture, and could attain excellent results on a broad range of graph representation learning tasks, especially on the recent OGB Large-Scale Challenge. Our key insight to utilizing Transformer in the graph is the necessity of effectively encoding the structural information of a graph into the model. To this end, we propose several simple yet effective structural encoding methods to help Graphormer better model graph-structured data. Besides, we mathematically characterize the expressive power of Graphormer and exhibit that with our ways of encoding the structural information of graphs, many popular GNN variants could be covered as the special cases of Graphormer.
In this technical report, we present our solution of KDD Cup 2021 OGB Large-Scale Challenge - PCQM4M-LSC Track. We adopt Graphormer and ExpC as our basic models. We train each model by 8-fold ...cross-validation, and additionally train two Graphormer models on the union of training and validation sets with different random seeds. For final submission, we use a naive ensemble for these 18 models by taking average of their outputs. Using our method, our team MachineLearning achieved 0.1200 MAE on test set, which won the first place in KDD Cup graph prediction track.
TQ216; 将过氧化环己酮热转化成的聚6-羟基己酸进行酯化,通过相转移催化的理论和方法,探究了反应时间、温度和催化剂等对酯化反应的影响,并通过FT-IR、1 H NMR对产物进行了表征,最终确定了一条以18-冠醚-6(聚6-羟基己酸质量的1％)为催化剂,聚6-羟基己酸与2-溴乙醇质量比3:1,在90℃,反应2 h条件下酯化率为99％的最佳酯化路线.
Abstract
Objective
To investigate whether there are differences inmacular vascular density (VD) between patients with high-myopia (HM) and those with non-high myopia (NHM) using Optical Coherence ...Tomography Angiography (OCTA).
Method
OCTA was performed on 35 eyes with HM with spherical equivalence (SE) > − 6.00D and 35 eyes with NHM with SE ≤ -6.00D. Vascular densities of the macula (overall macula, fovea, parafovea, superior hemi and inferior hemi) were measured in each of the superficial, deep and choriocapillaris layers of the retina.
Results
In the superficial retinal layer, overall macular VFD was significantly higher in the NHM compared to the HM group (51.27 ± 3.74 vs. 48.07 ± 5.69,
p
< 0.05). There were significant differences between the NHM and HM in parafovea (52.58 ± 5.78 vs. 49.4 ± 6.43,
p
< 0.05), superior-hemi (53.38 ± 4.03 vs 49.78 ± 6.84,
p
< 0.05) and inferior-hemi regions (53.49 ± 4.61 vs 49.05 ± 6.41,
p
< 0.05), but not in the fovea region. Similarly, in the deep retinal layer, overall macular VFD was significantly higher in the NHM group compared to the HM group (58.69 ± 2.46 vs. 56.90 ± 4.08,
p
< 0.05). There was significant differences between the HM and NHM in superior-hemi region (61.97 ± 2.68 vs. 60.08 ± 3.98,
p
< 0.05), but not in the fovea, parafovea, and inferior-hemi region. In the choriocapillaris, there was no difference in the overall macular VFD, nor any of the individual sectors between the HM and the NHM groups.
Conclusion
VFD in the superficial and deep retinal layers of the macula are significantly increased in the NHM compared to HM eyes. This is not the case in the choroidal capillary layers of the retina.
Bird predation during seed maturation causes great loss to agricultural production. In this study, through GWAS analysis of a large-scale sorghum germplasm diversity panel, we identified that ...Tannin1, which encodes a WD40 protein functioning in the WD40/MYB/bHLH complex, controls bird feeding behavior in sorghum. Metabolic profiling analysis showed that a group of sorghum accessions preferred by birds contain mutated tan1-a/b alleles and accumulate significantly lower levels of anthocyanins and condensed tannin compounds. In contrast, a variety of aromatic and fatty acid-derived volatiles accumulate at significantly higher levels in these bird-preference accessions. We subsequently conducted both sparrow feeding and sparrow volatile attractant assays, which confirmed, respectively, the antifeedant and attractant functions of these differentially accumulated metabolites. In addition, the connection between the biosynthesis pathway of anthocyanin and proanthocyanidin and the pathway of fatty acid–derived volatile biosynthesis was demonstrated by discovering that Tannin1 complex modulates fatty acid biosynthesis by regulating the expression of SbGL2 in sorghum, thus affecting the accumulation of fatty acid-derived volatiles. Taken together, our study identified Tannin1 as the gene underlying the major locus controlling bird feeding behavior in sorghum, illustrating an example of the identification of an ecologically impactful molecular mechanism from field observation and providing significant insights into the chemistry of bird–plant ecological interactions.
This study identified that Tannin1, which encodes a WD40 protein functioning in the WD40/MYB/bHLH complex, control bird feeding behavior in sorghum. Tannin1 was found to differentially modulate the biosynthesis of anthocyanins and proanthocyanidins as well as the accumulation of fatty acid-derived volatiles, providing significant insights into the chemistry of bird–plant ecological interactions.
Full text
Available for:
GEOZS, IJS, IMTLJ, KILJ, KISLJ, NLZOH, NUK, OILJ, PNG, SAZU, SBCE, SBJE, UILJ, UL, UM, UPCLJ, UPUK, ZAGLJ, ZRSKP
The current research aimed to verify the effects of erythropoietin (EPO) on vascular calcification under inflammatory conditions and the molecular regulator of vascular calcification induced by EPO. ...To induce vascular calcification and systemic chronic inflammation in SD rats, EPO was administered intraperitoneally, and 10% casein was injected subcutaneously. The administration period lasted for 20 consecutive weeks. Blood samples were subsequently collected to detect inflammatory factors and vascular calcification. Additionally, high-dose EPOs were applied to stimulate primary vascular smooth muscle cells (VSMCs), and vascular calcification was measured using alizarin red staining, alkaline phosphatase (ALP) activity, and calcium salt quantification. The probe 2',7'-dichlorofluorescein diacetate (DCFH-DA) was employed to detect cellular reactive oxygen species (ROS) levels. The expressions of bone formation-related protein and anti-calcification protein matrix gla protein (MGP) were determined via Western blot. Compared with the control group, calcium deposits and vascular calcification were increased in the EPO group, tumor necrosis factor-alpha (TNF-α) group and TNF-α+ EPO group, whereas MGP was significantly reduced. Moreover, under the stimulation of TNF-α and EPO+TNF-α, pp38/p38 was increased substantially, the addition of p38 inhibitor SB203580 could significantly reduce calcium deposits and vascular calcification. In vivo experiment, compared with the EPO group, calcium salt deposition and vascular calcification were elevated in the EPO+casein group. The present results revealed that high-dose EPO could cause calcification of the abdominal aorta in rats. The inflammatory response aggravated the vascular calcification induced by EPO via activating p38 and ROS levels.
Dinoflagellates are important components of marine ecosystems and essential coral symbionts, yet little is known about their genomes. We report here on the analysis of a high-quality assembly from ...the 1180-megabase genome of Symbiodinium kawagutii. We annotated protein-coding genes and identified Symbiodinium-specific gene families. No whole-genome duplication was observed, but instead we found active (retro) transposition and gene family expansion, especially in processes important for successful symbiosis with corals. We also documented genes potentially governing sexual reproduction and cyst formation, novel promoter elements, and a microRNA system potentially regulating gene expression in both symbiont and coral. We found biochemical complementarity between genomes of S. kawagutii and the anthozoan Acropora, indicative of host-symbiont coevolution, providing a resource for studying the molecular basis and evolution of coral symbiosis.
Full text
Available for:
BFBNIB, NMLJ, NUK, ODKLJ, PNG, SAZU, UL, UM, UPUK
PDF
