Existing neural machine translation (NMT) models generally translate sentences in isolation, missing the opportunity to take advantage of document-level information. In this work, we propose to ...augment NMT models with a very light-weight cache-like memory network, which stores recent hidden representations as translation history. The probability distribution over generated words is updated online depending on the translation history retrieved from the memory, endowing NMT models with the capability to dynamically adapt over time. Experiments on multiple domains with different topics and styles show the effectiveness of the proposed approach with negligible impact on the computational cost.
With the promising progress of deep neural networks, layer aggregation has been used to fuse information across layers in various fields, such as computer vision and machine translation. However, ...most of the previous methods combine layers in a static fashion in that their aggregation strategy is independent of specific hidden states. Inspired by recent progress on capsule networks, in this paper we propose to use routing-by-agreement strategies to aggregate layers dynamically. Specifically, the algorithm learns the probability of a part (individual layer representations) assigned to a whole (aggregated representations) in an iterative way and combines parts accordingly. We implement our algorithm on top of the state-of-the-art neural machine translation model TRANSFORMER and conduct experiments on the widely-used WMT14 English-German and WMT17 Chinese-English translation datasets. Experimental results across language pairs show that the proposed approach consistently outperforms the strong baseline model and a representative static aggregation model.
This book constitutes the refereed proceedings of the First CCF Conference, NLPCC 2012, held in Beijing, China, during October/November, 2012. The 43 revised full papers presented were carefully ...reviewed and selected from 151 submissions. The papers are organized in topical sections on applications on language computing; fundamentals on language computing; machine translation and multi-lingual information access; NLP for search, ads and social networks; question answering and Web mining.
Full text
Available for:
FIS, FZAB, GEOZS, GIS, IJS, IMTLJ, KILJ, KISLJ, MFDPS, NUK, OBVAL, OILJ, PNG, SAZU, SBCE, SBJE, SBMB, SBNM, UKNU, UL, UM, UPUK, VKSCE, ZAGLJ
Self-attention networks have proven to be of profound value for its strength of capturing global dependencies. In this work, we propose to model localness for self-attention networks, which enhances ...the ability of capturing useful local context. We cast localness modeling as a learnable Gaussian bias, which indicates the central and scope of the local region to be paid more attention. The bias is then incorporated into the original attention distribution to form a revised distribution. To maintain the strength of capturing long distance dependencies and enhance the ability of capturing short-range dependencies, we only apply localness modeling to lower layers of self-attention networks. Quantitative and qualitative analyses on Chinese-English and English-German translation tasks demonstrate the effectiveness and universality of the proposed approach.
Pronouns are frequently omitted in pro-drop languages, such as Chinese, generally leading to significant challenges with respect to the production of complete translations. To date, very little ...attention has been paid to the dropped pronoun (DP) problem within neural machine translation (NMT). In this work, we propose a novel reconstruction-based approach to alleviating DP translation problems for NMT models. Firstly, DPs within all source sentences are automatically annotated with parallel information extracted from the bilingual training corpus. Next, the annotated source sentence is reconstructed from hidden representations in the NMT model. With auxiliary training objectives, in terms of reconstruction scores, the parameters associated with the NMT model are guided to produce enhanced hidden representations that are encouraged as much as possible to embed annotated DP information. Experimental results on both Chinese-English and Japanese-English dialogue translation tasks show that the proposed approach significantly and consistently improves translation performance over a strong NMT baseline, which is directly built on the training data annotated with DPs.
The high pressure phase diagrams of TaAs family (NbP, NbAs, TaP and TaAs) are explored systematically using crystal structure search together with first-principles calculations. Our calculations show ...that NbAs and TaAs have similar phase diagrams and possess the same structural phase transition sequence of I41md \(\rightarrow\) P-6m2 \(\rightarrow\) P21/c \(\rightarrow\) Pm-3m, with a bit different transition pressures. The phase transition sequence of NbP and TaP are somewhat different from that of NbAs and TaAs. In which new structures emerge, for instance, the Cmcm structure in NbP and the Pmmn structure in TaP. It is found interestingly that in the electronic structure of the high-pressure phase P-6m2-NbAs, there are Weyl points and triple degenerate points coexisted, similar to the high-pressure P-6m2-TaAs.
Using ab initio calculations based on density-functional theory and effective model analysis, we propose that the trigonal YH3(Space Group: P-3c1) at ambient pressure is a node-line semimetal when ...spin-orbit coupling (SOC) is ignored. This trigonal YH3 has very clean electronic structure near Fermi level and its nodal lines locate very closely to the Fermi energy, which makes it a perfect system for model analysis. Symmetry analysis shows that the nodal ring in this compound is protected by the glide-plane symmetry, where the band inversion of |Y+,dxz> and |H1-,s> orbits at Gamma point is responsible for the formation of the nodal lines. When SOC is included, the line nodes are prohibited by the glide-plane symmetry, and a small gap (~5 meV) appears, which leads YH3 to be a strong topological insulator with Z2 indices (1,000). Thus the glide-plane symmetry plays an opposite role in the formation of the nodal lines in cases without and with SOC. As the SOC-induced gap is so small that can be neglected, this P-3c1 YH3 may be a good candidate for experimental explorations on the fundamental physics of topological node-line semimetals. We find the surface states of this P-3c1 phase are somehow unique and may be helpful to identify the real ground state of YH3 in the experiment.
Strain can be used as an effective tool to tune the crystal structure of materials and hence to modify their electronic structures, including topological properties. Here, taking Na3Bi as a ...paradigmatic example, we demonstrated with first-principles calculations and k\(\cdot\)p models that the topological phase transitions can be induced by various types of strains. For instance, the Dirac semimetal phase of ambient Na3Bi can be tuned into a topological insulator (TI) phase by uniaxial strain along the h100i axis. Hydrostatic pressure can let the ambient structure transfer into a new thermodynamically stable phase with Fm-3m symmetry, coming with a perfect parabolic semimetal having a single contact point between the conduction and valence bands, exactly at \(\Gamma\) point on the Fermi level like \(\alpha\)-Sn. Furthermore, uniaxial strain in the direction can tune the new parabolic semimetal phase into a Dirac semimetal, while shear strains in both the and directions can take the new parabolic semimetal phase into a TI. k\(\cdot\)p models are constructed to gain more insights into these quantum topological phase transitions. At last, we calculated surface states of Fm-3m Na3Bi without and with strains to verify these topological transitions.
Improving albumen thermal stability using succinylation reaction with octenyl succinic anhydride Kulchaiyawat, Charlwit; Tong WangauthorDepartment of Food Science and Human Nutrition, Iowa State University, Ames, IA, 50011, United States; Zhaopeng HanauthorChinese National Egg Engineering Research Center, Beijing DQY Agriculture Technology Co., Ltd, Beijing, 100125, China
2015
Journal Article
Combination of treatments to improve thermal stability of egg albumen Kulchaiyawat, Charlwit; Chao WangauthorDepartment of Agricultural and Biosystems Engineering, Iowa State University, Ames, IA 50011, United States; Chenxu YuauthorDepartment of Agricultural and Biosystems Engineering, Iowa State University, Ames, IA 50011, United States ...
2015
Journal Article
