Future Internet involves several emerging technologies such as 5G and beyond 5G networks, vehicular networks, unmanned aerial vehicle (UAV) networks, and Internet of Things (IoTs). Moreover, the ...future Internet becomes heterogeneous and decentralized with a large number of involved network entities. Each entity may need to make its local decision to improve the network performance under dynamic and uncertain network environments. Standard learning algorithms such as single-agent Reinforcement Learning (RL) or Deep Reinforcement Learning (DRL) have been recently used to enable each network entity as an agent to learn an optimal decision-making policy adaptively through interacting with the unknown environments. However, such an algorithm fails to model the cooperations or competitions among network entities, and simply treats other entities as a part of the environment that may result in the non-stationarity issue. Multi-agent Reinforcement Learning (MARL) allows each network entity to learn its optimal policy by observing not only the environments but also other entities' policies. As a result, MARL can significantly improve the learning efficiency of the network entities, and it has been recently used to solve various issues in the emerging networks. In this paper, we thus review the applications of MARL in emerging networks. In particular, we provide a tutorial of MARL and a comprehensive survey of applications of MARL in next-generation Internet. In particular, we first introduce single-agent RL and MARL. Then, we review a number of applications of MARL to solve emerging issues in the future Internet. The issues consist of network access, transmit power control, computation offloading, content caching, packet routing, trajectory design for UAV-aided networks, and network security issues. Finally, we discuss the challenges, open issues, and future directions related to the applications of MARL in the future Internet.
CD4 protein is a single chain transmembrane glycoprotein and has a broad functionality beyond cell-mediated immunity. In this study, we cloned the full-length coding sequence (CDS) of duck CD4 ...(duCD4) and analyzed its sequence and structure, and expression levels in several tissues. It consists of 1,449 nucleotides and encodes a 482 amino acid protein. The putative protein of duCD4 consisted of an N-terminal signal peptide, three immunoglobulins and one immunoglobulins-like domain in its central, one terminal transmembrane region, and a C-terminal domain of the CD4 T cell receptor. The duCD4 also has the typical signature “CXC” of CD4s. The multiple sequence alignment suggests duCD4 has four potential N-glycosylation sites and the phylogenetic analysis suggests duCD4 shares greater similarity with avian than other vertebrates. Quantitative real-time PCR analysis showed that duCD4 mRNA transcripts are widely distributed in the healthy Cherry Valley duck, and the highest level in the thymus. During the virus infection, the obvious change of duCD4 expression was observed in the spleen, lung and brain, which suggesting that duCD4 could be involved in the host's immune response to multiple types of viruses. Our research studied the characterization, tissue distribution, and antiviral immune responses of duCD4.
Interferon regulatory factor 8 (IRF8) is also known as interferon (IFN) consensus sequence binding protein (ICSBP), which plays an important role in IFN signal transduction. In this study, we cloned ...the full-length coding sequence of Cherry Valley duck IRF8 (duIRF8) and analyzed its structure. In addition, we tested the distribution of IRF8 in the tissues of healthy Cherry Valley ducks, and the changes in IRF8 expression levels in the tissues after virus infection. The results show that the open reading frame (ORF) of IRF8 is 1293 bp, encodes 430 amino acids, and have 3 conserved domains: the N-terminal DBD domain, the C-terminal IAD domain, and the NLS domain. Besides, from the analysis of the phylogenetic tree, it can be known that the duIRF8 has the highest homology with the anser cygnoides, and has less homology with the fish. Analyzing the distribution level of IRF8 in the tissues, it is found that the expression level of IRF8 in the liver of Cherry Valley duck is the highest. However, after infection with duck Tambusu virus, novel duck reovirus, and duck plague virus, the expression of IRF8 in the spleen and brain all showed up-regulation. These data indicate that IRF8 is involved in the host's innate immune response against virus in Cherry Valley duck.
Interferon regulatory factor 4 (IRF4) is a multifunctional transcription factor that plays an important regulatory role in the interferon (IFN) signaling. IRF4 participates in the process of ...antivirus, Th cell differentiation and B cell maturation by regulating the expression of IFN and some lymphokines. In this study, Cherry Valley duck IRF4 (duIRF4) was cloned and its cDNA was analyzed. Expression of duIRF4 in a wide variety of tissues and changes in duIRF4 expression due to viral infection also was detected by quantitative real-time PCR. The results show that duIRF4 contains 1,341 bp of ORF encoding a protein with 446 amino acids and contains 3 domains: DNA-binding domain (DBD), IRF-association domain (IAD) and nuclear localization signal (NLS). Quantitative real-time PCR analysis showed that duIRF4 was evenly expressed in all tissues examined, with the highest expression in the spleen, followed by the bursa of Fabricius, and lower in the skin and brain. In addition, expression of duIRF4 in the brain and spleen was significantly upregulated after being infected by duck plague virus, duck Tembusu virus, and novel duck reovirus. These data suggest that duIRF4 may be involved in innate immune response.
Tripartite motif-containing 32 (TRIM32) is an E3 ubiquitin ligase with multiple functions. In this study, we amplified TRIM32 gene from the Cherry Valley duck, and its cDNA sequence contained an open ...reading frame of 1,950 bp that encodes 649 amino acids. Duck TRIM32 (duTRIM32) mRNA was expressed in all tissues tested. A series of immune-related genes that were induced by viral infection, including interferon alfa, IL-1β, retinoic acid–inducible gene-I, Mx, and OAS, were regulated by duTRIM32 expression. DuTRIM32 overexpression inhibits duck Tembusu virus (DTMUV) replication in the early stages of viral infection. Knockdown of duTRIM32 expression by siRNA reduced the ability of duck embryo fibroblast cells to mount a type Ⅰ interferon response to DTMUV. Therefore, our results suggest that the duTRIM32-mediated signal pathway plays an essential role in DTMUV infection-induced innate immune response.
In mammals, the retinoic acid-inducible gene I (RIG-I)-like receptors (RLR) has been demonstrated to play a critical role in activating downstream signaling in response to viral RNA. However, its ...role in ducks’ antiviral innate immunity is less well understood, and how gene-mediated signaling is regulated is unknown. The regulatory role of the duck laboratory of genetics and physiology 2 (duLGP2) in the duck RIG-I (duRIG-I)-mediated antiviral innate immune signaling system was investigated in this study. In duck embryo fibroblast (DEF) cells, overexpression of duLGP2 dramatically reduced duRIG-I-mediated IFN-promotor activity and cytokine expression. In contrast, the knockdown of duLGP2 led to an opposite effect on the duRIG-I-mediated signaling pathway. We demonstrated that duLGP2 suppressed the duRIG-I activation induced by duck Tembusu virus (DTMUV) infection. Intriguingly, when duRIG-I signaling was triggered, duLGP2 enhanced the production of inflammatory cytokines. We further showed that duLGP2 interacts with duRIG-I, and this interaction was intensified during DTMUV infection. In summary, our data suggest that duLGP2 downregulated duRIG-I mediated innate immunity against the Tembusu virus. The findings of this study will help researchers better understand the antiviral innate immune system’s regulatory networks in ducks.
Novel duck reovirus (NDRV) causes severe economic losses to the duck industry, which is characterized by hemorrhagic spots and necrotic foci of the livers and spleens. DEAD-box helicase 1 (DDX1) ...plays a critical role in the innate immune system against viral infection. However, the role of duck DDX1 (duDDX1) in anti-RNA virus infection, especially in the anti-NDRV infection, has yet to be elucidated. In the present study, the full-length cDNA of duDDX1 (2223 bp encode 740 amino acids) was firstly cloned from the spleen of healthy Cherry valley ducks, and the phylogenetic tree indicated that the duDDX1 has the closest relationship with Anas platyrhynchos in the bird branch. The duDDX1 mRNA was widely distributed in all tested tissues, especially in the duodenum, liver, and spleen. Overexpression of duDDX1 in primary duck embryo fibroblast (DEF) cells triggered the activation of transcription factors IRF-7 and NF-κB, as well as IFN-β expression, and the expression of the Toll-like receptors (TLR2, TLR3, and TLR4) was significantly increased. Importantly, after overexpressing or knocking down duDDX1 and infecting NDRV in DEF cells, duDDX1 inhibits the replication of NDRV virus and also regulates the expression of pattern recognition receptors and cytokines. This indicates that duDDX1 may play an important role in the innate immune response of ducks to NDRV. Collectively, we first cloned DDX1 from ducks and analyzed its biological functions. Secondly, we proved that duck DDX1 participates in anti-NDRV infection, and innovated new ideas for the prevention and control of duck virus infection.
Sensor networks contain a large number of nodes that can perceive changes of external environment, which makes sensor networks particularly suitable for target tracking and discovery. In practical ...applications, once the sensor nodes are arranged, it is difficult to move them. We focus on analysing the target discovery ability of static-sensor networks. We divided the target into two kinds, one is persistent target and the other is instantaneous target. We investigate target discovery probability and discovery delay with different nodes density, sensing range and duty cycle. Energy saving is still the most important problem for the applications of sensor networks. Balancing target discovery capability and lifetime of the whole sensor network is necessary. Based on the theoretical analysis, we propose a coverage adaptive optimization algorithm that significantly prolongs the life of sensor networks. Simulation results show the advantage of coverage adaptive optimization algorithm over previous proposed methods.
Galectins play important roles in the host's innate immunity as pattern recognition receptors. In this study, the coding sequences of galectin-2 were identified from Cherry Valley ducks. Tissue ...distribution of duck galectin-2 (duGal-2) in healthy ducks and ducks infected with avian pathogenic Escherichia coli (APEC) was studied, respectively. The results showed that duGal-2 expression was higher in the gut, kidney, and liver tissue, and weakly expressed in the lung and brain, in healthy ducks; however, the expression level of duGal-2 was detected as being up-regulated after infection with APEC. In addition, knockdown or overexpression of duGal-2 in DEFs was achieved by small interference RNA (siRNA) transfection and plasmid transduction, respectively. The knockdown of duGal-2 led to a decrease in the expression of some inflammatory cytokines such as IL-1β, IL-6, and IL-8, while the expression levels of anti-inflammatory factor IL-10 were up-regulated. At the same time, the bacterial load of APEC was increased after knockdown of duGal-2
in vitro
. However, the opposite results were obtained in the duGal-2 overexpression group. Taken together, duGal-2 plays an important role in the host against APEC infection.
PDF
