Transformers for Energy Forecast Oliveira, Hugo S; Oliveira, Helder P
Sensors (Basel, Switzerland),
08/2023, Volume:
23, Issue:
15
Journal Article
Peer reviewed
Open access
Forecasting energy consumption models allow for improvements in building performance and reduce energy consumption. Energy efficiency has become a pressing concern in recent years due to the ...increasing energy demand and concerns over climate change. This paper addresses the energy consumption forecast as a crucial ingredient in the technology to optimize building system operations and identifies energy efficiency upgrades. The work proposes a modified multi-head transformer model focused on multi-variable time series through a learnable weighting feature attention matrix to combine all input variables and forecast building energy consumption properly. The proposed multivariate transformer-based model is compared with two other recurrent neural network models, showing a robust performance while exhibiting a lower mean absolute percentage error. Overall, this paper highlights the superior performance of the modified transformer-based model for the energy consumption forecast in a multivariate step, allowing it to be incorporated in future forecasting tasks, allowing for the tracing of future energy consumption scenarios according to the current building usage, playing a significant role in creating a more sustainable and energy-efficient building usage.
Creativity is an inherently human skill, and thus one of the goals of Artificial Intelligence. Specifically, linguistic computational creativity deals with the autonomous generation of ...linguistically-creative artefacts. Here, we present four types of text that can be tackled in this scope—poetry, humour, riddles, and headlines—and overview computational systems developed for their generation in Portuguese. Adopted approaches are described and illustrated with generated examples, and the key role of underlying computational linguistic resources is highlighted. The future of such systems is further discussed together with the exploration of neural approaches for text generation. While overviewing such systems, we hope to disseminate the area among the community of the computational processing of the Portuguese language.
Chitosan is widely used in the biomedical field due its chemical and pharmacological properties. However, intake of chitosan results in renal tissue accumulation of chitosan and promotes an increase ...in calcium excretion. On the other hand, the effect of chitosan on the formation of calcium oxalate crystals (CaOx) has not been described. In this work, we evaluated the antioxidant capacity of chitosan and its interference in the formation of CaOx crystals in vitro. Here, the chitosan obtained commercially had its identity confirmed by nuclear magnetic resonance and infrared spectroscopy. In several tests, this chitosan showed low or no antioxidant activity. However, it also showed excellent copper-chelating activity. In vitro, chitosan acted as an inducer mainly of monohydrate CaOx crystal formation, which is more prevalent in patients with urolithiasis. We also observed that chitosan modifies the morphology and size of these crystals, as well as changes the surface charge of the crystals, making them even more positive, which can facilitate the interaction of these crystals with renal cells. Chitosan greatly influences the formation of crystals in vitro, and in vivo analyses should be conducted to assess the risk of using chitosan.
One of the world's most important crops, barley, was domesticated in the Near East around 11,000 years ago. Barley is a highly resilient crop, able to grown in varied and marginal environments, such ...as in regions of high altitude and latitude. Archaeobotanical evidence shows that barley had spread throughout Eurasia by 2,000 BC. To further elucidate the routes by which barley cultivation was spread through Eurasia, simple sequence repeat (SSR) analysis was used to determine genetic diversity and population structure in three extant barley taxa: domesticated barley (Hordeum vulgare L. subsp. vulgare), wild barley (H. vulgare subsp. spontaneum) and a six-rowed brittle rachis form (H. vulgare subsp. vulgare f. agriocrithon (Åberg) Bowd.). Analysis of data using the Bayesian clustering algorithm InStruct suggests a model with three ancestral genepools, which captures a major split in the data, with substantial additional resolution provided under a model with eight genepools. Our results indicate that H. vulgare subsp. vulgare f. agriocrithon accessions and Tibetan Plateau H. vulgare subsp. spontaneum are closely related to the H. vulgare subsp. vulgare in their vicinity, and are therefore likely to be feral derivatives of H. vulgare subsp. vulgare. Under the eight genepool model, cultivated barley is split into six ancestral genepools, each of which has a distinct distribution through Eurasia, along with distinct morphological features and flowering time phenotypes. The distribution of these genepools and their phenotypic characteristics is discussed together with archaeological evidence for the spread of barley eastwards across Eurasia.
We used genotyping-by-sequencing (GBS) to investigate the evolutionary history of domesticated tetraploid wheats. With a panel of 189 wild and domesticated wheats, we identified 1,172,469 single ...nucleotide polymorphisms (SNPs) with a read depth ≥3. Principal component analyses (PCAs) separated the Triticum turgidum and Triticum timopheevii accessions, as well as wild T. turgidum from the domesticated emmers and the naked wheats, showing that SNP typing by GBS is capable of providing robust information on the genetic relationships between wheat species and subspecies. The PCAs and a neighbour-joining analysis suggested that domesticated tetraploid wheats have closest affinity with wild emmers from the northern Fertile Crescent, consistent with the results of previous genetic studies on the origins of domesticated wheat. However, a more detailed examination of admixture and allele sharing between domesticates and different wild populations, along with genome-wide association studies (GWAS), showed that the domesticated tetraploid wheats have also received a substantial genetic input from wild emmers from the southern Levant. Taking account of archaeological evidence that tetraploid wheats were first cultivated in the southern Levant, we suggest that a pre-domesticated crop spread from this region to southeast Turkey and became mixed with a wild emmer population from the northern Fertile Crescent. Fixation of the domestication traits in this mixed population would account for the allele sharing and GWAS results that we report. We also propose that feralization of the component of the pre-domesticated population that did not acquire domestication traits has resulted in the modern wild population from southeast Turkey displaying features of both the domesticates and wild emmer from the southern Levant, and hence appearing to be the sole progenitor of domesticated tetraploids when the phylogenetic relationships are studied by methods that assume a treelike pattern of evolution.
Local and temporal control of drug release has for long been a main focus in the development of novel drug carriers. Polymersomes, which can load both hydrophilic and hydrophobic species and, at the ...same time, be tailored to respond to a desired stimulus, have drawn much attention over the last decade. Here we describe polymersomes able to encapsulate up to 6% (w/w) of doxorubicin (DOX) together with 30% (w/w) of superparamagnetic iron oxide nanoparticles (USPIO; γ-Fe2O3). Upon internalization in HeLa cells and when a high frequency AC magnetic field (14mT at 750kHz) was applied, the developed delivery system elicited an 18% increase in cell toxicity, associated with augmented DOX release kinetics. In order to ensure that the observed cytotoxicity arose from the increased doxorubicin release and not from a pure magnetic hyperthermia effect, polymersomes loaded with magnetic nanoparticles alone were also tested. In this case, no increased toxicity was observed. We hypothesize that the magnetic field is inducing a very local hyperthermia effect at the level of the polymersome membrane, increasing drug release. This approach opens new perspectives in the development of smart delivery systems able to release drug upon demand and therefore, improving treatment control.
When exposed to a high frequency magnetic field, internalized hybrid polymersomes (loaded with doxorubicin and superparamagnetic iron oxide nanoparticles) are able to trigger intracellular drug release and increase cytotoxicity. Display omitted
Faba bean (Vicia faba L.) is a facultative cross-pollinating legume crop with a great importance for food and feed due to its high protein content as well as the important role in soil fertility and ...nitrogen fixation. In this work we evaluated genetic diversity and population structure of faba bean accessions from the Western Mediterranean basin and wild related species. For that purpose we screened 53 V. faba, 2 V. johannis and 7 V. narbonensis accessions from Portugal, Spain and Morocco with 28 faba bean Single Sequence Repeats (SSR). SSR genotyping showed that the number of alleles detected per locus for the polymorphic markers ranged between 2 and 10, with Polymorphic Information Content (PIC) values between 0.662 and 0.071, and heterozygosity (HO) between 0-0.467. Heterozygosity and inbreeding coefficient levels indicate a higher level of inbreeding in wild related species than in cultivated Vicia. The analysis of molecular variance (AMOVA) showed a superior genetic diversity within accessions than between accessions even from distant regions. These results are in accordance to population structure analysis showing that individuals from the same accession can be genetically more similar to individuals from far away accessions, than from individuals from the same accession. In all three levels of analysis (whole panel of cultivated and wild accessions, cultivated faba bean accessions and Portuguese accessions) no population structure was observed based on geography or climatic factors. Differences between V. narbonensis and V. johannis are undetectable although these wild taxa are clearly distinct from V. faba accessions. Thus, a limited gene flow occurred between cultivated accessions and wild relatives. Contrastingly, the lack of population structure seems to indicate a high degree of gene flow between V. faba accessions, possibly explained by the partially allogamous habit in association with frequent seed exchange/introduction.
Peptidoglycan degrading enzymes are of increasing interest as antibacterial agents, especially against multi-drug resistant pathogens. Herein we present a review about the biological features of ...virion-associated lysins and endolysins, phage-derived enzymes that have naturally evolved to compromise the bacterial peptidoglycan from without and from within, respectively. These natural features may determine the adaptability of the enzymes to kill bacteria in different environments. Endolysins are by far the most studied group of peptidoglycan-degrading enzymes, with several studies showing that they can exhibit potent antibacterial activity under specific conditions. However, the lytic activity of most endolysins seems to be significantly reduced when tested against actively growing bacteria, something that may be related to fact that these enzymes are naturally designed to degrade the peptidoglycan from within dead cells. This may negatively impact the efficacy of the endolysin in treating some infections in vivo. Here, we present a critical view of the methods commonly used to evaluate in vitro and in vivo the antibacterial performance of PG-degrading enzymes, focusing on the major hurdles concerning in vitro-to-in vivo translation.
PDF
