Despite progress in perceptual tasks such as image classification, computers still perform poorly on cognitive tasks such as image description and question answering. Cognition is core to tasks that ...involve not just recognizing, but reasoning about our visual world. However, models used to tackle the rich content in images for cognitive tasks are still being trained using the same datasets designed for perceptual tasks. To achieve success at cognitive tasks, models need to understand the interactions and relationships between objects in an image. When asked “What vehicle is the person riding?”, computers will need to identify the objects in an image as well as the relationships
riding(man, carriage)
and
pulling(horse, carriage)
to answer correctly that “the person is riding a horse-drawn carriage.” In this paper, we present the Visual Genome dataset to enable the modeling of such relationships. We collect dense annotations of objects, attributes, and relationships within each image to learn these models. Specifically, our dataset contains over 108K images where each image has an average of
35
objects,
26
attributes, and
21
pairwise relationships between objects. We canonicalize the objects, attributes, relationships, and noun phrases in region descriptions and questions answer pairs to WordNet synsets. Together, these annotations represent the densest and largest dataset of image descriptions, objects, attributes, relationships, and question answer pairs.
Finding effective and objective biomarkers to inform the diagnosis of schizophrenia is of great importance yet remains challenging. Relatively little work has been conducted on multi-biological data ...for the diagnosis of schizophrenia. In this cross-sectional study, we extracted multiple features from three types of biological data, including gut microbiota data, blood data, and electroencephalogram data. Then, an integrated framework of machine learning consisting of five classifiers, three feature selection algorithms, and four cross validation methods was used to discriminate patients with schizophrenia from healthy controls. Our results show that the support vector machine classifier without feature selection using the input features of multi-biological data achieved the best performance, with an accuracy of 91.7% and an AUC of 96.5% (p < 0.05). These results indicate that multi-biological data showed better discriminative capacity for patients with schizophrenia than single biological data. The top 5% discriminative features selected from the optimal model include the gut microbiota features (Lactobacillus, Haemophilus, and Prevotella), the blood features (superoxide dismutase level, monocyte-lymphocyte ratio, and neutrophil count), and the electroencephalogram features (nodal local efficiency, nodal efficiency, and nodal shortest path length in the temporal and frontal-parietal brain areas). The proposed integrated framework may be helpful for understanding the pathophysiology of schizophrenia and developing biomarkers for schizophrenia using multi-biological data.
•In this work, novel nickel-organic framework nanosheets comprising Ni2+ and an organic ligand of hexamethylenetetramine (Ni-MOFs-t, where t is the solvothermal temperature) are synthesized by a ...facile one-pot solvothermal method.•The self-supported Ni-MOFs-120 nanosheets on Ni foam (Ni-MOFs-120/NF) exhibits high electrocatalytic activity toward MOR with a low potential of 1.44 V (vs RHE) at a current density of 100 mA cm−2due to structural modulation of Ni-DMAP-t.•Electrochemical measurements have also shown that the Ni-MOFs-120/NF has superior MOR stability and catalytic kinetics, which is better than currently reported Ni-based catalysts.•Under the catalysis of Ni-MOFs-120/NF, the selective conversion of methanol to formic acid was obtained.
To improve the reaction rate and the yield of high value-added product (formic acid) of electrocatalytic methanol oxidation reaction (MOR), the development of high-performance electrocatalyst is essential. In this work, novel nickel-organic framework nanosheets comprising Ni2+ and an organic ligand of hexamethylenetetramine (Ni-MOFs-t, where t is the solvothermal temperature) are synthesized by a facile one-pot solvothermal method. By structural regulation of Ni-DMAP-t, the self-supported Ni-MOFs-120 nanosheets on Ni foam (Ni-MOFs-120/NF) exhibits high electrocatalytic activity toward MOR with a low potential of 1.44 V (vs RHE) at a current density of 100 mA cm−2. Electrochemical measurement has also demonstrated that the Ni-MOFs-120/NF possesses superior stability for MOR. Particularly, the selectively conversion of methanol to formic acid was achieved under the catalysis of Ni-MOFs-120/NF. This work offers a new high-performance electrocatalytic material for the conversion of methanol to high value-added formic aci
Organophosphorus flame retardants (OPFRs), including 2-ethylhexyl diphenyl phosphate (EHDPHP), are prevalent in everyday life due to their broad usage in fields such as healthcare, electronics, ...industry, and sports. These compounds, added to polymers through physical mixing, can leach into the environment, posing a risk to humans through direct contact or the food chain. Despite known associations with health issues like endocrine disruption, neurotoxicity, and reproductive toxicity, the implications of perinatal EHDPHP exposure on both mothers and offspring are still unclear. This study aimed to investigate the neuroinflammatory effects of EHDPHP and the potential mitigating role of inulin. Pregnant C57 mice were administered either a corn oil control or an EHDPHP solution (300 μg/kg bw/d) from gestation day 7 (GD7) to postnatal day 21 (PND21). Concurrently, mice were provided either regular drinking water or water supplemented with 1% inulin. We found that EHDPHP significantly increased the serum levels of IL-1β, IL-6, and MDA, but decreased SOD levels in both mothers and pups. These effects were reversed by inulin supplementation. RNA-sequencing revealed that EHDPHP induced inflammation and oxidative stress through the TLR4/NF-κB pathway, which was mitigated by inulin. In conclusion, inulin ameliorated EHDPHP-induced neuroinflammation and oxidative stress in both mothers and offspring, highlighting its potential therapeutic role.
Display omitted
•Perinatal exposure to EHDPHP led to neuroinflammation and oxidative stress in dams and pups.•EHDPHP upregulated the expressions of inflammation and oxidative stress related biomarkers.•Inulin attenuated EHDPHP-associated oxidative stress and neuroinflammation in both dams and pups.
Learning from Noisy Labels with Distillation Yuncheng Li; Jianchao Yang; Yale Song ...
2017 IEEE International Conference on Computer Vision (ICCV),
2017-Oct.
Conference Proceeding
The ability of learning from noisy labels is very useful in many visual recognition tasks, as a vast amount of data with noisy labels are relatively easy to obtain. Traditionally, label noise has ...been treated as statistical outliers, and techniques such as importance re-weighting and bootstrapping have been proposed to alleviate the problem. According to our observation, the real-world noisy labels exhibit multimode characteristics as the true labels, rather than behaving like independent random outliers. In this work, we propose a unified distillation framework to use "side" information, including a small clean dataset and label relations in knowledge graph, to "hedge the risk" of learning from noisy labels. Unlike the traditional approaches evaluated based on simulated label noises, we propose a suite of new benchmark datasets, in Sports, Species and Artifacts domains, to evaluate the task of learning from noisy labels in the practical setting. The empirical study demonstrates the effectiveness of our proposed method in all the domains.
Image retrieval using scene graphs Johnson, Justin; Krishna, Ranjay; Stark, Michael ...
2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR),
06/2015
Conference Proceeding
This paper develops a novel framework for semantic image retrieval based on the notion of a scene graph. Our scene graphs represent objects ("man", "boat"), attributes of objects ("boat is white") ...and relationships between objects ("man standing on boat"). We use these scene graphs as queries to retrieve semantically related images. To this end, we design a conditional random field model that reasons about possible groundings of scene graphs to test images. The likelihoods of these groundings are used as ranking scores for retrieval. We introduce a novel dataset of 5,000 human-generated scene graphs grounded to images and use this dataset to evaluate our method for image retrieval. In particular, we evaluate retrieval using full scene graphs and small scene subgraphs, and show that our method outperforms retrieval methods that use only objects or low-level image features. In addition, we show that our full model can be used to improve object localization compared to baseline methods.
Abstract
With the rapid development of blockchain technology, the financial and monetary (FM) blockchain fields also began to collide. Therefore, this study aims to explore the relationship between ...the two fields and efficiently evaluate the security of financial information. Firstly, this study introduces the theoretical basis of blockchain in the dynamic linkage mechanism of FM and gives the overall framework of digital currency based on blockchain. Meanwhile, the relationship between blockchain and digital finance is empirically analyzed and designed. Secondly, the framework of financial information service security assessment (ISSA) is created using blockchain technology, and the frame of security risk evaluation is verified by taking electronic invoice information as the research object. Finally, the results show that: (1) foreign exchange (forex) events and major stock index decline events have a significant impact on the return of Bitcoin (BTC) in the short term. Moreover, more than 70% of uncertainty events will make BTC’s abnormal return (AR) significantly positive; (2) Under the influence of forex uncertainty events, only one BTC’s AR is remarkably negative in short order, while the other seven times are markedly positive. In the uncertainty events of major stock indexes, only two times are significantly negative, and the other six times are positive. This indicates that uncertain events in the short run make prominent AR of BTC; the proposed blockchain-based ISSA model and assessment index are scientific, feasible, and operable.
The explosion of the Internet provides us with a tremendous resource of images shared online. It also confronts vision researchers the problem of finding effective methods to navigate the vast amount ...of visual information. Semantic image understanding plays a vital role towards solving this problem. One important task in image understanding is object recognition, in particular, generic object categorization. Critical to this problem are the issues of learning and dataset. Abundant data helps to train a robust recognition system, while a good object classifier can help to collect a large amount of images. This paper presents a novel object recognition algorithm that performs automatic dataset collecting and incremental model learning simultaneously. The goal of this work is to use the tremendous resources of the web to learn robust object category models for detecting and searching for objects in real-world cluttered scenes. Humans contiguously update the knowledge of objects when new examples are observed. Our framework emulates this human learning process by iteratively accumulating model knowledge and image examples. We adapt a non-parametric latent topic model and propose an incremental learning framework. Our algorithm is capable of automatically collecting much larger object category datasets for 22 randomly selected classes from the
Caltech 101
dataset. Furthermore, our system offers not only more images in each object category but also a robust object category model and meaningful image annotation. Our experiments show that OPTIMOL is capable of collecting image datasets that are superior to the well known manually collected object datasets
Caltech 101
and LabelMe.
In this study, a novel sandwiched electrochemiluminescence (ECL) immunosensor for the detection of carcinoembryonic antigen (CEA) was developed. The nanocomposite of polydopamine and Ag nanoparticles ...(PDA-AgNPs) was prepared by the redox reaction between Ag+ and dopamine. This nanocomposite not only provided an effective matrix for the immobilization of primary antibody (Ab1) but also enhanced the conductivity of the electrode. Carbon quantum dots (CQDs) were immobilized on the poly(ethylenimine) functionalized graphene oxide (PEI-GO) through amido-bond. Then Au nanoparticles were decorated on the CQDs modified PEI-GO matrix, and the resulted complex AuNPs/CQDs-PEI-GO was introduced to link secondary antibody (Ab2). The CQDs can be connected to the electrode surface through the combination of CEA with Ab1 and Ab2, and then the amplified electrochemiluminescence signal of CQDs was obtained with the synergistic effect of AgNPs, polydopamine, AuNPs and PEI-GO. Under the optimal conditions, the ECL intensity was proportional to the logarithm value of CEA concentration in the linear range from 5pgmL−1 to 500ngmL−1 with a detection limit of 1.67pgmL−1 for CEA detection. The immunosensor was applied for the CEA detection in real samples with satisfactory results. The proposed ECL immunosensor showed good performance with high sensitivity, specificity, reproducibility, stability and will be potential in clinical detection.
•The nanocomposite of polydopamine and Ag nanoparticles (PDA-AgNPs) provided an effective matrix for the immobilization of primary antibody (Ab1).•Carbon quantum dots (CQDs), the electrochemiluminescence material, were immobilized on the poly(ethylenimine) functionalized graphene oxide (PEI-GO) to link secondary antibody (Ab2).•The ECL signals of CQDs were greatly amplified under the synergistic effect of AgNPs, polydopamine, AuNPs and PEI-GO.•The proposed ECL immunosensor can be used for the detection of CEA in real human serum samples.
Image captioning is a challenging problem owing to the complexity in understanding the image content and diverse ways of describing it in natural language. Recent advances in deep neural networks ...have substantially improved the performance of this task. Most state-of-the-art approaches follow an encoder-decoder framework, which generates captions using a sequential recurrent prediction model. However, in this paper, we introduce a novel decision-making framework for image captioning. We utilize a policy network and a value network to collaboratively generate captions. The policy network serves as a local guidance by providing the confidence of predicting the next word according to the current state. Additionally, the value network serves as a global and lookahead guidance by evaluating all possible extensions of the current state. In essence, it adjusts the goal of predicting the correct words towards the goal of generating captions similar to the ground truth captions. We train both networks using an actor-critic reinforcement learning model, with a novel reward defined by visual-semantic embedding. Extensive experiments and analyses on the Microsoft COCO dataset show that the proposed framework outperforms state-of-the-art approaches across different evaluation metrics.
PDF
