An up-to-date, self-contained introduction to a state-of-the-art machine learning approach, Ensemble Methods: Foundations and Algorithms shows how these accurate methods are used in real-world tasks. ...It gives you the necessary groundwork to carry out further research in this evolving field.After presenting background and terminology, the book cover
Praise for the First Edition " . . . the book is a valuable addition to the literature in the field, serving as a much-needed guide for both clinicians and advanced students."-Zentralblatt MATH A new ...edition of the cutting-edge guide to diagnostic tests in medical research In recent years, a considerable amount of research has focused on evolving methods for designing and analyzing diagnostic accuracy studies. Statistical Methods in Diagnostic Medicine, Second Edition continues to provide a comprehensive approach to the topic, guiding readers through the necessary practices for understanding these studies and generalizing the results to patient populations. Following a basic introduction to measuring test accuracy and study design, the authors successfully define various measures of diagnostic accuracy, describe strategies for designing diagnostic accuracy studies, and present key statistical methods for estimating and comparing test accuracy. Topics new to the Second Edition include: Methods for tests designed to detect and locate lesions Recommendations for covariate-adjustment Methods for estimating and comparing predictive values and sample size calculations Correcting techniques for verification and imperfect standard biases Sample size calculation for multiple reader studies when pilot data are available Updated meta-analysis methods, now incorporating random effects Three case studies thoroughly showcase some of the questions and statistical issues that arise in diagnostic medicine, with all associated data provided in detailed appendices. A related web site features Fortran, SAS®, and R software packages so that readers can conduct their own analyses. Statistical Methods in Diagnostic Medicine, Second Edition is an excellent supplement for biostatistics courses at the graduate level. It also serves as a valuable reference for clinicians and researchers working in the fields of medicine, epidemiology, and biostatistics.
Abstract
Supervised learning techniques construct predictive models by learning from a large number of training examples, where each training example has a label indicating its ground-truth output. ...Though current techniques have achieved great success, it is noteworthy that in many tasks it is difficult to get strong supervision information like fully ground-truth labels due to the high cost of the data-labeling process. Thus, it is desirable for machine-learning techniques to work with weak supervision. This article reviews some research progress of weakly supervised learning, focusing on three typical types of weak supervision: incomplete supervision, where only a subset of training data is given with labels; inexact supervision, where the training data are given with only coarse-grained labels; and inaccurate supervision, where the given labels are not always ground-truth.
Full text
Available for:
IZUM, KILJ, NUK, PILJ, PNG, SAZU, UL, UM, UPUK
A Review on Multi-Label Learning Algorithms Zhang, Min-Ling; Zhou, Zhi-Hua
IEEE transactions on knowledge and data engineering,
08/2014, Volume:
26, Issue:
8
Journal Article
Peer reviewed
Multi-label learning studies the problem where each example is represented by a single instance while associated with a set of labels simultaneously. During the past decade, significant amount of ...progresses have been made toward this emerging machine learning paradigm. This paper aims to provide a timely review on this area with emphasis on state-of-the-art multi-label learning algorithms. Firstly, fundamentals on multi-label learning including formal definition and evaluation metrics are given. Secondly and primarily, eight representative multi-label learning algorithms are scrutinized under common notations with relevant analyses and discussions. Thirdly, several related learning settings are briefly summarized. As a conclusion, online resources and open research problems on multi-label learning are outlined for reference purposes.
Deep forest Zhou, Zhi-Hua; Feng, Ji
National science review,
01/2019, Volume:
6, Issue:
1
Journal Article
Peer reviewed
Open access
Abstract
Current deep-learning models are mostly built upon neural networks, i.e. multiple layers of parameterized differentiable non-linear modules that can be trained by backpropagation. In this ...paper, we explore the possibility of building deep models based on non-differentiable modules such as decision trees. After a discussion about the mystery behind deep neural networks, particularly by contrasting them with shallow neural networks and traditional machine-learning techniques such as decision trees and boosting machines, we conjecture that the success of deep neural networks owes much to three characteristics, i.e. layer-by-layer processing, in-model feature transformation and sufficient model complexity. On one hand, our conjecture may offer inspiration for theoretical understanding of deep learning; on the other hand, to verify the conjecture, we propose an approach that generates deep forest holding these characteristics. This is a decision-tree ensemble approach, with fewer hyper-parameters than deep neural networks, and its model complexity can be automatically determined in a data-dependent way. Experiments show that its performance is quite robust to hyper-parameter settings, such that in most cases, even across different data from different domains, it is able to achieve excellent performance by using the same default setting. This study opens the door to deep learning based on non-differentiable modules without gradient-based adjustment, and exhibits the possibility of constructing deep models without backpropagation.
Full text
Available for:
IZUM, KILJ, NUK, PILJ, PNG, SAZU, UL, UM, UPUK
It is well-known that exploiting label correlations is important to multi-label learning. Existing approaches either assume that the label correlations are global and shared by all instances; or that ...the label correlations are local and shared only by a data subset. In fact, in the real-world applications, both cases may occur that some label correlations are globally applicable and some are shared only in a local group of instances. Moreover, it is also a usual case that only partial labels are observed, which makes the exploitation of the label correlations much more difficult. That is, it is hard to estimate the label correlations when many labels are absent. In this paper, we propose a new multi-label approach GLOCAL dealing with both the full-label and the missing-label cases, exploiting global and local label correlations simultaneously, through learning a latent label representation and optimizing label manifolds. The extensive experimental studies validate the effectiveness of our approach on both full-label and missing-label data.
Performing CO
2
conversion in a cost-effective and environmentally benign manner would be promising and remains challenging due to its thermodynamic stability and kinetic inertness. Herein, we would ...like to summarise significant advances in organic synthesis using CO
2
with high catalytic efficiency and excellent selectivity towards the target product mainly during the last five years (2012-2016). Achieving an efficient and selective CO
2
conversion depends on the development of metal catalysts (especially functional metal complex catalysis) including main-group metal, typical transition metal and lanthanide series metal as well as organocatalysts
e.g.
N-heterocyclic carbenes, N-heterocyclic olefins, task-specific ionic liquids, superbases and frustrated Lewis pairs that are able to effectively activate CO
2
and/or the substrate on the basis of the mechanistic understanding at the molecular level. This review just covers typical catalytic transformation of CO
2
, for instance, carboxylation, amidation, hydrogenation, and representative green processes like solvent-less, halogen-free that use CO
2
as an ideal carbon-neutral source to prepare valuable compounds with improved atom economy and enhanced sustainability of chemical processes through green catalysis. In particular,
in situ
catalytic CO
2
conversion,
i.e.
the combination of carbon capture and subsequent conversion, a recent breakthrough in the CO
2
chemistry field, is also discussed.
The efficient and selective conversion of CO
2
as a sustainable C
1
resource into valuable chemicals and energy-related products through catalysis is reviewed.
Summary
By using the adaptive control approach, we solve the error feedback regulator problem for the one‐dimensional wave equation with a general harmonic disturbance anticollocated with control and ...with two types of disturbed measurements, ie, one collocated with control and the other anti‐collocated with control. Different from the classical error feedback regulator design, which is based on the internal mode principle, we give the adaptive servomechanism design for the system by making use of the measured tracking error (and its time derivative) and the estimation mechanism for the parameters of the disturbance and of the unknown reference. Constructing auxiliary systems and observer and applying the backstepping method for infinite‐dimensional system play important roles in the design. The control objective, which is to regulate the tracking error to zero and to keep the states bounded, is achieved.
Full text
Available for:
FZAB, GIS, IJS, KILJ, NLZOH, NUK, OILJ, SAZU, SBCE, SBMB, UL, UM, UPUK
PDF
