The Kilo-Degree Survey (KiDS) is a multi-band imaging survey designed for cosmological studies from weak lensing and photometric redshifts. It uses the European Southern Observatory VLT Survey ...Telescope with its wide-field camera OmegaCAM. KiDS images are taken in four filters similar to the Sloan Digital Sky Survey ugri bands. The best seeing time is reserved for deep r-band observations. The median 5σ limiting AB magnitude is 24.9 and the median seeing is below 0.7 arcsec. Initial KiDS observations have concentrated on the Galaxy and Mass Assembly (GAMA) regions near the celestial equator, where extensive, highly complete redshift catalogues are available. A total of 109 survey tiles, 1 square degree each, form the basis of the first set of lensing analyses of halo properties of GAMA galaxies. Nine galaxies per square arcminute enter the lensing analysis, for an effective inverse shear variance of 69 arcmin−2. Accounting for the shape measurement weight, the median redshift of the sources is 0.53. KiDS data processing follows two parallel tracks, one optimized for weak lensing measurement and one for accurate matched-aperture photometry (for photometric redshifts). This technical paper describes the lensing and photometric redshift measurements (including a detailed description of the Gaussian aperture and photometry pipeline), summarizes the data quality and presents extensive tests for systematic errors that might affect the lensing analyses. We also provide first demonstrations of the suitability of the data for cosmological measurements, and describe our blinding procedure for preventing confirmation bias in the scientific analyses. The KiDS catalogues presented in this paper are released to the community through http://kids.strw.leidenuniv.nl.
Context. The Kilo-Degree Survey (KiDS) is an ongoing optical wide-field imaging survey with the OmegaCAM camera at the VLT Survey Telescope. It aims to image 1500 square degrees in four filters ...(ugri). The core science driver is mapping the large-scale matter distribution in the Universe, using weak lensing shear and photometric redshift measurements. Further science cases include galaxy evolution, Milky Way structure, detection of high-redshift clusters, and finding rare sources such as strong lenses and quasars. Aims. Here we present the third public data release and several associated data products, adding further area, homogenized photometric calibration, photometric redshifts and weak lensing shear measurements to the first two releases. Methods. A dedicated pipeline embedded in the Astro-WISE information system is used for the production of the main release. Modifications with respect to earlier releases are described in detail. Photometric redshifts have been derived using both Bayesian template fitting, and machine-learning techniques. For the weak lensing measurements, optimized procedures based on the THELI data reduction and lensfit shear measurement packages are used. Results. In this third data release an additional 292 new survey tiles (≈300 deg2) stacked ugri images are made available, accompanied by weight maps, masks, and source lists. The multi-band catalogue, including homogenized photometry and photometric redshifts, covers the combined DR1, DR2 and DR3 footprint of 440 survey tiles (44 deg2). Limiting magnitudes are typically 24.3, 25.1, 24.9, 23.8 (5σ in a 2′′ aperture) in ugri, respectively, and the typical r-band PSF size is less than 0.7′′. The photometric homogenization scheme ensures accurate colours and an absolute calibration stable to ≈2% for gri and ≈3% in u. Separately released for the combined area of all KiDS releases to date are a weak lensing shear catalogue and photometric redshifts based on two different machine-learning techniques.
Context. The Kilo-Degree Survey (KiDS) is an optical wide-field imaging survey carried out with the VLT Survey Telescope and the OmegaCAM camera. KiDS will image 1500 square degrees in four filters ...(ugri), and together with its near-infrared counterpart VIKING will produce deep photometry in nine bands. Designed for weak lensing shape and photometric redshift measurements, its core science driver is mapping the large-scale matter distribution in the Universe back to a redshift of ~0.5. Secondary science cases include galaxy evolution, Milky Way structure, and the detection of high-redshift clusters and quasars. Aims. KiDS is an ESO Public Survey and dedicated to serving the astronomical community with high-quality data products derived from the survey data. Public data releases, the first two of which are presented here, are crucial for enabling independent confirmation of the survey’s scientific value. The achieved data quality and initial scientific utilization are reviewed in order to validate the survey data. Methods. A dedicated pipeline and data management system based on Astro-WISE, combined with newly developed masking and source classification tools, is used for the production of the data products described here. Science projects based on these data products and preliminary results are outlined. Results. For 148 survey tiles (≈160 sq.deg.) stacked ugri images have been released, accompanied by weight maps, masks, source lists, and a multi-band source catalogue. Limiting magnitudes are typically 24.3, 25.1, 24.9, 23.8 (5σ in a 2′′ aperture) in ugri, respectively, and the typical r-band PSF size is less than 0.7′′. The photometry prior to global homogenization is stable at the ~2% (4%) level in gri (u) with some outliers due to non-photometric conditions, while the astrometry shows a typical 2D rms of 0.03′′. Early scientific results include the detection of nine high-z QSOs, fifteen candidate strong gravitational lenses, high-quality photometric redshifts and structural parameters for hundreds of thousands of galaxies.
Federated Learning (FL) is a machine learning technique that enables to collaboratively learn valuable information across devices or sites without moving the data. In FL, the model is trained and ...shared across decentralized locations where data are privately owned. After local training, model updates are sent back to a central server, thus enabling access to distributed data on a large scale while maintaining privacy, security, and data access rights. Although FL is a well-studied topic, existing frameworks are still at an early stage of development. They encounter challenges with respect to scalability, data security, aggregation methodologies, data provenance, and production readiness. In this paper, we propose a novel FL framework that supports functionalities like scalable processing with respect of data, devices, sites and collaborators, monitoring services, privacy, and support for use cases. Furthermore, we integrate multi party computation (MPC) within the FL setup, preventing reverse engineering attacks. The proposed framework has been evaluated in diverse use cases both in cross-device and cross-silo settings. In the former case, in-device FL is leveraged in the context of an AI-driven internet of medical things (IoMT) environment. We demonstrate the framework suitability for a range of AI techniques while benchmarking with conventional centralized training. Furthermore, we prove the feasibility of developing a user-friendly pipeline that enables an efficient implementation of FL in diverse clinical use cases.
The Kilo-Degree Survey (KiDS) is a multi-band imaging survey designed for cosmological studies from weak lensing and photometric redshifts. It uses the ESO VLT Survey Telescope with its wide-field ...camera OmegaCAM. KiDS images are taken in four filters similar to the SDSS ugri bands. The best-seeing time is reserved for deep r-band observations that reach a median 5-sigma limiting AB magnitude of 24.9 with a median seeing that is better than 0.7arcsec. Initial KiDS observations have concentrated on the GAMA regions near the celestial equator, where extensive, highly complete redshift catalogues are available. A total of 109 survey tiles, one square degree each, form the basis of the first set of lensing analyses, which focus on measurements of halo properties of GAMA galaxies. 9 galaxies per square arcminute enter the lensing analysis, for an effective inverse shear variance of 69 per square arcminute. Accounting for the shape measurement weight, the median redshift of the sources is 0.53. KiDS data processing follows two parallel tracks, one optimized for galaxy shape measurement (for weak lensing), and one for accurate matched-aperture photometry in four bands (for photometric redshifts). This technical paper describes how the lensing and photometric redshift catalogues have been produced (including an extensive description of the Gaussian Aperture and Photometry pipeline), summarizes the data quality, and presents extensive tests for systematic errors that might affect the lensing analyses. We also provide first demonstrations of the suitability of the data for cosmological measurements, and explain how the shear catalogues were blinded to prevent confirmation bias in the scientific analyses. The KiDS shear and photometric redshift catalogues, presented in this paper, are released to the community through http://kids.strw.leidenuniv.nl .
The Kilo-Degree Survey (KiDS) is an optical wide-field imaging survey carried out with the VLT Survey Telescope and the OmegaCAM camera. KiDS will image 1500 square degrees in four filters (ugri), ...and together with its near-infrared counterpart VIKING will produce deep photometry in nine bands. Designed for weak lensing shape and photometric redshift measurements, the core science driver of the survey is mapping the large-scale matter distribution in the Universe back to a redshift of ~0.5. Secondary science cases are manifold, covering topics such as galaxy evolution, Milky Way structure, and the detection of high-redshift clusters and quasars. KiDS is an ESO Public Survey and dedicated to serving the astronomical community with high-quality data products derived from the survey data, as well as with calibration data. Public data releases will be made on a yearly basis, the first two of which are presented here. For a total of 148 survey tiles (~160 sq.deg.) astrometrically and photometrically calibrated, coadded ugri images have been released, accompanied by weight maps, masks, source lists, and a multi-band source catalog. A dedicated pipeline and data management system based on the Astro-WISE software system, combined with newly developed masking and source classification software, is used for the data production of the data products described here. The achieved data quality and early science projects based on the data products in the first two data releases are reviewed in order to validate the survey data. Early scientific results include the detection of nine high-z QSOs, fifteen candidate strong gravitational lenses, high-quality photometric redshifts and galaxy structural parameters for hundreds of thousands of galaxies. (Abridged)