Phase 3 - News and Changes

Please find below any news regarding the Phase 3 process and a record of the past evolution in reverse chronological order.

29 September 2014

Ultra-deep Ks-band imaging data of the UDS and GOODS-South fields released

The HAWK-I Ultra Deep Survey and GOODS Survey is a new ultra-deep near-IR imaging survey executed with Hawk-I at the VLT lead by A. Fontana as principal investigator. It was designed to cover the two CANDELS (http://candels.ucolick.org) extragalactic fields accessible from Paranal that do not have suitably-deep K-band images: a sub area of UDS and GOODS-South. It delivers the deepest, highest quality images ever collected in the K-band. Deep Y-band images in the UDS field have also been acquired. The UDS field is covered to a limit of Ks=27.3 (at 1 sigma) and the GOODS-South data reach slightly deeper/shallower limits (Ks=27.8).

Data are grouped in three distinct data collections: HUGS_GOODSS_K, HUGS_UDS_K and HUGS_UDS_Y. Images can be queried and downloaded from the ESO Science Archive Facility with the band-merged catalogues being accessible from ESO's dedicated catalogue facility query interface (www.eso.org/qi).

18 September 2014

New imaging data of the Public ESO Spectroscopic Survey of Transient Objects (PESSTO) released

PESSTO (Public ESO Spectroscopic Survey of Transient Objects) is a public spectroscopic survey that targets supernovae and optical transients brighter than 20.5m with the goal of classifying supernovae as close as possible to their explosion phase. Release version 1 contained more than 900 flux calibrated spectra for 298 distinct objects observed during the first year of the survey. Such spectra are now complemented with 234 reduced and calibrated near-infrared SOFI images for 22 transient objects. Images and spectra can be ​queried and downloaded from the ESO Science Archive Facility​​.

The PESSTO Data Release 2 is accompanied by a comprehensive ​description​​.

23/24 August 2014

Network maintenance affecting the ESO Science Archive Facility

Due to maintenance reasons, there may be a disruption of archive services on the weekend 23/24 August. Phase 3 file uploads could be affected. We apologize for any inconvenience this may cause.

15 July 2014

First Data Release of VVV Photometric Catalogues via the ESO Science Archive Facility

VVV belongs to the suite of six public surveys being conducted at ESO’s Visible and Infrared Survey Telescope for Astronomy (VISTA). The VISTA Variables in the Via Lactea Survey (VVV) is a wide area (562 sq.degrees), near-infrared, multi-epoch imaging survey of the Milky Way bulge and disk. The initial survey in the five broadband filters Z, Y, J, H, Ks is followed by extensive multi-epoch observations in the Ks band.

The first VVV data release, which is based on observations carried out until 1 October 2010, actually covers 404 square degrees of the Galactic disk and the bulge region and consists of 208 million sources (including duplicates). The previously announced release of astrometrically and photometrically calibrated mosaiced and co-added images, weight maps and associated single band source lists (DR1) is now complemented by three high-level photometric catalogues. The five-band photometric catalogue records object coordinates, fluxes, color indices as well as associated quality information, in total 95 parameters per object with a total data volume exceeding 81 GB. Multi-epoch Ks band photometry of these sources is provided in a separate catalogue consisting of more than 600 million individual measurements with a data volume over 36 GB. More than 6.7 million sources classified as variable are recorded in a third catalogue, which contains mean magnitude, photometric amplitudes and probability of variability with a data volume of 320 MB.

The data are fully searchable and accessible – the entire data set or user-defined subsets – from ESO’s catalogue facility query interface. Please use your personal ESO user portal credentials for login.

By accessing the VVV public catalogue releases, the ESO community benefits from joint efforts by ESO, the VVV public survey team, led by D. Minniti (P.I.), and their collaborators.

11 July 2014

GOODS/FORS2 Advanced Data Products migrated to the Phase 3 infrastructure

The GOODS/FORS2 advanced data products are now available via the query forms for Science Data Products of the ESO Archive.
The data were migrated to be compliant to the ESO standard regarding format and header keywords requirements, and ingested in the ESO Science Archive Facility via the Phase 3 infrastructure.
This migration enhanced the value of these products by adding useful information in the headers of the files. Furthermore the associated  catalogue has also become accessible via the Catalog facility query interface.
More details about the GOODS/FORS2 release can be found in the associated Phase 3 release description.

27 May 2014

Phase 3 Release Validator update version 2.1.2

The Phase 3 Release Validator is a java-based tool to be run locally on your system to validate the data before uploading them to ESO. The updated version 2.1.2 of the Phase 3 Release Validator, which is now available for download, offers a considerable improved performance in case of large updating releases.

09 May 2014

ESSENCE/FORS1 Advanced Data Products migrated to the Phase 3 infrastructure

The ESSENCE/FORS1 advanced data products are now available via the query forms for Science Data Products of the ESO Archive. The ESSENCE data were migrated to be compliant to the ESO standard regarding format and header keywords requirements, and ingested in the ESO Science Archive Facility via the Phase 3 infrastructure. This migration enhanced the value of these products by adding useful information in the headers of the FITS files.

Part of the migration was devoted to recover the processing provenance and the association with the raw data which was successful for almost all of the migrated files. More details about the ESSENCE release can be found in the associated Phase 3 release description.

09 April 2014

New photometric catalogue data resulting from the VISTA Magellanic Survey released

The VISTA Magellanic Survey (VMC) - one of the six public surveys being conducted at ESO’s Visible and Infrared Survey Telescope for Astronomy - aims at the determination of the spatially resolved star formation history and the three-dimensional geometry of the Magellanic system. The sensitivity is designed to reach sources below the oldest main-sequence turn off point of the stellar population and the multi-epochs to measure accurate Ks mean magnitudes for pulsating variable stars, e.g. RR Lyrae stars and Cepheids.

This data release, covering the survey tiles LMC 6_6 (including the 30 Doradus star forming region) and LMC 8_8 (including the South Ecliptic Pole region), ca. 3.5 deg2 in total, consists of the band-merged YJKs photometric catalogue based on the deep co-added survey images of at least three epochs in Y and J filters and twelve epochs in Ks filter, the multi-epoch photometry in each of the three bands and the catalogue of known Cepheids including also periods and modes of pulsation from optical-band data. The catalogues were extracted from the reduced images which have been released under VMC Data Release 2 in June 2013.

The new catalogue data are conjointly accessible from ESO’s catalogue facility query interface(*), each one accompanied by a comprehensive release description.

(*)Note: ESO User Portal authentication required.

04 April 2014

First data of the VISTA Deep Extragalactic Observations Survey in the VIDEO-ES1 field released

VIDEO is a deep near-infrared survey which targets ~12 square degrees over the ELAIS-S1, XMMLSS, and CDFS extragalactic fields. VIDEO belongs to the suite of six public surveys being conducted at ESO’s Visible and Infrared Survey Telescope for Astronomy (VISTA). This release (VIDEO-ES1 DR1) contains single-OB images in Z,H and Ks bands in the VIDEO-ES1 field along with the associated source lists taken between 06/10/2010 and 15/11/2011. Coverage of the full 3.0 square degrees of the ES1 field will be provided in future releases.

Images can be queried and downloaded from the ESO Science Archive Facility. The VIDEO-ES1 Data Release 1 is accompanied by a comprehensive description.

01 April 2014

First data of the VISTA Deep Extragalactic Observations Survey in the VIDEO-CDFS field released

VIDEO is a deep near-infrared survey which targets ~12 square degrees over the ELAIS-S1, XMMLSS, and CDFS extragalactic fields. VIDEO belongs to the suite of six public surveys being conducted at ESO’s Visible and Infrared Survey Telescope for Astronomy (VISTA). This release (VIDEO-CDFS DR1) contains single-OB images in Z,H and Ks bands in the VIDEO-CDFS1 field along with the associated source lists taken between 06/12/2011 and 29/12/2011. The whole coverage over the full 4.5 square degrees of the CDFS field will be provided in future releases.

Images can be queried and downloaded from the ESO Science Archive Facility. The VIDEO-CDFS Data Release 1 is accompanied by a comprehensive description.

21 March 2014

zCOSMOS Advanced Data Products migrated to the Phase 3 infrastructure

The zCOSMOS-bright advanced data products are now available via the query forms for Science Data Products of the ESO Archive. The zCOSMOS data were migrated to be compliant to the ESO standard regarding format and header keywords requirements, and ingested in the ESO Science Archive Facility via the Phase 3 infrastructure.

This migration enhanced the value of these products by adding useful information in the headers of the files. Furthermore the associated zCOSMOS-bright catalogue has also become accessible via the Catalog Facility query interface.

Part of the migration was devoted to recover the processing provenance and the association with the raw data which was successful for 97% of the migrated files. More details about the zCOSMOS release can be found in the associated Phase 3 release description.

20 January 2014

First release of PESSTO spectral data products

The Public ESO Spectroscopic Survey of Transient Objects (PESSTO) is one of the two on-going ESO public spectroscopic surveys. It aims to deliver detailed, high-quality, time series optical and near infrared spectroscopy of 150 optical transients covering the full range of parameter space that the current synoptic surveys now deliver: luminosity, host metallicity, explosion mechanisms. This will build a comprehensive understanding of the exotic, explosive Universe.

Data products resulting from the first release of PESSTO are now available via the dedicated Phase 3 query interface at the ESO Science Archive Facility. This data release consists of optical (NTT/EFOSC2) and NIR (NTT/SOFI) wavelength-calibrated 1-dimensional spectra of supernovae and optical transients brighter than 20.5mag, observed between April 2012 and April 2013 under ESO program ID 188.D-3003. The total number of data files submitted in this release is 909 1-d spectra and the corresponding 909 2-d spectra (downloadable as ancillary files associated to the 1-d products), of 298 unique targets. The total data volume of this release is 3 GB.

The 1d spectra are published using the tabular format following the established standard for ESO science data products. The PESSTO public survey data release is accompanied by a comprehensive description.

Instructions on how to read or display data in the ESO/SDP tabular data format can be found in the 1D spectrum data format help page.

08 January 2014

New data of the VISTA Deep Extragalactic Observations Survey in the VIDEO-XMM field released

VIDEO is a deep near-infrared survey which targets ~12 square degrees over the ELAIS-S1, XMMLSS, and ECDFS extragalactic fields. VIDEO belongs to the suite of six public surveys being conducted at ESO’s Visible and Infrared Survey Telescope for Astronomy (VISTA). The first public data release of the VIDEO programme via the ESO Science Archive Facility, the VIDEO-XMM Data Release Number 1, Date: 25.07.2011, contained 97 individual (i.e. single-OB) tile images in the VIDEO-XMM3 field and their associated single-band source lists. This release (VIDEO-XMM DR2) adds 156 single-OB images in the VIDEO-XMM fields 1, 2 and 3. DR2 is the first release that includes deep co-added images of the XMM3 field including the associated single-band source lists and the resulting deep photometric catalogue where the ZYJHKs data have been merged. To the 5σ limit of Ks~23.8, the Ks-selected catalogue contains 198178 sources over ~1.8 deg2.

Images can be queried and downloaded from the ESO Science Archive Facility while the band-merged catalogue data are accessible from ESO’s catalogue facility query interface. The VIDEO-XMM Data Release 2 is accompanied by a comprehensive description.

16 December 2013

First Data Release of the VIKING five-band photometric catalogue via the ESO Science Archive Facility

VIKING belongs to the suite of six public surveys being conducted at ESO’s Visible and Infrared Survey Telescope for Astronomy (VISTA). The VISTA Kilo-degree Infrared Galaxy Survey (VIKING) is a wide area (eventually ~1500 sq.degrees), intermediate-depth (5-sigma detection limit J~21 on Vega system) near-infrared imaging survey, in the five broadband filters Z, Y, J, H, Ks.

The first VIKING data release, which is based on observations carried out until mid February 2011, covers 226 square degrees in all five VIKING filters and consists of 14.7 million sources (including low-reliability single-band detections). The previously announced release of astrometrically and photometrically calibrated mosaiced and co-added images (each 1.5 square degrees), weight maps and associated single band source lists is now complemented by the VIKING five-band photometric catalogue recording object coordinates, fluxes, color indices, morphologic parameters as well as associated quality information, in total over 160 parameters per object with a total data volume over 9 gigabytes. The data are fully searchable and accessible – the entire data set or user-defined subsets – from ESO’s catalogue facility query interface. Please use your personal ESO user portal credentials for login.

By accessing the first VIKING public catalogue release, the ESO community benefits from joint efforts by ESO, the VIKING public survey team, led by A. Edge (P.I.), and their collaborators.

Release of pipeline-processed UVES data by the ESO Science Archive Facility

The collection of pipeline-processed high-resolution spectral data obtained with the Ultraviolet and Visual Echelle Spectrograph (UVES) has been significantly extended, now also including the observations that make use of the image slicers in order to optimize the observing efficiency during sub-optimal seeing conditions. In addition to the UVES data announced on 24 October 2013, over 10,000 individual spectra, which have been acquired in the period between 2003 and 2013, are now available from the ESO Science Archive Facility. The data consist of extracted wavelength- and, whenever possible, flux-calibrated 1-dimensional spectra in tabular format following the established ESO science data products standard.

The data products, being tagged "UVES_ECHELLE", can be queried and downloaded from the ESO Science Archive Facility. More details about the data can be found in the updated Phase 3 data release description for UVES data.

According to ESO’s data access policy, data products become publicly accessible once the proprietary period (usually one year) has expired; before that date, access to the data products is restricted to the P.I. of the observing programme and her/his collaborators.

18 November 2013

First Release of Gaia-ESO Spectroscopic Public Survey Data

Data products resulting from the first release of the Gaia-ESO Public Spectroscopic Survey are now available via the dedicated Phase 3 query interface at the ESO Science Archive Facility.

This data release consists of wavelength calibrated 1-dimensional spectra of point-like sources in tabular format following the established standard for ESO science data products, and obtained with FLAMES from 31.12.2011 to 30.06.2012 under ESO program ID 188.B-3002. The total number of data files submitted in this release is 5654 comprising spectra of 3834 unique targets. The total data volume of this data release is 1.3 GB.

The Gaia-ESO public survey data release is accompanied by a comprehensive description. Instructions on how to read or display data in the ESO/SDP tabular data format can be found in the 1D spectrum data format help page.

First Release of VST Public Survey ATLAS Imaging Data

Data products resulting from the first release of the ESO/VST Public Survey ATLAS are now available via the dedicated Phase 3 query interface at the ESO Science Archive Facility.

This data release consists of the stacked reduced images and associated source lists taken from the start of observations in August 2011, through to end September 2012 under ESO program ID 177.A-3011. The imaging data comprises the combination of the two individual pawprint images which goes to make an ATLAS stacked pawprint in each field. The passbands covered are the SDSS u,g,r,i,z bands reaching approximately the same depth (r~22) as the SDSS survey in the Northern Hemisphere. The data release comprises a total of 32031 data files occupying ~3TB in its default Rice compression. The total area covered is ~1000 deg2.

The ATLAS public survey data release is accompanied by a comprehensive description.

24 October 2013

Release of UVES Echelle Science Data Products

The ESO archive now provides access to reduced scientific data obtained with the UVES spectrograph mounted on the VLT via the Phase 3 system. More than 75000 spectra of point-like sources obtained in "ECHELLE mode" from the beginning of 2000 until 2013 are now published. The data consist of extracted wavelength- and, whenever possible, flux-calibrated 1-dimensional spectra in tabular format following the established standard for ESO science data products. The UVES data collection will grow with time and includes the current stream of UVES data as they are acquired at the observatory, with the reduced products becoming available in monthly release cycles as soon as they are processed.

The data products, being tagged "UVES_ECHELLE", can be queried and downloaded using the Phase 3 query form dedicated to spectral data, or from the generic query form that provides access to all Phase 3 data but is lacking the fields specific to spectral data.

More details about the data can be found in the associated Phase 3 data release description for UVES data.

16 September 2013

Upgrade of the Phase 3 system, release validator version 2.0.0

The Phase 3 system has been upgraded to support the publication of new data products, particularly data to be processed by ESO in the course of data flow operations, so-called internal data products (IDPs). The upgrade includes the following general improvements.

  • In order to catch problems earlier in the process, the integrity of the processing provenance information provided in the products is verified after data submission to ESO (i.e. when the release has been closed);
  • The Phase 3 system now fully supports recording the processing provenance of data products within one dedicated FITS binary table extension (cf. ESO SDP Standard, Issue 5, Sect. 2.4.2, for details);
  • Performance improvements and bugs fixes

Please upgrade to the new version of the Phase 3 release validator (v2.0.0) if you downloaded the Phase 3 release validator before.

20 August 2013

First Data Release of VST Public Survey VPHAS+ Imaging Data

Data products resulting from the first release of the ESO/VST Public Survey VPHAS+ are now available via the dedicated Phase 3 query interface at the ESO Science Archive Facility.

This data release covers the first 9 months of data-taking in which a tenth of the survey footprint was observed to desired quality. These first pointings have favoured the Galactic equator and some well-known open clusters of interest to the Gaia-ESO Survey. Reduced images and unstacked single-band source lists are provided. The total data volume of this data release is 749 GB.

The VPHAS+ public survey data release is accompanied by a comprehensive description.

15 July 2013

First Data Release from the MATISSE/OCA-ESO Project (AMBRE)

Stellar radial velocities, atmospheric parameters (effective temperature, surface gravity, mean metallicity [M/H]) and enrichment in alpha-elements ([alpha/Fe]) resulting from the automatic analysis of 21551 FEROS spectra from the ESO data archive with the MATISSE algorithm have been released. Go to the ESO Catalogue Facility(*) for data download and further information.

(*) Note: requires authentication through the ESO User Portal.

11 July 2013

First Release of VST Public Survey KiDS Imaging Data

Data products resulting from the first release of the ESO/VST Public Survey KiDS are now available via the dedicated Phase 3 query interface at the ESO Science Archive Facility.

This data release consists of the first 50 “tiles” of KiDS, each observed in all four filters (u,g,r,i), during the first year of regular operations (15 October 2011 to 31 September 2012) and during Early Science Time (13 August to 15 October 2011). A total of 800 files is included in this data release. The release consists of astrometrically and photometrically calibrated mosaiced and coadded images (each 1.0 deg²), weight maps, FLAG mask images and associated single band source lists in the different bands of the survey. The total data volume of this data release is 702 GB.

The KiDS public survey data release is accompanied by a comprehensive description.

Deep HAWK-I J and Ks imaging of the X-­ray luminous galaxy cluster XMMU J2235.3-2557

Data products resulting from ESO programme ID 60.A-­9284(H) as part of the first HAWK-­I science verification  are now available via the dedicated Phase 3 query interface at the ESO Science Archive Facility.

This data release consists of a mosaic of four pointings in two filters J and Ks, with the center of the X-­ray luminous galaxy cluster XMMU J2235.3-­2557 imaged in the four extreme corners of the HAWK-I detector mosaic. The deep image covers 13' by 13' on the sky with a pixel scale of 0.1065''. The image quality varies from 0.3'' to 0.7'' depending on filter and location.

The 60.A-­9284(H) data release is accompanied by a comprehensive description.

28 June 2013

Second Release of ESO/VISTA Public Survey Imaging Data

New data products resulting from the ESO/VISTA public surveys are now available via the dedicated Phase 3 query interface at the ESO Science Archive Facility. The current release of data from the VVV, VHS, VIKING, and VMC surveys (6.2 TB) covers mostly the period from October 2010 to September 2011 and consists of astrometrically and photometrically calibrated mosaiced and coadded images (each 1.5 deg²), weight maps and associated single band source lists in the different bands of each survey.

The new data largely complement the first release of VISTA public survey data products from 2011 adding up to 12 TB of (compressed) imaging data. Each public survey data release is accompanied by a comprehensive description.

14 May 2013

Phase 3 validator is ready to verify data submissions from spectroscopic surveys

The configuration of the Phase 3 validator has been updated and is now ready to be used for the verification of 1D spectra and generic images. No user action is needed to activate the new configuration. The Java code itself (validator.jar) remains unchanged. Next time validator.jar is launched, the updated configuration will be taken into account automatically.

Revised version of the Frequently Asked Questions

A revised version of the Questions and Answers is available, with a more detailed description of the metadata for the characterisation of 1D spectra and support for the "ANCILLARY.2DSPECTRUM" and "ANCILLARY.IMAGE" data formats.

Revised version of the Phase 3 policies

A revised version of the Phase 3 policies has been published, which now include specific information on VST, spectroscopic surveys and catalogue information, in addition to VISTA public survey policies.

14 March 2013

Phase 3 validator supports the "ANCILLARY.MASK" data format.

The configuration of the Phase 3 validator has been updated now including support for the "ANCILLARY.MASK" data format, which allows to describe the data quality of image arrays. Next time validator.jar is launched, the updated configuration will be taken into account automatically.

26 February 2013

Phase 3 validator is ready to verify VST OmegaCAM DR1 data.

The Phase 3 validator has been reconfigured and is now ready to be used for the verification of the VST OmegaCAM DR1 data.

No user action is needed to activate the new configuration. Next time validator.jar is launched, the updated configuration will be taken into account automatically. The Java code itself (validator.jar) remains unchanged.

11 January 2013

Phase 3 data format standard for OmegaCAM data products available.

To support the VST Public Surveys in their Phase 3 preparations the format standard for data products to be submitted via Phase 3 has been expanded and now includes OmegaCAM data products (Issue 5, Date 11/01/2013).

15 October 2012

Phase 3 data format standard for spectroscopic data available.

To support ESO spectroscopic surveys in their Phase 3 preparations the format standard for data products to be submitted via Phase 3 has been expanded and now includes spectroscopic data, i.e. extracted, calibrated, and fully characterized one-dimensional spectra.

The new ESO Science Data Products Standard (Issue 4, Date 15/10/2012) is based on the standard definitions, which were previously published in the External Data Products Standard, Issue 3 (25/05/2012). Note that the data format standard for VISTA public survey products (images and catalogues) remains unchanged, meaning that issue 3 still may be used for the preparation of these data.

As the scope of the new standard was enlarged to science data products in general, the document title has been adjusted accordingly. External data providers are not affected by this modification.

ESO Science Data Products Standard (Issue 4, Date 15/10/2012)
Please consult the CHANGE RECORD on p.2 for further details.

02 July 2012

Phase 3 Validator is ready to verify VISTA DR2 data.

DR2 images and source lists require a few modifications with respect to DR1 (see below). To this end the Phase 3 validator has been reconfigured and is now ready to be used for the verification of the VISTA DR2 data.

No user action is needed to activate the new configuration. Next time validator.jar is launched, the updated configuration will be taken into account automatically. The Java code itself (validator.jar) remains unchanged.

Here is a brief summary of changes to the data requirements with respect to DR1:

  1. PROV keys were recommended for image data products (tile, pawprint etc.) submitted in 2011. The upgrade of the Phase 3 infrastructure that took place in May 2012 entails the requirement saying that processing provenance is compulsory metadata for Phase 3 data products delivered thereafter. Now the validator also checks the existence of the PROV keyword for VISTA tiles and pawprints.
  2. RA, DEC keywords are required to point to the actual center of the image. For tiles RA/DEC should be set to the image centre (based on the WCS) instead of the previously tolerated telescope pointing of the first pawprint /offset position. Alternatively, the tile coordinates as defined by SADT can be copied (once converted to decimal degree format).
  3. PRODCATG tokens are upper case, eg. SCIENCE.IMAGE. Although, the previous lower case format is still accepted for DR2, it is recommended to change the software in view to future releases.

Pls. see also: ESO External Data Products Standard (Issue 3, Date 22/05/2012), CHANGE RECORD on p.2. The validation of VISTA DR1 catalogue data products is unaffected by this update.

12 June 2012

Phase 3 FTP server: SSL/TLS encryption requirement dropped.

As of 12 June 2012 any standard FTP client can be used to transfer Phase 3 data including the clients previously suggested like lftp and FileZilla. The requirement to use the SSL/TLS encryption layer for connections to the Phase 3 FTP server at ESO has been dropped. phase3ftp.eso.org now accepts plain FTP connections (port 21) whereas the support for FTP over TLS has been removed.

Normally, the change is fully transparent to the user. If you have previously saved the details of the connection to phase3ftp.eso.org using FileZilla's site manager for instance, you may need to update your setting. In this case encryption needs to be disabled by selecting "Use plain FTP".

25 May 2012

Adding support for catalogue data submission with improved validation of data products

This is a major upgrade of the Phase 3 Infrastructure that entails the following changes:

10 March 2011

Initial roll-out of the Phase 3 infrastructure

Phase 3 operations started supporting the validation, transfer and publication of the first data products from ESO/VISTA public surveys.

30 November 2010

Public Surveys Phase 3 Workshop, Garching

Click here to find workshop programme, list of participants and slides of presentations.