Pipelines are used at ESO to process both calibration data and science data
and to retrieve quality information.
There is a dedicated
pipeline for each VLT and VLTI instrument.
Find general information about ESO reduction pipelines here.
QC Garching creates master calibration data from all raw calibration data. The
raw data are stored in the ESO Archive and are public. They are
quality-checked and used for data reduction and for trending.
For selected instrument modes, we offer science-grade data products processed
with the pipelines.
There are two instances of the data reduction pipelines:
at the instrument workstation on Paranal, running in automatic mode,
at HQ Garching, run by the Quality Control Group in the optimized mode.
The automatic mode is used for quick look and for on-site quality
control. It processes all raw data sequentially, as they arrive from the
instrument. If calibration products ("master calibrations") are required for
processing science data, these are taken from a database with standard,
pre-manufactured calibration products. The automatic mode is not tuned to
obtain the best possible results.
The optimized mode is the mode, which uses all data of a night, including the
daytime calibrations. The calibration data are sorted and grouped according to
their dependencies. Master calibration data are created. Their quality is
checked.
The PIONIER pipeline is not distributed to the community by ESO but by the consortium. It can be found here .
QC runs the pipeline in Garching to verify the quality of the calibration data and the Health of the instrument. The pipeline run at QC Garching includes in addition the detector monitoring recipes which are used to monitor the instrument.