QC documentation system: QC procedure qc_RESET for VIRCAM

This documentation is intended both for QC scientists and SciOps astronomers (who may want to ignore the technical information displayed in grey).
 
HOME
 
CRIRES
FORS1
FORS2
KMOS
NACO
 
GIRAFFE
UVES
XSHOOTER
 
ISAAC
SPHERE
VIMOS
VISIR
 
HAWKI
MUSE
SINFONI
 
AMBER
GRAVITY
MIDI
PIONIER
 
ESPRESSO
 
OMEGACAM
VIRCAM
[best viewing with style sheets and javascript enabled]
qc_RESET qc_GAIN qc_LINE qc_CURRENT
qc_DARK qc_DOME qc_TWIL qc_STD
 
bottom  plots   |   contact
NAME qc_RESET.sh
VERSION 1.0 -- 2006-10-11
2.0 -- 2008-06-10
2.2 -- 2001-12-15, reference reset frame read from AB
3.0 -- 2010-01-27, docu updated for start of operations
3.1 -- 2017-08-30, docu updated
SYNTAX SHELL
CALL called by processQC
from $DFS_PRODUCT/RESET/$DATE:
CALL_SYNTAX RESET 0000.fits &&qc_RESET -a $AB -u vircam -e 0 -level 3 2\>\&1 \> $DFS_LOG/$AB.qclog&&
INSTRUMENT VIRCAM
RAWTYPE RESET
PURPOSE quality control script for VIRCAM RESET product frames
-level 0 : Reads QC parameters from product fits headers and writes them into the QC1 DB.
-level 1 : Fits a Gaussian to the histogram of the product to obtain robust median and rms.
-level 2 : Generates a QC graphical report.
-level 3 : Generates a hot pixel map,
a cold pixel map, a deviant pixel map, and a deviant product.
level 3 includes all steps of level 2, level {n} includes all steps of level {n-1}. This shell script calls a number of python scripts.
PROCINPUT There are three command line paramaters:
-a {AB}
-e {extensions}
-level {processing category}
use -e -1 for final QC processing requirering all detectors (equivalent to joinAB)
use -e 0 to process all extension sequentially (1..16) and thereafter the QC that requires all extension
This means using -e 0 is the same as calling one after the other with -e 1 .. -e 16 and thereafter one call with -e -1
a) -e 1..16 -level 0 : for an individual extension do : writeQC
b) -e 1..16 -level 1 : for an individual extension do : writeQC + histogram fit
c) -e 1..16 -level 2 : for an individual extension do : writeQC + histogram fit + QC report
d) -e 1..16 -level 3 : for an individual extension do : writeQC + histogram fit + QC report + extras
where extras are the number of hot pixels, the number of cold pixel and th the number of deviant pixel
e) -e -1 -level 0 : writeQC -m AVERAGE
f) -e -1 -level 1 : writeQC -m AVERAGE
g) -e -1 -level 2 : writeQC -m AVERAGE
h) -e -1 -level 3 : writeQC -m AVERAGE + extras
where extras are : generate a hot a cold and a deviant pixel map as fits product
Reference MASTER_BIAS and DIFFIMG_BIAS are implicitely read from the AB.
QC1TABLE trending | table(s) in QC1 database:
vircam_reset
TRENDPLOT trending | HealthCheck plot(s) associated to this procedure:
trend_report_RESETMED_AVG_HC.html | trend_report_RESETRMS_AVG_HC.html | trend_report_RESETDIFFRMS_AVG_HC.html
QC1PAGE trending | associated documentation:
qc_VC_reset.html
QC1PLOTS
top

masterreset.png
master bias product, snapshot from SkyCat
differencereset.png
difference bias product, snapshot from SkyCat
resetdeviant.png
standard deviation product based on 5 raw frames, snapshot from SkyCat
reset_qcreport_0.png
QC report for individual detector
UL: cross sections of the MASTER_BIAS
UC: cross section of the MASTER_BIAS
UR: histogram and fit of the MASTER_BIAS
LL: cross section of the DIFFIMG_BIAS
LC: cross section of the DIFFIMG_BIAS
LR: image of the DIFFIMG_BIAS
QC1PARAM QC1 parameters generated by pipeline and written into QC1 table:
NameInHeader, DBNAME , typical value, description:
QC.RESETMED qc_resetmed (pipeline)
QC.RESETRMS qc_resetrms (pipeline)
QC.RESETDIFF_MED qc_resetdiff_med (pipeline)
QC.RESETDIFF_RMS qc_resetdiff_rms (pipeline)
QC1 parameters generated by qc_RESET and written into QC1 table:
DBNAME , typical value, description:
qc_post_man , dark median from histogram fit (QC script)
qc_post_mdm , dark stddev from histogram fit (QC script)
qc_num_hp , number of cold pixel (QC script)
qc_num_cp , number of cold pixel (QC script)
qc_num_dp , number of deviant pixel (QC script)
qc_dev_mean , mean of all pixel deviations (QC script)
qc_dev_std , stdev of all pixel deviations (QC script)
qc_ron12 , RON from (raw2 minus raw1) (pipeline)
qc_ron23 , RON from (raw3 minus raw2) (pipeline)
qc_ron34 , RON from (raw4 minus raw3) (pipeline)
qc_ron45 , RON from (raw5 minus raw4) (pipeline)
ALGORITHM Description of algorithms:
qc_resetmed, see pipeline manual
qc_resetrms, see pipeline manual
qc_postman, fit MASTER_BIAS density histogram by Gaussian, get mu
qc_postmdm, fit MASTER_BIAS density histogram by Gaussian, get sigma
qc_num_hp, qc_num_cp, qc_num_dp, number of hot cold and deviant pixel
qc_dev_mean, fit DEVIANT product density histogram by Gaussian, get mu
qc_dev_std, fit DEVIANT product density histogram by Gaussian, get sigma
qc_ron12, qc_ron23, qc_ron34, qc_ron45, read noise from consecutive raw frames
CERTIF As a technical health check, all reset products are accepted
COMMENTS The RESETDIFF QC parameters depend on the associated REFERENCE_BIAS calibration product. RESET, BIAS are dark frames in uncorrelated read mode with MINDIT (reset-read) The reset levels show a long-term
top [2022-02-28T08:09:41]         created by qcDocu v1.1.2, a tqs tool