QC documentation system: QC procedure QCsinfo_dark.py for SINFONI

This documentation is intended both for QC scientists and SciOps astronomers (who may want to ignore the technical information displayed in grey).
 
HOME
 
CRIRES
FORS1
FORS2
KMOS
NACO
 
GIRAFFE
UVES
XSHOOTER
 
ISAAC
SPHERE
VIMOS
VISIR
 
HAWKI
MUSE
SINFONI
 
AMBER
MIDI
PIONIER
 
OMEGACAM
VIRCAM
[best viewing with style sheets and javascript enabled]
QCsinfo_dark.py QCsinfo_flat.py QCsinfo_wave.py
QCsinfo_dist.py QCsinfo_line.py QCsinfo_pupil.py
QCsinfo_hcao.py QCsinfo_std.py QCsinfo_psf.py
QCsinfo_sci.py
 
bottom  plots   |   contact
NAME QCsinfo_dark.py
VERSION 1.0 -- 2006-06-15 fill template by handbook
1.1 -- 2006-07-07 certified
2.0 -- 2009.05.05 completely re-written in Python with added QC functions and images
SYNTAX PYTHON
CALL measureQuality
from $DFS_PRODUCT/DARK/$DATE:
 QCsinfo_dark.py -a $AB_name -i $level_of_interaction: 0-2
INSTRUMENT SINFONI
RAWTYPE DARK
PURPOSE a) calculates post-pipeline FPN and odd/even column effect in slitlet #25 (OES) QC1 parameters
b) generates QC report
c) writes QC1 parameters into local list
PROCINPUT No input is required:
a) $DATE is now read from the input AB
b) primary file is set in QCsinfo_dark.py and is the PRO.CATG=MASTER_DARK product with the _0000.fits extension.
c) raw frames are implicitly read from the AB.
d) reference MASTER_DARK and BP_MAP_HP are found and read from $DFO_QC_DIR/references/DARK.
QC1TABLE trending | table(s) in QC1 database:
sinfoni_dark
TRENDPLOT trending | HealthCheck plot(s) associated to this procedure:
trend_report_DARK_300_HC.html
QC1PAGE trending | associated documentation:
dark_QC1.html
QC1PLOTS
top

dark1.png
display MASTER_DARK on RealTimeDisplay
dark2.png
display BP_MAP_HP (hot pixel map) on RealTime Display
dark3.png
left: Image of current master dark. The plot scale is set to -1.0 sigma to 2.0 sigma (sigma is computed from a Gaussian fit to the histogram of the master dark).
center: Difference image of the reference master dark - current master dark (same DIT). The plot scale is set to -1.0 sigma to 4.0 sigma (sigma is computed as above).
right: Plot of the hot pixels from the current master dark (shown in blue) and the reference master dark (red).

dark4.png
UL: The mean (collapsed) columns of the current master dark (blue) and the reference master dark (red).
UC: The mean (collapsed) rows of the current master dark (blue) and the reference master dark (red).
UR: Logarithmic histograms of the current master dark (blue), the reference master dark (red), and the difference between the two (black).
LL: The difference between the mean (collapsed) columns of the reference master dark - current master dark.
LC: The difference between the mean (collapsed) rows of the reference master dark - current master dark.
LR: Logarithmic histograms of the difference of the raw dark frames. Second raw minus first raw (purple), third raw minus second raw (turquois).
QC1PARAM QC1 parameters written into QC1 table(sinfoni_dark) 
SOURCE(header/script)       DBNAME                 value          description

 QC.DARKMED.AVE          qc_darkmed_ave           20.207021    Average of raw darks medians
 QC.DARKMED.STDEV        qc_darkmed_stdev          1.741316    STDEV of raw darks medians
 QC.RONRMS               qc_ronrms               441.092956    RMS on Read Out Noise
 QC.DARKFPN              qc_dark_fpn               2.53823     Fixed Pattern Noise of combined frames
 QC.RON1                 qc_ron1                   3.517257    Read Out Noise from first raw frame pair
 QC.RON2                 qc_ron2                   3.524859    Read Out Noise from second raw frame pair
 QC.BP-MAP.METHOD        qc_bpm_method             Normal      bad pixel map method (here hot pixel map)
 QC.BP-MAP.NBADPIX       qc_bpm_nbadpix          200           number of hot pixels 
 QCsinfo_dark.py         qc_oes1                   0.0234      oddeven column stripe of first raw frame 
 QCsinfo_dark.py         qc_oes2                   0.0234      oddeven column stripe of second raw frame 
 QCsinfo_dark.py         qc_oes3                   0.0234      oddeven column stripe of third raw frame 
 QCsinfo_dark.py         qc_gaf_fpn                2.543       Fixed Pattern Noise of combined frames
 QCsinfo_dark.py         qc_slitlet_ratio          0.25        Dark frame persistence check: Ratio of median value of (slit17/slit32) - 1.0
ALGORITHM Description of algorithms:
qc_darkmed_ave : Average of (3) raw darks medians
qc_darkmed_stdev : STDEV of (3) raw darks medians
qc_ronrms : RMS on Read Out Noise
qc_dark_fpn : Use the window of the MASTER_DARK product frame specified by recipe command line parameters dark-qc_fpn_xmin/xmax/ymin/ymax (default is the whole chip). Take dark-qc_fpn_nsamp (default dark-qc_fpn_nsamp = 100) randomly distributed samples of (2 hsize +1)*(2 hsize +1) (default hsize = 4) sample size from MASTER_DARK. Take median of all sample stdev. This is the isaac RON algorithm applied to a master dark to get the fixed pattern noise.
qc_ron1 : Apply the formulae of DARKFPN to the difference of the first two consecutive raw DARK frames. Convert to NDIT=1 and single raw frame (factor of sqrt(2)).
qc_ron2 As RON1 but for second pair of raw frames.
qc_bpm_method: Bad pixel map method
qc_bpm_nbadpix: All pixels above kappa * sigma, where kappa is --bp_noise-thresh_sigma_fct (default = 10)
qc_oes1, (not calculated by pipeline): Of the first dark raw frame, calculate the median of all odd columns and all even columns for slitlet #25 only and derive stdev. This parameter monitors sporadic occurence of odd-even signal in slitlet #25
qc_oes2, not calculated by pipeline): As qc_oes1, but for second raw frame
qc_oes3, (not calculated by pipeline): As qc_oes1, but for third raw frame
qc_gaf_fpn, (not calculated by pipeline) generate histogram of MASTER_DARK and fit Normal distribution, read stdev.
CERTIF Quality diminishing features (not under control, but tolerated) :
- slitlet #25 (the #31th slitlet counted from left) might contain additional oddeven signal
- random hot/cold pixels in slitlet #31 (the #18th counted from left)
Reasons for rejection:
- persistence due to previous exposures (objects or standard stars, typically) with high counts (generally about 10,000 ADU).
See also SINFONI problems page.
COMMENTS
top [2015-10-30T08:20:36]         created by qcDocu v1.1.2, a tqs tool