Help for calibration completeness monitor

close window | last update: July 22, 2015 | contact

The calChecker monitor is developed and maintained by QC Garching. It provides information about the calibration completeness and calibration quality.
Find general information about the process here.

 

 

  daytime calibs:   [daytime calibrations ongoing, started 13:33 UT]
DATE*:
[color if science data acquired]
2012-12-09
SM
11
report | NLT
2012-12-10
SM
87
report | NLT
2012-12-11

report | NLT 
2012-12-12
SM
23
report | NLT
2012-12-13

report | NLT 
2012-12-14
VM
217
report | NLT
  LOST?
[may require OB
grade review]
action required?
[if not green:
take these data types ...
Setup:

... for these setups]
r... Raw CAL displays:     [?]
raw raw raw raw raw raw        
P...
Product quality:     [?]
products products products products products products      

Dates with science data: highlighted in yellow, contain the SM and/or VM flag (total number of science files is displayed).

Dates without science data: grey background, no SM/VM flag.

'report': raw data report (created by QC)

'NLT': night log from nightlog tool (requires login to user portal, password-protected)

The last DATE column has a field on top, indicating the status of daytime calibrations (pending/ongoing/finished). This is relevant for the judgment of missing calibrations for that date: any MISS or NOK in case of "finished" is significant, while otherwise these calibrations are likely to still be in the calOBBuilder queue. Also, this field might be helpful to detect cases when a calibration queue is broken or has been interrupted.

The row labelled Raw CAL displays links to the raw file displays (screenshots). Only the last 7 days have this link. Screenshots for older data are removed. In rare cases this line is labelled "n/a" ("not available"), when an instruments delivers only raw files in bintable format for which screenshots make no sense.

The row labeled Product quality links to the QC-maintained product quality monitor (also called the "AB monitor" where AB stands for association block, the fundamental QC processing job).

The product quality monitor shows the current status of data processing at QC Garching, including quality scores (which are also used on the Health Check monitor) and QC reports. The AB monitor reflects the calibration quality, while the calChecker reflects calibration completeness. Processing of the calibrations by QCG is done automatically and within the hour unless there are data delivery delays.

The links labelled "Products quality" are marked products if the CALIBs for that date have already been certified by the QC group (to indicate to PSO that the product quality has been checked and potential issues have already been raised). Those nights which are not yet certified are marked products .

An exclamation mark ! products marks nights with data coming in unsupported modes. These data have no products and need a visual check by Paranal daytime astronomers.

The column "action required?" contains types of missing calibrations, and a link to the association rules used. The last Setup column lists the setup of missing calibrations. These two columns contain the necessary information about missing calibrations.

The column "LOST?" contains those types of missing calibrations which are missing and cannot be acquired anymore (see below). They are distinguished from the calibration issues since strictly speaking it is pointless to take them e.g. a night later. Rather the affected science OBs need to be reviewed and perhaps be downgraded. A classical example for LOST calibrations are photometric STD data for imaging modes, which need to be taken the same night as the science data.

  daytime calibs:   [daytime calibrations ongoing, started 13:33 UT]
    2013-12-09
SM
11
report | NLT
2013-12-10
SM
87
report | NLT
2013-12-11

report | NLT 
2013-12-12
SM
23
report | NLT
2013-12-13

report | NLT 
2013-12-14
VM
217
report | NLT
  LOST?
[may require OB
grade review]
action required?
[if not green:
take these data types ...
Setup:

... for these setups]
Data type (Mode): Setup:                  
SCIENCE_IMG I_BESSEL  
 
ok
 
 
LOST  STD all ok  
SCIENCE_MED IFU2_L881.7  
ok 
 
 
 

  all ok  
  Medusa1_L881.7 ok 
 
 
 
 
  nok
[not yet analyzed]
  FLAT | WAVE Medusa1_L881.7
  Medusa1_L543.1  
 
 
ok 
 
 ok
  all ok  
 
Argus_H651.5A
 
 
 
 
 
 ok
  all ok  

Data types are defined by mode and setup. Each science data type has one row, each date has one column. These two coordinates define a box which is evaluated by the tool as ok, nok or lost/miss:
ok available CALIB data are complete and all within the validity time range.
nok available CALIB data are complete but at least one CALIB file type is outdated. New measurement should be done asap. The corresponding CALIB file type is listed in the rightmost column.
miss CALIB data are incomplete, at least one CALIB file type is missing. New measurement should be done asap. Missing files are listed in the rightmost column.
LOST CALIB data are incomplete, a specific CALIB file type is missing which however cannot be measured again (under the same circumstances). The only action to be taken is a review of the science OB grade. LOST file types are listed in the corresponding column.

Whenever a "missing" calibration is indicated, this is a reminder for obtaining them as soon as possible. Otherwise the corresponding SCIENCE observation may be lost (graded 'C' or 'D').

Old issues. It might happen that an unsolved calibration issue is older than the standard analysis window of 7 days. Classical example is a twilight flat that requires certain conditions which might not be available for a week. Then, the issue (NOK or MISS; not: LOST!) is carried over and displayed for as long as the configured range of the calibration memory. That range is displayed in the right bottom corner. The date with the carried over issue is listed at the left part of the result table, with a slightly different lokup. It remains visible until either the issue is solved or the maximum date range has expired.

  daytime calibs: finished 09:28UT
DATE*:   [?]
[color if science data acquired]
old issue
2014-01-18
SM
49
report | NLT
2014-01-20
SM
84
report | NLT
2014-01-21
SM
115
report | NLT
2014-01-22
SM
86
report | NLT
2014-01-23
SM
127
report | NLT
2014-01-24

report | NLT
2014-01-25

report | NLT
2014-01-26
SM
113
report | NLT
LOST?
[may require OB
grade review]
Calibration action?     [?]
[take these data types ...
Setup:
... for these setups]
r... Raw CAL displays:     [?]
  raw raw raw raw raw raw        
P...
Product quality:     [?]
products products products products products products products products      
Data types: Setup:        
SCIENCE H_ALPHA_1_1  
 
 
 
 
 
 
nok
[daycals finished; problem not yet analyzed]
  STD | TWILIGHT H_ALPHA_1_1
NB_659_1_1  
ok
ok
 
 
 
 
 
  all ok  
g_SDSS_1_1  
ok
 
ok
analyzed: [1]
ok
 
 
nok
[daycals finished; problem not yet analyzed]
STD TWILIGHT g_SDSS_1_1
i_SDSS_1_1 nok
analyzed: [2]
ok
ok
LOST
analyzed: [3]
ok
analyzed: [4]
 
 
ok
STD TWILIGHT i_SDSS_1_1
r_SDSS_1_1 ok
ok
ok
ok
analyzed: [5]
ok
 
 
nok
[daycals finished; problem not yet analyzed]
STD TWILIGHT r_SDSS_1_1
u_SDSS_1_1  
 
 
 
ok
 
 
 
  all ok  

Analysis notes. Whenever possible, the QC scientist or the Paranal astronomer makes an attempt to analyze a situation with NOK, MISS or LOST. The analysis result is then displayed underneath the result table, as a separate table labeled "Analysis notes".

Detail pages. Click on any of the links in the result boxes, and see detailed results per DATE: every single SCIENCE file is listed with its OB ID, grade and comment, and the details of its associated calibrations, including the time delay and the calChecker flag. These detailed pages are intended to help with the analysis of problems. For instance, they tell you immediately that an OB has been graded C and therefore in principle does not need complete and valid calibrations.