[ ESO ]

Workflow information system for QC

 

WISQ
   ALL*
Other ...
        [page auto-refreshes after 300 sec]   [stop | on]            [press Ctrl+Shift+R to enforce refresh of scores, dates and news]
Workflow information system for QC  
Last update: 2024-12-22T15:50:22 (UT)
  | now: 2024-12-23T05:37:34 (UT)  
same group: raw AB_proc AB_certif prod   packs
General news: NOTE: The Health Check and calChecker services are moved to qcFlow on an instrument by instrument basis. The current pages will not be updated any longer once the move has been finished.
Report news: IDPs included in red [qc@eso.org]

scores&comments | history: all data plotted here | plot tutorial ... | contact               [?]
*Date on this monitor changes at 21:00 UT
png: Information and research:
- png file - advanced studies: QC1 browser | QC1 plotter
Plot
?
Symb
?
Source
*
Average ? Thresholds ? N_
data
QC1
parameter
Data
downloads
Remarks
method value unit method value
1 QC1DB none   number none  252 N_AB_EXE all (full time range) All instruments.
1a. number of all processed detector ABs per month (after 2011-10: CALIB)
1 oQC1DB none   number none  133 N_AB_EXE all (full time range) 1b. same for IDPs (SCIENCE)
2 QC1DB MEAN 440 hours none  234 T_AB_EXE all (full time range) 2a. total AB processing time per month (hours)
2 oQC1DB none   hours none  133 T_AB_EXE all (full time range) 2b. same for IDPs

3 QC1DB none   number none  252 N_AB_EXE all (full time range) 3. processed detector ABs per month
a) ALL instruments
3 QC1DB none   number none  160 N_AB_EXE all (full time range) b) VIRCAM
3 QC1DB none   number none  152 N_AB_EXE all (full time range) c) OMEGACAM
4 QC1DB MEAN 296 hours none  182 T_QC_EXE all (full time range) 4a. total QC report execution time per month (hours)
4 oQC1DB none   hours none  133 T_QC_EXE all (full time range) 4b. same for IDPs
*Data sources: QC1DB: QC1 database; LOCAL: local data source
Plot 1
data source:monthly_stat
(QC1 database)
dataset:
(numbers below apply to this dataset)
N_AB_EXE
average:none
thresholds:none
N_data plotted:252
[click plot for closeup]
Plot 2
data source:monthly_stat
(QC1 database)
dataset:
(numbers below apply to this dataset)
T_AB_EXE
mean:440hours
thresholds:none 
N_data plotted:234
[click plot for closeup]
Plot 3
data source:monthly_stat
(QC1 database)
dataset:
(numbers below apply to this dataset)
N_AB_EXE
average:none
thresholds:none
N_data plotted:252
[click plot for closeup]
Plot 4
data source:monthly_stat
(QC1 database)
dataset:
(numbers below apply to this dataset)
T_QC_EXE
mean:296hours
thresholds:none 
N_data plotted:182
[click plot for closeup]
This plot

This plot visualizes the monthly statistics of executed detector ABs ('det.ABs'):
- number of all successfully processed ABs
(before XXLight: successful CAL+SCI; with XXLight: successful CAL only),
- total execution time for ABs in hours (pipeline processing),
- total QC report execution time in hours.

The label 'muc' marks the begin of dfos operations on the muc machines in 2013-04, with a significant gain in compute performance and corresponding drop of execution times.

We have added metrics for IDPs to plots #1, #3 and #4. The peaks refer to the (re)processing of the entire historical batch.

The det.AB number refers to jobs per detector and is higher by a factor MEF_FACTOR than the actual number of ABs as counted in the QC system and displayed in the AB certification plot. For reference, MEF_FACTOR=4 for CRIRES and HAWKI; 16 for VIRCAM; 32 for OCAM; 3 for KMOS; 24 for MUSE. This number measures the compute workload.

The numbers for AB_texec and QC_texec are the sum of execution times for all processed ABs (including the failed ones), without further correction for MEF_FACTOR.

Note: The latest data point in the current plot usually refers to a month which is not yet finished. Its value will therefore continue to increase until a new last month starts.  


General information

Click on any of the plots to see a close-up version.

The latest date is indicated on top of the plot.

If configured,

  • data points belonging to the latest date are specially marked
  • statistical averages are indicated by a solid line, and thresholds by broken lines
  • outliers are marked by a red asterisk. They are defined as data points outside the threshold lines
  • "aliens" (= data points outside the plot Y limits) are marked by a red arrow ( or )
  • you can download the data for each parameter set if the 'Data downloads' link shows up