[ ESO ]

Workflow information system for QC

 

WISQ
   GIRAFFE*
Other ...
        [page auto-refreshes after 300 sec]   [stop | on]            [press Ctrl+Shift+R to enforce refresh of scores, dates and news]
Workflow information system for QC  
Last update: 2024-11-04T15:50:21 (UT)
  | now: 2024-11-05T00:22:02 (UT)  
same group: raw AB_proc AB_certif prod   packs
General news: NOTE: The Health Check and calChecker services are moved to qcFlow on an instrument by instrument basis. The current pages will not be updated any longer once the move has been finished.
Report news: IDP streams incl. STACK and COSMIC (2019) included [qc@eso.org]

scores&comments | history: all data plotted here | plot tutorial ... | contact               [?]
*Date on this monitor changes at 21:00 UT
png: Information and research:
- png file - advanced studies: QC1 browser | QC1 plotter
Plot
?
Symb
?
Source
*
Average ? Thresholds ? N_
data
QC1
parameter
Data
downloads
Remarks
method value unit method value
1 QC1DB MEAN 450 number none  239 N_AB_EXE all (full time range) GIRAFFE
1a. number of all executed det.ABs per month (after 2011-10: CALIB)
1 oQC1DB none   number none  93 N_AB_EXE all (full time range) 1b. all executed ABs for IDPs (SCIENCE) per month
2 QC1DB MEAN 5.42 hours none  239 T_AB_EXE all (full time range) 2a. total AB processing time per month (hours)
2 oQC1DB none   hours none  93 T_AB_EXE all (full time range) 2b. same for IDPs
4 QC1DB MEAN 1.86 hours none  175 T_QC_EXE all (full time range) 3a. total QC report execution time per month (hours)
4 oQC1DB none   hours none  93 T_QC_EXE all (full time range) 3b. same for IDPs
*Data sources: QC1DB: QC1 database; LOCAL: local data source
Plot 1
data source:monthly_stat
(QC1 database)
dataset:
(numbers below apply to this dataset)
N_AB_EXE
mean:450number
thresholds:none 
N_data plotted:239
[click plot for closeup]
Plot 2
data source:monthly_stat
(QC1 database)
dataset:
(numbers below apply to this dataset)
T_AB_EXE
mean:5.42hours
thresholds:none 
N_data plotted:239
[click plot for closeup]
Plot 4
data source:monthly_stat
(QC1 database)
dataset:
(numbers below apply to this dataset)
T_QC_EXE
mean:1.86hours
thresholds:none 
N_data plotted:175
[click plot for closeup]
This plot

This plot visualizes the monthly statistics of executed detector ABs ('det.ABs'):
- number of all successfully processed ABs
(before XXLight: successful CAL+SCI; with XXLight: successful CAL only),
- total execution time for ABs in hours (pipeline processing),
- total QC report execution time in hours.

The significant drop in execution times in 2013-04 is caused by the migration to the muc machines, with a significant gain in compute performance.

If applicable we have added metrics for IDPs. The initial peak refers to the (re)processing of the entire historical batch.

The det.AB number refers to jobs per detector and is higher by a factor MEF_FACTOR than the actual number of ABs as counted in the QC system and displayed in the AB certification plot. For reference, MEF_FACTOR=4 for CRIRES and HAWKI; 16 for VIRCAM; 32 for OCAM; 3 for KMOS; 24 for MUSE. This number measures the compute workload.

The numbers for AB_texec and QC_texec are the sum of execution times for all processed ABs (including the failed ones), without further correction for MEF_FACTOR.

Note: The latest data point in the current plot usually refers to a month which is not yet finished. Its value will therefore continue to increase until a new last month starts.  


General information

Click on any of the plots to see a close-up version.

The latest date is indicated on top of the plot.

If configured,

  • data points belonging to the latest date are specially marked
  • statistical averages are indicated by a solid line, and thresholds by broken lines
  • outliers are marked by a red asterisk. They are defined as data points outside the threshold lines
  • "aliens" (= data points outside the plot Y limits) are marked by a red arrow ( or )
  • you can download the data for each parameter set if the 'Data downloads' link shows up