Common Trending and QC tools:
|
tqs = Trending and Quality Control System |
|
new: |
see also:
|
The tool webKPI helps to organize the KPI web pages. KPI stands for 'key performance indicator' and is meant to be a subsystem of the HC monitor, with a standardized content of KPI plots across all VLT instruments.
A KPI plot is a HC plot
An example for a KPI is resolution (resolving power) for a spectrograph, and gain for detectors. Click here for the GIRAFFE resolution plot.
Organizing all KPI plots per instrument is the core task of webKPI, together with creating a common page as entry point and a navigation bar as table of content.
The tool has a general configuration file and instrument-specific configuration files. The general configuration file is config.webKPI and contains
In order to preserve the standardization, it is used as "master" for the normal user.
The instrument-specific configuration file is config.webKPI_<instrument>. It is filled and maintained by the normal user. It configures the names of KPI plots for the chosen KPI items and categories. The tool checks the choices against the general configuration file.
The normal user calls the tool only to set up or maintain the KPI page for the chosen instrument. The update of the KPI plots is not done by the tool, but by the usual HC monitor update mechanism.
The normal call is
webKPI -i <myInstr>
or just
webKPI
As sketched below, the tool downloads the general configuration from qcweb (for consistency checks), and takes the local content config.webKPI_<myInstr> to create the result page for myInstr which is then uploaded to the HC monitor site. Also, the instrument configuration file is uploaded to the qcweb site and is the master for <myInstr> if needed.
The general call is
webKPI -A
(A stands for ALL). It can only be executed by the account hard-coded in the tool as $AUTHORIZED. In that mode, the tool takes the local config.webKPI as master, reading all instruments from it and creating the overview page Instrument_performance.html. In addition, it also loops across all configured instruments, downloads the corresponding config files from qcweb, executes the 'webKPI -i <instr>' calls, and uploads the InstrPerf_<instr>.html files. This loop is executed in order to always have the same design and concepts behind the individual pages. For this loop the tool makes use of all the config.webKPI_<instr> files maintained and uploaded by the individual accounts.
Finally, one can also call the tool as
webKPI -i <notMyInstr>
if e.g. a change is necessary and the corresponding QC scientist is not available. Then, after confirmation ("do you really want to"), one can call the tool for this specific instrument. The mechanism then is that both the config.webKPI and the config.webKPI_<notMyInstr> are downloaded from qcweb and used to create the specific output page for notMyInstr.
Type
webKPI -h for on-line help,
webKPI -v for the version number.
The standard mode is:
webKPI [-i <myInstr>]
Exceptionally, you can also call
webKPI -i <notMyInstr>
There is also the exploration mode,
webKPI -E
which gives an overview of the supported categories, the items per category, and who is $AUTHORIZED. This is useful when you need to start from scratch for a new instrument.
As $AUTHORIZED, you can also call
webKPI -A
which can be done as such interactively, or as
webKPI -A -n
without interactivity, designed for a cronjob. Type 'webKPI -E' to see who is $AUTHORIZED.
The uploads of the config files go to http://qcweb.hq.eso.org/ALL/KPI/. You can directly connect to that link by clicking right of the text "back to overview". There you can see the pool of config files.
All local tool configuration goes to $DFO_CONFIG_DIR/webKPI. There is config.webKPI and one config.webKPI_<myInstr>. For $AUTHORIZED, all other config.webKPI_<instr> are also in the local system.
The tool configuration config.webKPI has the following content:
Section 1: List of telescopes |
|||
TEL_NAME | UT1 | ||
TEL_NAME | UT2 | ||
TEL_NAME | ICCS | ||
TEL_NAME | VLTI | ||
TEL_NAME | retired | this is a special "telescope" to support decommissioned instruments, just in case. | |
Section 2: Instruments |
|||
INS_NAME | UVES | UT2 | # this is the instrument-telescope assignment |
INS_NAME | retired | VIMOS | |
INS_NAME | ICCS | ESPRESSO | |
|
|||
#CATEG_NAME | category short | category long | |
CATEG_NAME | DET_PERF | Detector_Performance | |
etc. | |||
Section 4: KPI items |
|||
#ITEM_NAME | CATEG_SHORT | ||
ITEM_NAME | DET_PERF | GAIN | |
etc. |
Entries can be modified or added by the $AUTHORIZED account.
The instrument configuration config.webKPI_<instr> has the following content:
Section 1: KPI report names and properties There is one row per KPI report. Each row has the following columns: |
||
#REPORT_NAME | Example | Comment |
INSTR | GIRAFFE | as in $DFO_INSTRUMENT |
MODE | ANY or ECH etc. | your choice, not normalized across instruments |
CATG | DET_PERF | must exist in section 3 above |
ITEM | GAIN | must exist in section 4 above |
LABEL | Read_noise | one word; is used as label for the hyperlink |
LINK | trend_report_KPI_READNOISE.html | name of KPI report |
PREV | 0.9" | optional additional tag that precedes the LABEL, one word; useful if you have more than one report to configure and want some structuring |
DECO | <br> | optional HTML tag; if used, PREV must be set (or EMPTY) |
Find examples of webKPI config files here: http://qcweb.hq.eso.org/ALL/KPI/.
For the KPI plot overview page to be linked properly to HC navigation bar, you include the following lines in the config.navbar_HC_<instr> file at the proper place (see the tool webNavbar for more):
Instrument_Performance | CLASS=nav-dailyitem |
KPI | CLASS=nav-noscoreitem |
SPACE | nav-subitem |
as highlighted by the frame in the following screenshot of config.navbar_HC_GIRAFFE (at right the configuration, at left the result):
The KPI plots are configured as part of the HC monitor, with the trendPlotter tool (see here).
The most important difference between a normal HC plot and a KPI plot is the reference value (to be entered in Sect 4.7 of the config file). While configuring a value is straightforward, finding it and distributing it to the upcoming QC documentation system webDocuSys is more involved. This is an IOT task and relies in particular on the close collaboration between QC scientist and instrument scientist.
Please also make sure to always have a file <REPORT_NAME>.txt filled with useful information about the reference value (which, why etc.). This displays in the report as "This plot" and is particularly useful for KPI plots.
Find an example of the config file for http://www.eso.org/observing/dfo/quality/GIRAFFE/reports/FULL/trend_report_KPI_SPECRES.html here:
Last update: April 26, 2021 by rhanusch |