Common Trending and QC tools:
Documentation

tqs = Trending and Quality Control System

make printable 


new:

v1.0:

- released

see also:

trendPlotter, webNavbar

[ used databases ] databases none
[ used dfos tools ] tqs tools webDocuSys; webNavbar
[ output used by ] output used by none
[ upload/download ] upload/download

upload/download scheme for config files;
upload (scp) created web pages to standard QC web server


[ top ] webKPI

Description

The tool webKPI helps to organize the KPI web pages. KPI stands for 'key performance indicator' and is meant to be a subsystem of the HC monitor, with a standardized content of KPI plots across all VLT instruments.

A KPI plot is a HC plot

An example for a KPI is resolution (resolving power) for a spectrograph, and gain for detectors. Click here for the GIRAFFE resolution plot.

Organizing all KPI plots per instrument is the core task of webKPI, together with creating a common page as entry point and a navigation bar as table of content.


[ top ] Principles

The tool has a general configuration file and instrument-specific configuration files. The general configuration file is config.webKPI and contains

In order to preserve the standardization, it is used as "master" for the normal user.

The instrument-specific configuration file is config.webKPI_<instrument>. It is filled and maintained by the normal user. It configures the names of KPI plots for the chosen KPI items and categories. The tool checks the choices against the general configuration file.

The normal user calls the tool only to set up or maintain the KPI page for the chosen instrument. The update of the KPI plots is not done by the tool, but by the usual HC monitor update mechanism.

[ top ] Normal vs. general call

The normal call is

webKPI -i <myInstr>

or just

webKPI

As sketched below, the tool downloads the general configuration from qcweb (for consistency checks), and takes the local content config.webKPI_<myInstr> to create the result page for myInstr which is then uploaded to the HC monitor site. Also, the instrument configuration file is uploaded to the qcweb site and is the master for <myInstr> if needed.

 

The general call is

webKPI -A

(A stands for ALL). It can only be executed by the account hard-coded in the tool as $AUTHORIZED. In that mode, the tool takes the local config.webKPI as master, reading all instruments from it and creating the overview page Instrument_performance.html. In addition, it also loops across all configured instruments, downloads the corresponding config files from qcweb, executes the 'webKPI -i <instr>' calls, and uploads the InstrPerf_<instr>.html files. This loop is executed in order to always have the same design and concepts behind the individual pages. For this loop the tool makes use of all the config.webKPI_<instr> files maintained and uploaded by the individual accounts.

 

Finally, one can also call the tool as

webKPI -i <notMyInstr>

if e.g. a change is necessary and the corresponding QC scientist is not available. Then, after confirmation ("do you really want to"), one can call the tool for this specific instrument. The mechanism then is that both the config.webKPI and the config.webKPI_<notMyInstr> are downloaded from qcweb and used to create the specific output page for notMyInstr.

 

[ top ] How to use

Type

webKPI -h for on-line help,

webKPI -v for the version number.

The standard mode is:

webKPI [-i <myInstr>]

Exceptionally, you can also call

webKPI -i <notMyInstr>

There is also the exploration mode,

webKPI -E

which gives an overview of the supported categories, the items per category, and who is $AUTHORIZED. This is useful when you need to start from scratch for a new instrument.

As $AUTHORIZED, you can also call

webKPI -A

which can be done as such interactively, or as

webKPI -A -n

without interactivity, designed for a cronjob. Type 'webKPI -E' to see who is $AUTHORIZED.


[ top ] Output

The output is the result HTML web page on the HC monitor site, e.g. http://www.eso.org/observing/dfo/quality/HEALTH/KPI/InstrPerf_GIRAFFE.html.

The uploads of the config files go to http://qcweb.hq.eso.org/ALL/KPI/. You can directly connect to that link by clicking right of the text "back to overview". There you can see the pool of config files.


[ top ] Configuration

All local tool configuration goes to $DFO_CONFIG_DIR/webKPI. There is config.webKPI and one config.webKPI_<myInstr>. For $AUTHORIZED, all other config.webKPI_<instr> are also in the local system.

The tool configuration config.webKPI has the following content:


Section 1: List of telescopes
TEL_NAME UT1  
TEL_NAME UT2  
TEL_NAME ICCS  
TEL_NAME VLTI  
TEL_NAME retired this is a special "telescope" to support decommissioned instruments, just in case.

Section 2: Instruments
INS_NAME UVES UT2 # this is the instrument-telescope assignment
INS_NAME retired VIMOS  
INS_NAME ICCS ESPRESSO  


Section 3: KPI categories

#CATEG_NAME category short category long  
CATEG_NAME DET_PERF Detector_Performance  
  etc.    

Section 4: KPI items
#ITEM_NAME CATEG_SHORT    
ITEM_NAME DET_PERF GAIN  
    etc.  

Entries can be modified or added by the $AUTHORIZED account.

The instrument configuration config.webKPI_<instr> has the following content:


Section 1: KPI report names and properties
There is one row per KPI report. Each row has the following columns:
#REPORT_NAME Example Comment
INSTR GIRAFFE as in $DFO_INSTRUMENT
MODE ANY or ECH etc. your choice, not normalized across instruments
CATG DET_PERF must exist in section 3 above
ITEM GAIN must exist in section 4 above
LABEL Read_noise one word; is used as label for the hyperlink
LINK trend_report_KPI_READNOISE.html name of KPI report
PREV 0.9" optional additional tag that precedes the LABEL, one word; useful if you have more than one report to configure and want some structuring
DECO <br> optional HTML tag; if used, PREV must be set (or EMPTY)

Find examples of webKPI config files here: http://qcweb.hq.eso.org/ALL/KPI/.


[ top ] Navigation bar for KPI plots

For the KPI plot overview page to be linked properly to HC navigation bar, you include the following lines in the config.navbar_HC_<instr> file at the proper place (see the tool webNavbar for more):

Instrument_Performance CLASS=nav-dailyitem
KPI CLASS=nav-noscoreitem
SPACE nav-subitem

as highlighted by the frame in the following screenshot of config.navbar_HC_GIRAFFE (at right the configuration, at left the result):


[ top ] trendplotter configuration for KPI plots

The KPI plots are configured as part of the HC monitor, with the trendPlotter tool (see here).

The most important difference between a normal HC plot and a KPI plot is the reference value (to be entered in Sect 4.7 of the config file). While configuring a value is straightforward, finding it and distributing it to the upcoming QC documentation system webDocuSys is more involved. This is an IOT task and relies in particular on the close collaboration between QC scientist and instrument scientist.

Please also make sure to always have a file <REPORT_NAME>.txt filled with useful information about the reference value (which, why etc.). This displays in the report as "This plot" and is particularly useful for KPI plots.

Find an example of the config file for http://www.eso.org/observing/dfo/quality/GIRAFFE/reports/FULL/trend_report_KPI_SPECRES.html here:

config.tp_KPI_SPECRES

 


Last update: April 26, 2021 by rhanusch