Common DFOS tools:
Documentation

dfos = Data Flow Operations System, the common tool set for DFO
*make printable

Cronjobs with DFOS

Certain steps of the daily workflow can be called automatically day by day and hence qualify for the unix cronjob functionality. DFOS offers the tool dfosCron as a wrapper script to launch certain dfos tools as cronjob. Details about the tool are described here.

As a reference, the current dfos cronjob file operational for FLAMES/GIRAFFE is available here.

Here we describe how cronjobs (not just dfosCron but in principle any kind of job) are installed and managed under linux/unix.

Installation of cronjobs

Install a dfos cronjob:

Monitor and test cronjobs

Type 'crontab -l' to see the active cronjobs.

dfosCron is written such that it writes any regular output (log information) into the CRON files (see above). Any irregular output (error messages) would go to stdout which does not exist for cronjobs, however. That output is instead sent as an email to the user. While this is useful in the rare case of a failure, it should not become routine behaviour of the tool. Hence the user may want to test the cronjob before it is made operational.

There are two essential test:

The script functionality itself is best checked by calling the tool from the command line.

The cronjob functionality is best tested by a test run. Call crontab -e with a time close in the future, and check its results (in the log file and maybe in the email queue). The critical part is that cronjobs do not source the initialization files like .login, .qcrc etc. which are sourced at any user login. The tool dfosCron explicitly sources .qcrc and .dfosrc, hoping that all environment variables, as well as the PATH and DISPLAY information is properly set afterwards. Since there seem to be slight differences in the way DFO account are setup, this test is critical.


Last update: April 26, 2021 by rhanusch