HISTORY getStatusAB
VERSION DATE DESCRIPTION
1.0 2004-09-10 created from scratch
1.0.1 2004-09-15 bug with cmdstat fixed
1.1 2004-09-21 location and extension of job files changed (sorry...); $DFO_GUI_DIR supported
1.2 2004-09-28 introducing $IMG_URL
1.3 2004-11-24 introducing $SHOW_COMPLETENESS
1.3.1 2004-11-30 Links to DFO monitor and QC1_URL enabled
1.3.2 2004-12-09 Treatment of TECHNICAL data included
1.3.3 2005-01-11 T_EXEC correctly read from esorex
1.3.4 2005-02-14 improved treatment to find ABs by DATE
1.3.5 2005-03-17 even more improved treatment (2005-03-17)
1.3.6 2005-04-01 bug fixed with option -n
1.3.7 2005-06-10 support for CONDOR added
1.3.8 2005-08-02 visualization of cascade added, not yet common
1.3.9 2005-09-08 checks for ps or gif to set QC_STATUS to DONE
1.3.10 2005-10-22 bug fixed with TOOL_MODE=AB
1.4 2005-12-14 introducing sort options (AB_NAME or SETUP), association log, DELTA_T warnings, QC plot links
1.5 2006-02-23 supports LSPACK_MODE=YES
1.6 2006-03-03 compatible with createAB_v2.0 and firefox
1.6.1 2006-03-13 compatible with new condor
1.7 2007-02-06 supports MEF cascades; qcdate replaces mjd2date; supports scoreQC; displays pipelog warnings and errors; PGI_GETSTATUSAB, supports cmt files
1.7.1 2007-05-25 bug with "[ ERROR" fixed
1.7.2 2007-06-04 LINE_NEWENTRY handling; $CONDOR_DAG_BASE; JOB_ID and queue_watch.html extended for QCBQS=PAR
1.7.3 2007-09-13 improved handling of JOB_ID
1.7.4 2007-12-05 little bug with sorting of incomplete ABs fixed; minor modifications for histoMonitor
1.7.5 2008-05-27 bug fixed with error messages containing "load" string; report link added
1.7.6 2008-06-18 support for auto-certification
1.7.7 2008-09-16 bug fixed with certif/rejected tags; CAL link added
1.7.8 2008-09-18 another bug fixed with certif/rejected tags
1.8 2008-12-03 export status pages to web server; displays and exports total score
1.8.1 2009-01-14 bug fixed with SCORE_COL
1.9 2009-01-23 display CAL and SCI total scores separately
1.10 2009-04-02 new options -F and -H; AB marked if raw file not yet available; improved navigation
1.10.1 2009-04-20 bug fixed (GIRAFFE --> $DFO_INSTRUMENT)
1.10.2 2009-04-23 bug fixed (handling of plot formats: jpg|gif|png); enforced to scan all directories underneath $DFS_PRODUCT for plots
1.10.3 2009-06-16 HC marking; bug fixed with sorting (-k21 instead of -k20)
1.11 2009-10-23 w4 usage and CHECK_SCORE_DAY cleaned up; T_QC_EXEC; date comment; nopipe marking; modif_setup; improved handling for "No ABs found!"
1.11.1 2010-01-27 blinking for "check raw!" message turned off
1.11.2 2010-02-01 bug fixed in line 821 for large number of files
1.11.3 2010-02-23 bug fixed with vultur_exec_cascade for single ABs
1.11.4 2010-03-08 another bug fixed in line 802 for large number of files
1.11.5 2010-03-15 bug fix in line 1009; safweb1 -> qcweb
1.11.6 2010-03-22 comments read from $DFO_LST_DIR/PRODCOM/prod_comment_$DATE.txt
1.11.7 2010-04-23 bug fix in line 1752
1.12 2010-04-29 bug fix in line 1021; new option -e
1.12.1 2010-05-05 offers launch_recreateAB.esh
1.12.2 2010-06-01 minor bug fixed with launch_recreateAB.esh
1.12.3 2010-07-30 modified line :487, for ScientificLinux 5.3
1.13 2010-08-30 mark those ABs which are contained in others as WAITFOR; link to $DFO_RAW_DIR if existing
1.13.1 2010-09-20 bug fix in :1009
1.13.2 2010-09-30 bug fix in :1074 (case 3 consecutive nights w/o ABs) [IPer]
--------------------------------------------
2.0 2010-12-06 tablesorter, fancyzoom; NR link, buttons for comment management added; cumulative scores removed; removed individual display of DETs (former section 3.3.2); LSPACK_MODE suspended; java button to turn refresh off
2.0.1 2010-12-07 fancyzoom optional, control key is ZOOM, default is NO
2.1 2011-05-05 dataTables replacing tablesorter: offering sorting plus filtering; improved strategy for DATEs without ABs; fancyzoom disabled, replaced by coversheet
2.1.1 2011-06-01 bug fix for incremental mode: coversheets included in plots.tar
2.2 2011-10-12 for option -H: links to ingestion logs, and to harvestAB output
2.2.1 2011-10-19 improved top text, SCIENCE boxes enforced to be grey
2.2.2 2011-11-14 line 1804: 'sort -g' instead of 'sort -n' [JPr]; introducing N_AB_CREATED
2.3 2012-01-18 support for cmaps; improved indexes CAL1-->CAL01; for PARANAL: P... logo; AB monitor --> product quality monitor; link to score_investigate.html
2.3.1 2012-03-02 bug fix for DPR_CATG=TEST
2.3.2 2012-09-13 bug fix in line 2211 for TOTAL_SCORE=X; AB_NUMBER_MAX checked and displayed
2.3.3 2012-09-19 AB_NUMBER_MAX taken from dfoMonitor, to avoid double definition
2.3.4 2012-10-02 nightlogs replaced by NLT; DET_SPLITTING terminated
2.3.5 2012-11-29 SETUP empty --> forced to 'none'
2.3.6 2012-12-05 simplified: DELAY=300, AUTO_REFRESH=YES; END_MONITOR_PLUGIN, START_MONITOR_PLUGIN, LOAD_STATUS, LOAD_ALARM disabled
-------------------------------------------------------------
3.0 2013-01-09 gets info from AB tab files, for performance boost; support for ABS terminated; PLOG_WARNING terminated; CALnn -> CALnnn; -e terminated
3.1 2013-02-15 ready for the mucs: buttons for mucMonitor and cascadeM if on muc; technical options -m and -c
3.1.1 2013-03-05 bug fix for date navigation of LAST page; permalink to cascadeMonitor
3.1.2 2013-04-09 minor change for launch_recreate (refresh added)
3.1.3 2013-05-13 improved launch jobs for MUC and CASC
3.1.4 2013-07-26 bug fix in line :1342
3.2 2014-06-03 adapted to MUSE serial processing
3.2.1 2014-07-22 added handling for DRS_TYPE=INT
3.3 2014-08-14 supporting both DFOS and PHOENIX
3.3.1 2014-09-11 minor change for PHOENIX
3.4 2015-04-20 supporting the new calSelector (for science) and phoenix v2; code improvement for score flags
3.4.1 2015-05-06 fix in :2222ff for YELLOW_SCORE >9
3.5 2015-06-22 improved support for new calSelector
3.6 2015-07-15 supporting RAWDISP plots [BWo]; bug fixes for verifyAB
3.6.1 2015-07-20 small fix for PHOENIX; arr1red-->arr1black
3.6.2 2015-07-23 RAWDISP: reads new optional config key RAWDISP_SUPPORT, print DO_CLASS in web pages, introduce info.rawdisp, do not work on outdated nights
3.6.3 2015-07-27 small bug fix in line 2777
3.6.4 2015-07-29 create AAREADME in ~/qc//reports/RAWDISP/ on qcweb; usage of rawlog files
3.6.5 2015-09-21 for PHOENIX: understands 'NOQC' for certain step1 ABs (special cases); uses comment_phoenixMonitor (:2425); displays RELEASE comments
3.7 2015-12-07 RAWDISP: supports reference RAWDISP plots
3.7.1 2016-01-11 OBS.START added to line :1059
3.7.2 2016-05-30 RAWDISP: proper handling of # in links to reference plots
3.8 2016-10-10 supporting DEEP IDP projects (pseudo-dates
3.8.1 2016-11-23 RAWDISP: '#' removed in file names of reference plots; proper handling of UVES-blue file format
3.8.2 2017-07-24 handling of NLT_APPLICABLE adapted to getObInfo v2.0
3.8.3 2017-08-16 link to REF rawfiles_START_ALL.html; REF_PAGE_URL obsolete
3.8.4 2017-09-18 launch_mucMonitor script w/o $DATE; DFOS_URL obsolete as config key; new optional key: DFO_UID
3.8.5 2017-10-17 minor improvement of launch_mucMonitor
3.9 2017-12-06 RAWDISP: extract and display classification rules of raw types
3.9.1 2018-03-26 adapted to P100+ for DEEP_MODE=YES
3.9.2 2018-06-01 minor changes to adapt to step2 processing of SCIENCE; new optional AB_FILTER_COMMENT in config.phoenix evaluated, PHOENIX only
-------------------------------------------------------------
4.0 2018-10-22 OPSHUB aware; QUICK_EDIT obsolete (done by updateTAB@certifyP)
4.1 2019-02-14 correct syntax for condor_q; OPSHUB: self-fixing of missing ATAB file(s)
4.1.1 2019-03-19 OPSHUB: sleep 0.1 added for opshub (fragile gluster environment)
4.1.2 2019-03-25 creation of ATAB switched off (creates multiple instances on OPSHUB)
4.1.3 2019-08-19 adapted to COMPLETE_MODE=YES for phoenix; dependencies for cascadeMonitor dropped
4.1.4 2021-03-11 bug fix for PHOENIX around :2190
4.1.5 2021-03-12 adapted to new runID scheme which makes pseudo-dates even more challenging
4.1.6 2021-04-26 bug fix for new runID scheme
4.1.7 2021-05-19 bug fix for links on qcweb to QC plots if raw type contains a number like in P2VM