HISTORY getStatusAB

VERSION	DATE		DESCRIPTION
1.0	2004-09-10	created from scratch
1.0.1	2004-09-15	bug with cmdstat fixed
1.1	2004-09-21	location and extension of job files changed (sorry...); $DFO_GUI_DIR supported
1.2	2004-09-28	introducing $IMG_URL 
1.3	2004-11-24	introducing $SHOW_COMPLETENESS 
1.3.1	2004-11-30	Links to DFO monitor and QC1_URL enabled
1.3.2	2004-12-09	Treatment of TECHNICAL data included
1.3.3	2005-01-11	T_EXEC correctly read from esorex
1.3.4	2005-02-14	improved treatment to find ABs by DATE
1.3.5	2005-03-17	even more improved treatment (2005-03-17)
1.3.6	2005-04-01	bug fixed with option -n 
1.3.7	2005-06-10	support for CONDOR added
1.3.8	2005-08-02	visualization of cascade added, not yet common 
1.3.9	2005-09-08	checks for ps or gif to set QC_STATUS to DONE
1.3.10	2005-10-22	bug fixed with TOOL_MODE=AB
1.4	2005-12-14	introducing sort options (AB_NAME or SETUP), association log, DELTA_T warnings, QC plot links
1.5	2006-02-23	supports LSPACK_MODE=YES
1.6 	2006-03-03	compatible with createAB_v2.0 and firefox
1.6.1	2006-03-13	compatible with new condor
1.7 	2007-02-06	supports MEF cascades; qcdate replaces mjd2date; supports scoreQC; displays pipelog warnings and errors; PGI_GETSTATUSAB, supports cmt files
1.7.1	2007-05-25	bug with "[ ERROR" fixed
1.7.2	2007-06-04	LINE_NEWENTRY handling; $CONDOR_DAG_BASE; JOB_ID and queue_watch.html extended for QCBQS=PAR
1.7.3	2007-09-13	improved handling of JOB_ID
1.7.4	2007-12-05	little bug with sorting of incomplete ABs fixed; minor modifications for histoMonitor
1.7.5	2008-05-27	bug fixed with error messages containing "load" string; report link added
1.7.6	2008-06-18	support for auto-certification
1.7.7	2008-09-16	bug fixed with certif/rejected tags; CAL link added
1.7.8	2008-09-18	another bug fixed with certif/rejected tags
1.8	2008-12-03	export status pages to web server; displays and exports total score
1.8.1	2009-01-14	bug fixed with SCORE_COL
1.9	2009-01-23	display CAL and SCI total scores separately
1.10	2009-04-02	new options -F and -H; AB marked if raw file not yet available; improved navigation
1.10.1	2009-04-20	bug fixed (GIRAFFE --> $DFO_INSTRUMENT)
1.10.2	2009-04-23	bug fixed (handling of plot formats: jpg|gif|png); enforced to scan all directories underneath $DFS_PRODUCT for plots
1.10.3	2009-06-16	HC marking; bug fixed with sorting (-k21 instead of -k20)
1.11	2009-10-23	w4 usage and CHECK_SCORE_DAY cleaned up; T_QC_EXEC; date comment; nopipe marking; modif_setup; improved handling for "No ABs found!"
1.11.1	2010-01-27	blinking for "check raw!" message turned off
1.11.2	2010-02-01	bug fixed in line 821 for large number of files
1.11.3	2010-02-23	bug fixed with vultur_exec_cascade for single ABs
1.11.4	2010-03-08	another bug fixed in line 802 for large number of files 
1.11.5	2010-03-15	bug fix in line 1009; safweb1 -> qcweb
1.11.6	2010-03-22	comments read from $DFO_LST_DIR/PRODCOM/prod_comment_$DATE.txt
1.11.7	2010-04-23	bug fix in line 1752
1.12	2010-04-29	bug fix in line 1021; new option -e
1.12.1	2010-05-05	offers launch_recreateAB.esh
1.12.2	2010-06-01	minor bug fixed with launch_recreateAB.esh
1.12.3	2010-07-30	modified line :487, for ScientificLinux 5.3
1.13	2010-08-30	mark those ABs which are contained in others as WAITFOR; link to $DFO_RAW_DIR if existing
1.13.1	2010-09-20	bug fix in :1009
1.13.2	2010-09-30	bug fix in :1074 (case 3 consecutive nights w/o ABs) [IPer]
--------------------------------------------
2.0	2010-12-06	tablesorter, fancyzoom; NR link, buttons for comment management added; cumulative scores removed; removed individual display of DETs (former section 3.3.2); LSPACK_MODE suspended; java button to turn refresh off
2.0.1 	2010-12-07	fancyzoom optional, control key is ZOOM, default is NO
2.1	2011-05-05	dataTables replacing tablesorter: offering sorting plus filtering; improved strategy for DATEs without ABs; fancyzoom disabled, replaced by coversheet
2.1.1	2011-06-01	bug fix for incremental mode: coversheets included in plots.tar
2.2	2011-10-12	for option -H: links to ingestion logs, and to harvestAB output
2.2.1	2011-10-19	improved top text, SCIENCE boxes enforced to be grey
2.2.2	2011-11-14	line 1804: 'sort -g' instead of 'sort -n' [JPr]; introducing N_AB_CREATED
2.3	2012-01-18	support for cmaps; improved indexes CAL1-->CAL01; for PARANAL: P... logo; AB monitor --> product quality monitor; link to score_investigate.html
2.3.1	2012-03-02	bug fix for DPR_CATG=TEST
2.3.2	2012-09-13	bug fix in line 2211 for TOTAL_SCORE=X; AB_NUMBER_MAX checked and displayed
2.3.3	2012-09-19	AB_NUMBER_MAX taken from dfoMonitor, to avoid double definition
2.3.4	2012-10-02	nightlogs replaced by NLT; DET_SPLITTING terminated
2.3.5	2012-11-29	SETUP empty --> forced to 'none'
2.3.6	2012-12-05	simplified: DELAY=300, AUTO_REFRESH=YES; END_MONITOR_PLUGIN, START_MONITOR_PLUGIN, LOAD_STATUS, LOAD_ALARM disabled
-------------------------------------------------------------
3.0	2013-01-09	gets info from AB tab files, for performance boost; support for ABS terminated; PLOG_WARNING terminated; CALnn -> CALnnn; -e terminated
3.1	2013-02-15	ready for the mucs: buttons for mucMonitor and cascadeM if on muc; technical options -m and -c
3.1.1	2013-03-05	bug fix for date navigation of LAST page; permalink to cascadeMonitor
3.1.2	2013-04-09	minor change for launch_recreate (refresh added)
3.1.3	2013-05-13	improved launch jobs for MUC and CASC
3.1.4	2013-07-26	bug fix in line :1342
3.2	2014-06-03	adapted to MUSE serial processing 
3.2.1	2014-07-22	added handling for DRS_TYPE=INT 
3.3	2014-08-14	supporting both DFOS and PHOENIX
3.3.1	2014-09-11	minor change for PHOENIX 
3.4	2015-04-20	supporting the new calSelector (for science) and phoenix v2; code improvement for score flags
3.4.1	2015-05-06	fix in :2222ff for YELLOW_SCORE >9
3.5	2015-06-22	improved support for new calSelector
3.6	2015-07-15	supporting RAWDISP plots [BWo]; bug fixes for verifyAB 
3.6.1	2015-07-20	small fix for PHOENIX; arr1red-->arr1black
3.6.2	2015-07-23	RAWDISP: reads new optional config key RAWDISP_SUPPORT, print DO_CLASS in web pages, introduce info.rawdisp, do not work on outdated nights
3.6.3	2015-07-27	small bug fix in line 2777
3.6.4	2015-07-29	create AAREADME in ~/qc//reports/RAWDISP/ on qcweb; usage of rawlog files
3.6.5	2015-09-21	for PHOENIX: understands 'NOQC' for certain step1 ABs (special cases); uses comment_phoenixMonitor (:2425); displays RELEASE comments
3.7	2015-12-07	RAWDISP: supports reference RAWDISP plots 
3.7.1	2016-01-11	OBS.START added to line :1059 
3.7.2	2016-05-30	RAWDISP: proper handling of # in links to reference plots
3.8	2016-10-10	supporting DEEP IDP projects (pseudo-dates
3.8.1	2016-11-23	RAWDISP: '#' removed in file names of reference plots; proper handling of UVES-blue file format
3.8.2	2017-07-24	handling of NLT_APPLICABLE adapted to getObInfo v2.0 
3.8.3	2017-08-16	link to REF rawfiles_START_ALL.html; REF_PAGE_URL obsolete
3.8.4	2017-09-18	launch_mucMonitor script w/o $DATE; DFOS_URL obsolete as config key; new optional key: DFO_UID
3.8.5	2017-10-17	minor improvement of launch_mucMonitor
3.9	2017-12-06	RAWDISP: extract and display classification rules of raw types
3.9.1	2018-03-26	adapted to P100+ for DEEP_MODE=YES
3.9.2	2018-06-01	minor changes to adapt to step2 processing of SCIENCE; new optional AB_FILTER_COMMENT in config.phoenix evaluated, PHOENIX only 
-------------------------------------------------------------
4.0	2018-10-22	OPSHUB aware; QUICK_EDIT obsolete (done by updateTAB@certifyP)
4.1	2019-02-14	correct syntax for condor_q; OPSHUB: self-fixing of missing ATAB file(s)
4.1.1	2019-03-19	OPSHUB: sleep 0.1 added for opshub (fragile gluster environment)
4.1.2	2019-03-25	creation of ATAB switched off (creates multiple instances on OPSHUB)
4.1.3	2019-08-19	adapted to COMPLETE_MODE=YES for phoenix; dependencies for cascadeMonitor dropped
4.1.4	2021-03-11	bug fix for PHOENIX around :2190 
4.1.5	2021-03-12	adapted to new runID scheme which makes pseudo-dates even more challenging
4.1.6	2021-04-26	bug fix for new runID scheme
4.1.7	2021-05-19	bug fix for links on qcweb to QC plots if raw type contains a number like in P2VM