HISTORY dfoMonitor

VERSION	DATE		DESCRIPTION
1.0	2004-12-22	created from scratch
1.0.1	2005-02-22	bug removed with launch_createJob
1.0.2	2005-03-10	bug fixed with N_AB
1.0.3	2005-08-10	finishNight also offered if N_ABs=0 for SCIENCE
1.0.4	2005-11-10	updateDP also offered if N_ABs=0 for SCIENCE
1.0.5	2005-11-22	SORT_SCHEME and SIMULATION obsolete 
1.1	2005-12-08	supports autoDaily
1.1.1	2005-12-22	includes check for product ingestion
1.2	2006-01-27	manages off-line jobs 
1.3	2006-03-03	supports createAB -v2.0 (and older versions) plus firefox
1.3.1	2006-03-10	has correct treatment for vcalib_list and mcalib_list
1.3.2	2006-03-13	mcalib_list replaced by scanning N_MCAL_LIST last dirs
1.3.3	2006-04-10	bug removed for case N_AB=0
1.3.4	2006-05-16	qcdate replacing mjd2date; dfosLog suspended
1.3.5	2006-06-20	listMcalib removed, bug fixed with VCAL
1.3.6	2006-09-19	modified handling of fitsort (qfits)
1.3.7	2006-10-24	bug fixed with vcalib_list
1.4	2006-10-30	supports nightlogs and NotValid flagging; colours hardcoded
1.5	2006-12-15	SM_VM flag included; links to logs added; maintains monitor navbars
1.5.1	2007-01-08	bug fixed with mixed SM_VM values
1.5.2	2007-02-06	added: POSTIT box, call of refreshVCAL, extractStat
1.5.3	2007-02-26	added: flagging of nights with filter list
1.5.4	2007-03-02	monitor refresh after editing POSTIT file
1.5.5	2007-03-23	bug fixed with some links showing up on exported version
1.5.6	2007-03-28	bug fixed with POSTIT
1.5.7	2007-09-11	improved handling of LOTS of ABs for SCIENCE (JP)
1.5.8	2007-10-15	minor change for DISK parameter, to handle new dfo blades
1.6	2007-11-19	updated to treat sci_Ingested flag
1.6.1	2008-01-09	links to HTML reports and histoMonitor, compatible with createReport v3.+
1.7	2008-01-24	Xtended Diskspace Monitor XDM, JOBS_CLEANUP
1.7.1	2008-02-13	DFO_HDR_DIR calculated offline; 1000->1024
1.7.2	2008-04-10	PRINT_JOBS=NONE --> not included in ToDo list	
1.8	2008-07-16	has link to calChecker report
1.8.1	2008-08-05	bug fixed with SM_VM flag
1.9	2008-09-16	modified completeness check
1.9.1	2009-08-18	bug fixed with compl. check
1.9.2	2008-09-19	raw_Complete handling modified
1.10	2008-09-29	options for ganglia monitor added
1.11	2008-11-17	transfer overview and autoDaily checkbox added; df protection for fastcache
1.11.1	2008-12-03	delay times in hrs
1.12	2009-01-12	export to safweb1
1.13	2009-02-16	ngasWatcher exported; ganglia display more comfortable; rcp to dmdarc1 turned off; DFS_RELEASE checked
1.13.1	2009-02-17	transferWatcher exported
1.13.2	2009-02-19	bug fix transferWatcher
1.13.3	2009-04-23	datatransfermonitor link updated
1.13.4	2009-05-18	added '-o BatchMode=yes' to few remaining ssh commands
1.13.5	2009-06-16	improved handling for large umber of files [WHu]
1.14	2009-07-07	improved handling of autoDaily messages; direct export to w1/w2; bandwidth monitored
1.14.1	2009-07-24	bug fix for VIMOS/VISIR/VIRCAM; check boxes for increm. processing enabled again
1.14.2	2009-07-28	new GANGLIA_HOME
1.14.3	2009-08-04	GANGLIA_HOME changed again
1.14.4	2009-09-16	MIDAS_CHECK included
1.15	2010-01-25	timeout for test download
1.15.1	2010-03-01	bug fixed with raw_Incomplete
-------------------------------------------------------------------------------------------
2.0 	2010-03-25	bug fixed with raw_Incomplete; links to DTS status, SOS Nagios/MUNIN; new key CLUSTER_WIDTH; safweb1->qcweb; option -N; checking for HCMON_SUPPORT
2.0.1	2010-05-07	improved test for DFS_DEFAULT (line 1678)
2.0.2	2010-07-26	minor improvements for QUIET=YES 
2.0.3	2010-08-02	refresh_browser modified, option -N modified
2.1	2010-09-15	MUNIN replaces nagios; ngasTest and DTS done in the bkg
2.2	2010-09-22	stabilized against loss of DFO_STATUS; proc_status pages; parallel execution possible
2.2.1	2010-10-10	fixed a bug with deleting $TEST_FILE
2.2.2	2010-10-22	fixed a bug with refreshTRQ
2.2.3	2010-11-02	fixed a bug with writeXDM
2.2.4	2010-12-03	fixed a bug with changeMunin
2.2.5	2011-01-28	BANDWIDTH_URL changed
2.3	2011-02-03	GANGLIA is back
2.3.1	2011-02-15	BANDWIDTH_URL changed again
2.3.2	2011-03-28	exported version: URL to status pages modified
2.3.3	2011-04-21	EDITOR variables replaced by $DFO_EDITOR
2.3.4	2011-05-02	new config key $CREATEAB_VCAL
2.4	2011-05-11	supports 'certifyP-light'
2.4.1	2011-06-09	check for calChecker cronjob
2.4.2	2011-08-30	bug fix with refreshPA.esh
2.4.3	2011-09-07	improved download of $TEST_FILE; improved monitoring of fastcache
-------------------------------------------------------------------------------------------
3.0	2011-10-04	new workflow for QC XXLight; JOB_FILE_NAME replaced by JOBS_NIGHT; ING_FILE_NAME replaced by JOBS_INGEST
3.0.1	2011-10-05	bug fix, plus indicators for XXLight added
3.0.2	2011-10-11	sci_Harvested recognized
3.0.3	2011-10-12	links to ingest and harvest logs
3.0.4	2011-10-14	links to harvestAB listings
3.0.5	2011-10-18	bug fix for finished nights; PRINT_JOBS removed
3.1	2011-11-07	packing step removed ; bug fix for ngas check 
3.1.1	2011-11-16	bug fixed with ngas error
3.2	2012-01-03	finishNight for SCIENCE nights enabled only if createAB called; enabled for nights without data; SRV removed from XDM
3.2.1	2012-01-18	warning mail if $DISK_FRAC>80%; XDM_INCLUDE always YES
3.2.2	2012-02-07	DATE added for offering science ABs for review; link to SDIFF file
3.2.3	2012-02-29	enter Y to continue in 'createAB -m SCIENCE'
3.2.4	2012-03-04	bug fix for mixed nights (SM/VM)
3.2.5	2012-03-19	GANGLIA_LOAD/CPU/NET obsolete; EVALSO monitors added
3.2.6	2012-05-23	XDM homogenized, XDM_SUPPRESS and XDM_THRESH obsolete, disk space scored, link to dfoManager
3.2.7	2012-08-13	no export of MUNIN monitors (due to IP protection)
3.2.8	2012-08-24	sara queries changed; $BROWSER_ACTIVE improved for multi-users; $SCI_NUM added
3.3	2012-09-14	FTP_HOSTID and load monitoring disabled; autoDaily, LAST_AB, AB_NUMBER_MAX enabled; speed up for createAB SCIENCE
3.3.1	2012-09-19	AB_NUMBER_MAX increased to 2500
3.3.2	2012-09-20	Bug fixed with last processed AB
3.3.3	2012-09-25	improved SM_VM display, bug fix for refreshTRQ
3.3.4	2012-10-02	link to NLT replacing NR link
3.3.5	2012-10-04	bug fix for AGE_ALERT
3.3.6	2012-10-14	bug fix for CURRENT; "NotValid" evaluation terminated
3.3.7	2012-10-21	slightly modified refresh_navbar 
3.3.8	2012-12-17	bug fix for N_ABs if 0; lower tool bar sorted properly
3.3.9	2013-02-17	link to condor_config; GANGLIA_DEFAULT obsolete; autoDaily checks 'current DATE' and 'increm' frozen; WISQ exectime link
3.3.10	2013-03-05	checks for current DATE' and 'increm' removed; new check for FULL calChecker and qc1Parser; slightly modified workflow for SCIENCE; DTS status link removed
3.3.11	2013-03-10	bug fix in :2580 for autoDailycheck; :140 new GANGLIA_HOME
3.3.12	2013-03-22	GANGLIA variables updated to mucXX
3.4	2013-04-26	terminated: /FASTCACHE support, frames and links to clusterMonitor 
3.5	2013-08-02	PHOENIX signal sent if configured
3.5.1	2013-10-11	new TRANSFER_URL
3.6	2013-10-28	transition stargate1-->qcweb 
3.6.1	2013-11-18	new MUNIN_HOME
3.6.2	2014-02-17	replace 'switch' by 'change' in awk commands (for OS upgrade)
3.7	2014-05-11	support for ANC files terminated, logics for JOBS_INGEST adapted
3.7.1	2014-07-09	minor improvement for launching JOBS files
-------------------------------------------------------------------------------------------
4.0	2014-08-13	supporting PHOENIX; new optional config key DATA_QUOTA
4.0.1	2014-08-21	bug fix in line :4315
4.0.2	2014-08-28	some active buttons switched off for PHOENIX; added: ganglia mem-report
4.1_beta 2015-01-09	check for qc1Parser removed [BWo]; prepared for new calSelector 
4.1_beta2 2015-02-20	minor changes for phoenix v2 
4.1_beta3 2015-03-23	ConnectTimeOut removed; bbcp-->DTS label
4.1_beta4 2015-06-11	default mode for XXLight is RANDOM
4.1	2015-06-22	workflow support for calSelector v2 
4.1.1	2015-07-13	new IMG for timezone
4.1.2	2015-07-23	cronjob checks added for cleanupRawdisp and autoDaily in watch mode 
4.1.3	2015-08-10	bug fix for autoDaily cronjob check, and XDM alignment
4.1.4	2015-09-01	minor bug fixes
4.2	2015-11-30	new button for rawdisp2reference; logo changed from XXLight to DFOS
4.2.1	2016-01-29	flag sci_Certif supported (for PHOENIX; lines 4029/4062)
4.2.2	2016-05-30	new link for RAWDISP_reference file (DFOS only)
4.2.3	2016-06-08	improved links for PHOENIX 
4.2.4	2016-08-06	small changes for non-std dates (PHOENIX DEEP); new link to REFERENCE page (DFOS)
4.2.5	2016-11-07	makes JOBS_NIGHT visible under PHOENIX
4.2.6	2016-11-17	bug fix for PHOENIX ($TMP_DIR/$PID was not managed properly)
4.2.7	2017-09-13	new link to dfoMonitor_contact.txt
4.2.8	2017-09-18 	new links for DTS; simplified behaviour for PHOENIX
4.2.9	2017-12-07	link for DYNAMIT added, dateandtime disabled
4.3	2017-12-18	SCIENCE step offered if no CALIBs
4.3.1	2018-01-09	updated DYNAMIT URL
4.3.2	2018-03-26	no disk space check if 'refresh' button is called (for better performance)
4.3.3	2018-04-03	improved refresh, improved removeNight
4.3.4	2018-04-16	labels updated for PHOENIX DEEP mode
4.3.5	2018-06-06	refresh_browser: usage of new variable DFO_BROWSER_PATH [BWo]
4.3.6	2018-06-13	sourcing .qcrc switched off
5.0     2018-08-02	supporting DFOS, PHOENIX, OPSHUB environments
5.0.1	2018-08-03	added MONITOR_TAG
5.0.2	2018-10-01	added shortcuts for OPSHUB
5.0.3	2018-10-22	OPSHUB: new link for DOCU; refresh_browser modified for firefox v52+; system monitors disabled
5.0.4	2018-11-16	OPSHUB: some format changes in upper table (nowrap); Q&A link for OPSHUB 
5.0.5	2018-12-19	bug fix for PHOENIX environment 
5.0.6	2019-03-19	OPSHUB: support for streams available in $OPSHUB_TOOL_PROJECT_FILE; support for pipeline_overview page; du is suppressed on opshub
5.0.7	2019-03-26	link to 'release notes' added
5.0.8	2019-04-16	dropped: system monitor for OPSHUB
5.0.9	2019-04-24	MAX_CORES=1 for opshub accounts; checks against other instances; all dfoMonitors refreshed if -X|-Y|-M
5.1	2020-10-22	DFOS_OPS: no call for science AB creation, no reference to PHOENIX project
5.1.1	2021-03-12	small bug fixes related to new runID format for DEEP mode