(r23) ESOPipelineMeeting < External

External Web>ESOPipelineMeeting (revision 23) (raw view)~~Raw edit~~ | ~~EditAttach~~

---+ ESO Pipeline Meeting, 30 May - 1 June 2017

%TOC%
---++ Travel to ESO
   * <span style="background-color: transparent;"> [[http://www.eso.org/public/about-eso/travel/garching/][Getting to ESO]]</span>
---++ Meeting Rooms
   * <span style="background-color: transparent;">Tuesday 30 May : Centaurus</span>
   * <span style="background-color: transparent;">Wednesday 31 May: Tucana</span>
   * <span style="background-color: transparent;">Thursday 1 June: Tucana</span>
   * [[http://www.eso.org/public/images/campus_map/][Map of room locations]]
---++ Participants
   * <span style="background-color: transparent;">External: Dirk Muders (Bonn), Stewart Williams (Edinburgh), Vincent Geers (Edinburgh)</span>
   * <span style="background-color: transparent;">ESO: Federica, Dirk, Vinod, Vincent, Sandra, Fabrizia, Wolfgang, Andy, Liz, Martin, Suzanna, Felix, Federico, Paola</span>
---++ Meeting Dinner
   * <span style="background-color: transparent;">Gasthof Neuwirt, Garching, Wednesday 31 May</span>
   * <span style="background-color: transparent;"> [[http://gasthof-neuwirt.org][Website]]</span>
---++ Agenda
---+++ Tuesday 30 May

   * *1400 Welcome and introductions (Martin), purpose of meeting (Liz)*
   * 1420 [[%ATTACHURL%/ObsModes6.pdf][Summary of decisions from the Obsmode meeting (Andy)]]
   * 1440 [[%ATTACHURL%/summary_pipelinef2f_v2.pdf][Summary of decisions from the Pipeline !F2F meeting (Liz)]]
   * 1500 [[%ATTACHURL%/Interferometry-Imaging-Status-EU-ARC-May-2017.pdf][Imaging Pipeline: status and plans (Dirk Muders)]]
   * *1600 Break*
   * 1620 Weblog status and plans (Stewart Williams)
      * [[%ATTACHURL%/Inside_the_Pipeline.pdf][Inside the Pipeline]]
      * [[%ATTACHURL%/Weblog_HPC.pdf][Weblog and HPC Updates]]
   * *1720 End of day 1*
---+++ Wednesday 31 May

   * *0930 [[%ATTACHURLPATH%/201705_vcg_flagging.pdf][Automated flagging in Pipeline, calibration pipeline plans (Vincent Geers)]]*
   * 1030 [[%ATTACHURLPATH%/qa2-at-the-euarc-may2017.pdf][QA2 at the EU ARC (Dirk Petry)]]
   * *1130 Break*
   * 1145 Issues related to 7m array and SD, group processing (Thomas Stanke) - cancelled
   * *1230 Lunch*

   * *1400 [[%ATTACHURL%/EU_distributed_system.pdf][Practical issues in the EU Distributed System (Federica Palla)]]*
   * 1420 [[%ATTACHURL%/PL_talk.pdf][Operations Pipeline at the EU ARC (Vinod)]]
   * 1440 [[%ATTACHURL%/APA_Garching2017.pdf][AQUA Pipeline Agent (Fabrizia)]]
   * 1500 [[%ATTACHURL%/PLWGactivities_EUARC.pdf][PLWG activities at the EU ARC (Liz)]]
      * [[%ATTACHURL%/pipeline_flagging_2_FINAL.pdf][Second flagging report from Italian ARC Node]]
   * *1520 Discussion/Break*
      * [[%ATTACHURL%/ARCPipelineMeeting.pdf][CASA Parallelisation (Sandra)]]
   * 1600 ARC Cheese and Wine
   * *1700 End of day 2*

*Meeting Dinner: Gasthof Neuwirt, Garching 1830*
---+++ Thursday 1 June

   * *0930 AQUA plans and needs from Pipeline (Suzanna)*
   * *1030 Break*
   * 1200 [[%ATTACHURL%/alma_reimaging_stoehr.pdf][alma_reimaging_stoehr.pdf]] (Felix)
   * 1230 Collection of discussion items, how to feed them back, *decide when to meet next*
      * 
         * Once per cycle
      * * *How to use the resources of the EU ARC better (e.g. involve more EU ARC (Node) staff in Pipeline testing/development)*
         * [[%ATTACHURL%/iPlCy4_23may2016.pdf][Example Requirements Document]]
         * Wish list of PL items people could work on in the ARCs (SSS provides?)
         * Action (Liz): meet with Evanthia and Martin to see what could happen, high level of commitment needed
      * *Pipeline "Second Generation" development programme/ working group / discussion*
         * *Works for all telescopes worldwide?*
         * *Takes SRDP to the next level?*
         * Action (Liz): Gather statistics to see what PIs want/what they are doing: User survey and CASA group, find out how much recalibration etc, pipeline versus manual, tell community
         * Nobeyama and other submm telescopes
         * Vinod could test on ATCA data
         * Own import steps
         * Keep flexible development
      * Portable Context
      * Make a continuum subtraction QA score from MOM8FC imaging of line-free channels. Add this score to the AQUA report.
      * Adding scores to accept = 'false' runs
      * Passing rms via Pipeline-AQUA report
      * Imaging a few channels in each spectral window
      * Group processing and EU Expertise
      * Export of bad antennas to pipeline-aqua report
      * How to protect antennas from being flagged
      * Flagging dry run capability?
      * Visibility Outlier work
      * Investigation of how consequential flagging is
      * Documentation improvement, and ask JH to add flagging task information to user documents
      * Use of rem_cloud in wvr correction
      * Issue reporting on SCOPS-1338
      * Add links to CASA Guides to the README
      * Check why NA wants to edit
      * ....
   * *1315 End of meeting, lunch*

   * 
      * Action (Maurizio): ask about getting tools into Operations testing early August
      * Action (Dirk): ask DRMs about the switch early
      * Action (Suzanna): AQUA demo, DRM-AQUA liasion telecons
      * Action (DRM+Maurizio): how to get manual into AQUA
      * Action (Maurizio+Suzanna+Dirk): Create poor mans weblog in AQUA for manual, Suzanna knows where, DRM will review after cal+imaging
      * Action (Suzanna): send ticket to Dirk
      * Action (Dirk): send example package to Suzanna
      * Action(Dirk, Suzanna, Maurizio): continue discussion offline
      * Action (Suzanna): Make sure it is easy to just change e.g. the data reducer, but Dirk should test what is there already first. Can batch script changes

syscal editing
versioning

-- %USERSIG{ElizabethHumphreys - 2017-05-21}%

---++ Comments

<br />%COMMENT%

   * [[%ATTACHURLPATH%/PL_talk.key][PL_talk.key]]: PL_talk.key

Attachments

Topic attachments
I	Attachment	History	Action	Size	Date	Who	Comment
pdf	201705_vcg_flagging.pdf	r1	manage	1878.7 K	2017-05-31 - 13:08	ElizabethHumphreys
pdf	APA_Garching2017.pdf	r1	manage	1911.8 K	2017-05-31 - 13:29	FabriziaGuglielmetti
pdf	ARCPipelineMeeting.pdf	r1	manage	677.6 K	2017-06-01 - 09:37	ElizabethHumphreys	Slides from Sandra Castro
pdf	EU_distributed_system.pdf	r1	manage	2826.6 K	2017-05-31 - 12:31	UnknownUser
pdf	Inside_the_Pipeline.pdf	r1	manage	224.8 K	2017-05-31 - 12:42	ElizabethHumphreys	Stewart Williams
pdf	Interferometry-Imaging-Status-EU-ARC-May-2017.pdf	r1	manage	482.5 K	2017-05-31 - 12:35	ElizabethHumphreys
pdf	ObsModes6.pdf	r2 r1	manage	135.6 K	2017-05-30 - 15:05	UnknownUser	Talk by Biggs summarising the Cycle-6 ObsMode meeting
pdf	PLWGactivities_EUARC.pdf	r1	manage	1359.7 K	2017-05-30 - 21:48	ElizabethHumphreys
key	PL_talk.key	r1	manage	3089.8 K	2017-06-01 - 09:34	UnknownUser
pdf	PL_talk.pdf	r1	manage	1542.4 K	2017-06-01 - 09:48	ElizabethHumphreys	Slides from Vinod
pdf	Weblog_HPC.pdf	r1	manage	187.4 K	2017-05-31 - 12:45	ElizabethHumphreys
pdf	alma_reimaging_stoehr.pdf	r1	manage	591.3 K	2017-06-01 - 09:48	FelixStoehr
pptx	aqua_euplmeeting_2017.pptx	r1	manage	5512.7 K	2017-06-06 - 11:14	SuzannaRandall	Talk by Suzanna on proposed Cycle 5 workflow and AQUA
pdf	iPlCy4_23may2016.pdf	r1	manage	827.7 K	2017-06-01 - 09:44	ElizabethHumphreys
pdf	pipeline_flagging_2_FINAL.pdf	r1	manage	1813.0 K	2017-05-31 - 12:52	ElizabethHumphreys	Second Flagging Report from Italian ARC Node
pdf	qa2-at-the-euarc-may2017.pdf	r3 r2 r1	manage	1342.2 K	2017-05-31 - 13:49	DirkPetry	Talk by Dirk Petry
pdf	summary_pipelinef2f.pdf	r1	manage	137.4 K	2017-05-28 - 23:08	ElizabethHumphreys
pdf	summary_pipelinef2f_v2.pdf	r1	manage	919.1 K	2017-05-30 - 11:03	ElizabethHumphreys

Topic revision: r23 - 2017-06-06 - SuzannaRandall

External