(r25) ESOCASAPipelineMeeting2019 < External

External Web>ESOCASAPipelineMeeting2019 (revision 25) (raw view)~~Raw edit~~ | ~~EditAttach~~
---+ ESO CASA and Pipeline Meeting - 15~17 May 2019

<br />%TOC%

---++ 1. Travel to ESO

   * [[https://www.eso.org/public/about-eso/travel/garching/][Getting to ESO and hotels in Garching]]
   * For a list of hotels in Munich please see [[http://www.muenchen.de/Tourismus/Accommodation_Hotels/7604/index.html][Munich hotels]]. If you prefer to stay in Munich, we suggest to choose a hotel close to the U6 metro line.
   * Visiting the ESO Supernova: [[https://supernova.eso.org/programme/calendar][programme]]

---++ 2. Participants
   * External:
      * Kana Sugimoto (NRAO - NM)
      * Ryan Raba (NRAO - CV),
      * Dirk Muders (MPIFR - Bonn),
      * Stewart Williams (UKRI-STFC - Edinburgh)
   * ESO:
      * Vinod Arumugam
      * Andy Biggs,
      * Sandra Castro,
      * Alex Chalevin
      * Maurizio Chavan,
      * Maria Diaz,
      * Enrique Garcia,
      * Justo Gonzalez,
      * Fabrizia Guglielmetti,
      * Liz Humphreys,
      * Luke Maud,
      * Stewart Mclay,
      * Federico Montesino,
      * Tony Mroczkowski,
      * Dirk Petry,
      * Suzanna Randall,
      * Erich Schmid
      * Felix Stoher,
      * Martin Zwaan
   * Remote participants via VC:
      * John Hibbard

---++ 3. Dinner in Munich

Date:
<div style="padding-left: 30px;"> *16th May at 19:30* </div> <literal>Place:</literal> <div style="padding-left: 30px;"> *Paulaner Bräuhaus* </div> <div style="padding-left: 30px;">Kapuzinerplatz 5, 80337 München</div> <div style="padding-left: 30px;">Telefon +49(0)89 / 544 611-0</div> <div style="padding-left: 30px;">https://www.paulaner-brauhaus.de/</div> <div style="padding-left: 30px;">Getting there by public transport from Garching: see this [[%ATTACHURLPATH%/PaulanerBraeuhausMap.pdf][map]].</div>

---++ 4. Agenda - Draft - Draft

*Meeting room: Pavo, A.2.01*
---++++ Wednesday, 15 May
   * 9:30 - Welcome and introductions (Sandra/Luke)
      * ESO Code of Conduct
   * 10:00 - Pipeline status today (Kana)
   * 10:30 - Overview of the Pipeline and how it works (Stewart W.)
   * 11:45 - Pipeline: weblogs, content, how, where, and what connections. Tips and Tricks (Stewart W.) - 60 min combined
   * 11:00 - Pipeline: imaging status and inside view (Dirk M.) - 45 min
   * 11:30 - Coffee break
   * 
   * 12:30 - Lunch
   * 14:00 - Pipeline development process and the Integration and Performance team (Ryan/Sandra)
   * 14:30 - Pipeline failures; MPI timeouts and what they mean (Federico)
   * 15:15 - Coffee break
   * 16:00 - CASA and Pipeline: status of parallelisation and performance (Federico/Sandra)
      * should we combine the above two topics?
---++++ Thursday, 16 May
   * 9:30 - CASA status (Ryan)
   * 10:00 - CASA forward plan for HPC testing, performance, benchmarking (Ryan)
   * 10:30 - CASA 6 and CASA next generation infrastructure (Ryan)
   * 11:30 - Coffee break
   * 11:45 - Ways forward on Virtual-columns+lazy import: how to be able to deliver calibrated MS to all users without having to store them (??)
   * 12:30 - Lunch
   * 14:00 - Summary of decisions from Pipeline <a href="https://www.eso.org/projects/alma/arc/tw/bin/edit/External/F2F?topicparent=External.ESOCASAPipelineMeeting2019;nowysiwyg=0" title="F2F (this topic does not yet exist; you can create it)">F2F</a> in March 2019 (Luke/Kana)
   * 14:30 - Status of EU PLWG (Luke)
   * 15:00 - Pipeline plans for Cycles 7, 8 and beyond (Kana)
   * 15:45 - Coffee break
   * ..... - Product ingestion problems: Can the PL tasks be used for manual data-reduction? (Felix/all)
   * 16:30 -
   * *Dinner at TBD*
---++++ Friday, 17 May
   * 9:30 - ESO QA2 overview (Dirk P.)
   * 10:00 - QA2 Manual Processing (??)
   * AQUA (Alex and Suzanna)
   * APA - AQUA Pipeline Agent (Fabrizia)
   * 
   * 11:15 - Coffee break
   * 11:30 - QA - how the EU ARC nodes work (TBD)
   * 12:00 - DARED and ADAPT (Maurizio)
   * ..... - CLAI - Cluster/ADAPT Interface (Alexis) - 10 min
   * ESO QA changes for Cycle 7 and beyond with the introduction of ADAPT
   * Lunch

   * Unique SPW IDs also across OUS: should we make a request to control? (Felix/all)
   * Group-level Processing, how to make best progress (Felix/all)
   * Antenna positions service (Federico)
   * Flux Service (Alisdair)
   * End of meeting

---++ 5. Summary of discussions

---++ 6. Action items

---++ 7. Input for Topics to Discuss

   * Pipeline
      * Pipeline: status and plans for Cycles 7, 8 and beyond (Kana)
      * An overview of flagging in pipeline stages (TBD)
      * Overview of the Pipeline and how it works (Stewart W.)
      * Pipeline scores (TBD)
      * Pipeline: imaging (Dirk M.)
      * Pipeline: weblogs, content, how, where, and what connections. Tips and Tricks (Stewart W.)
      * Pipeline failures; MPI timeouts and what they mean (Federico)
      * Pipeline development process and the Integration and Performance team (Ryan, Sandra)
   * CASA
      * CASA: status and plans (Ryan)
      * CASA 6, CASA next generation infrastructure (Ryan)
      * CASA forward plan for HPC testing, performance, benchmarking (Ryan)
      * CASA and Pipeline: status of parallelisation and performance (Federico/Sandra)
      * Ways forward on Virtual-columns+lazy import: how to be able to deliver calibrated MS to all users without having to store them
   * ESO QA2 and ingestion
      * QA2 overview (Dirk P.)
      * QA2 manual processing
         * Python 3 migration plans
         * Parallelisation of manual runs
      * QA.... (Vinod)
      * QA - how the ARC nodes work (TBD)
      * ESO QA changes for Cycle 7 and beyond with the introduction of ADAPT
      * Product ingestion problems: Can the PL tasks be used for manual data-reduction? (Felix/all)
   * Others
      * Summary of decisions from Pipeline F2F in March 2019
      * Status of EU PLWG (Luke)
      * Unique SPW IDs also across OUS: should we make a request to control? (Felix/all)
      * Group-level Processing, how to make best progress (Felix/all)
      * Discussion of EU development possibilities for better user products/choices
      * Use of EU cluster machines for CASA/PL development, best processes
   * Software specific
      * AQUA (Alex and Suzanna)
      * APA (AQUA Pipeline Agent) (Fabrizia)
      * DARED and ADAPT (Maurizio)
      * Flux Service (Alisdair)
      * Antenna positions service (Federico)

-- %USERSIG{SandraCastro - 2019-03-22}%
Attachments
Topic attachments
I	Attachment	History	Action	Size	Date	Who	Comment
pdf	PaulanerBraeuhausMap.pdf	r1	manage	1542.5 K	2019-04-30 - 16:04	SandraCastro	Paulaner Braeuhaus
Topic revision: r25 - 2019-05-02 - SandraCastro
External