ESO Pipeline Meeting, 30 May - 1 June 2017

Travel to ESO

• Getting to ESO

Meeting Rooms

• Tuesday 30 May : Centaurus
• Wednesday 31 May: Tucana
• Thursday 1 June: Tucana
• Map of room locations

Participants

• External: Dirk Muders (Bonn), Stewart Williams (Edinburgh), Vincent Geers (Edinburgh)
• ESO: Federica, Dirk, Vinod, Vincent, Sandra, Fabrizia, Wolfgang, Andy, Liz, Martin, Suzanna, Felix, Federico, Paola

Meeting Dinner

• Gasthof Neuwirt, Garching, Wednesday 31 May
• Website

Agenda

Tuesday 30 May

• 1400 Welcome and introductions (Martin), purpose of meeting (Liz)
• 1420 Summary of decisions from the Obsmode meeting (Andy)
• 1440 Summary of decisions from the Pipeline F2F meeting (Liz)
• 1500 Imaging Pipeline: status and plans (Dirk Muders)
• 1600 Break
• 1620 Weblog status and plans (Stewart Williams)
  • Inside the Pipeline
  • Weblog and HPC Updates
  • Callibrary presentation location: https://www.eso.org/projects/alma/arc/tw/bin/view/External/PipelineHeuristicsMeeting
• 1720 End of day 1

Wednesday 31 May

• 0930 Automated flagging in Pipeline, calibration pipeline plans (Vincent Geers)
• 1030 QA2 at the EU ARC (Dirk Petry)
• 1130 Break
• 1145 Issues related to 7m array and SD, group processing (Thomas Stanke) - cancelled
• 1230 Lunch

• 1400 Practical issues in the EU Distributed System (Federica Palla)
• 1420 Operations Pipeline at the EU ARC (Vinod)
• 1440 AQUA Pipeline Agent (Fabrizia)
• 1500 PLWG activities at the EU ARC (Liz)
  • Second flagging report from Italian ARC Node
• 1520 Discussion/Break
  • CASA Parallelisation (Sandra)
• 1600 ARC Cheese and Wine
• 1700 End of day 2

Meeting Dinner: Gasthof Neuwirt, Garching 1830

Thursday 1 June

• 0930 AQUA plans and needs from Pipeline (Suzanna, ppt is attached below)
• 1030 Break
• 1200 alma_reimaging_stoehr.pdf (Felix)
• 1230 Collection of discussion items, how to feed them back, decide when to meet next
  • • Once per cycle
  • * How to use the resources of the EU ARC better (e.g. involve more EU ARC (Node) staff in Pipeline testing/development)
    • Example Requirements Document
    • Wish list of PL items people could work on in the ARCs (SSS provides?)
    • Action (Liz): meet with Evanthia and Martin to see what could happen, high level of commitment needed
  • Pipeline "Second Generation" development programme/ working group / discussion
    • Works for all telescopes worldwide?
    • Takes SRDP to the next level?
    • Action (Liz): Gather statistics to see what PIs want/what they are doing: User survey and CASA group, find out how much recalibration etc, pipeline versus manual, tell community
    • Nobeyama and other submm telescopes
    • Vinod could test on ATCA data
    • Own import steps
    • Keep flexible development
  • Portable Context
  • Make a continuum subtraction QA score from MOM8FC imaging of line-free channels. Add this score to the AQUA report.
  • Adding scores to accept = 'false' runs
  • Passing rms via Pipeline-AQUA report
  • Imaging a few channels in each spectral window
  • Group processing and EU Expertise
  • Export of bad antennas to pipeline-aqua report
  • How to protect antennas from being flagged
  • Flagging dry run capability?
  • Visibility Outlier work
  • Investigation of how consequential flagging is
  • Documentation improvement, and ask JH to add flagging task information to user documents
  • Use of rem_cloud in wvr correction
  • Issue reporting on SCOPS-1338
  • Add links to CASA Guides to the README
  • Check why NA wants to edit
  • ....
• 1315 End of meeting, lunch

• • Action (Maurizio): ask about getting tools into Operations testing early August
  • Action (Dirk): ask DRMs about the switch early
  • Action (Suzanna): AQUA demo, DRM-AQUA liasion telecons
  • Action (DRM+Maurizio): how to get manual into AQUA
  • Action (Maurizio+Suzanna+Dirk): Create poor mans weblog in AQUA for manual, Suzanna knows where, DRM will review after cal+imaging
  • Action (Suzanna): send ticket to Dirk
  • Action (Dirk): send example package to Suzanna
  • Action(Dirk, Suzanna, Maurizio): continue discussion offline
  • Action (Suzanna): Make sure it is easy to just change e.g. the data reducer, but Dirk should test what is there already first. Can batch script changes

syscal editing versioning

-- Elizabeth Humphreys - 2017-05-21

Comments

• PL_talk.key: PL_talk.key