Service Mode Rules and Recommendations for Observation Blocks
Preparing Observation Blocks
Observations at all ESO telescopes are carried out by executing Observation Blocks (OBs) provided by the users. OBs for Service Mode runs with Paranal Instruments must be made with p2. For (designated) Visitor Mode observation preparation, please follow dedicated Visitor Mode Guidelines.
Please refer to the P2PP3 User Manual and to the User Manuals of the different instruments for more specific information on the structure and content of OBs, and how to build OBs for different instruments. A number of tutorials describing step-by-step the construction of OBs for different instruments is available.
Service Mode OBs: rules and advices
It is important to keep in mind the Service Mode policies and the following rules and guidelines when designing a Service Mode programme or when preparing a Phase 2 package:
- Some observing strategies cannot be supported in Service Mode; in particular, real-time decisions about the sequencing of OBs, complex OB sequencing, or decisions based on the outcome of previously executed OBs (like adjustment of integration times or execution of some OBs instead of others).
- OBs are only executed once. If you want to repeat an identical observation multiple times, you must submit multiple OBs. This requirement applies to standard stars as well.
- OBs are normally executed non-contiguously. Since efficient Service Mode operations require continuous flexibility to best match the OB constraints with actual observing conditions, OBs for a given programme may be scheduled non-contiguously. Therefore, users should not expect their OBs to be executed in a specific sequence or in a linked way, unless a sound scientific justification (indicated in the README file and approved with a Phase 2 Waiver in case of a contiguous execution lasting longer than 1 hr) exists. Approved OB sequences should then be prepared as concatenations. Exceptions to this rule are cases in which one OB observing a calibration source needs to be executed contiguously to a science OB. In such a case place both OBs into a concatenation scheduling container to enforce their contiguous execution.
- Multi-mode, multi-configuration OBs are normally not permitted in Service Mode. Although multiple configurations within one OB may sometimes reduce overheads, scheduling and calibrating such OBs is extremely inefficient and can increase the calibration load to an unsustainable level. Examples of such multi-configuration OBs are those combining imaging and spectroscopy in a single OB, spectroscopy with multiple grisms or multiple central wavelength settings, or imaging with a large number of filters (although most imagers allow multiple broadband filters in one OB). Multi-configuration OBs are accepted only if duly justified and authorized by means of a Phase 2 Waiver Request.
- OB execution times must be below 1 hour. Long OBs are more difficult to schedule and execute within the specified constraints because of the unpredictable evolution of the observing conditions. For this reason, OBs taking more than one hour to execute are accepted by ESO only in exceptional cases and provided that a Phase 2 Waiver Request is submitted and approved. In such cases, ESO will consider the OB successfully executed if the constraints were fulfilled during the first hour of execution, even if conditions degrade after that time.
- Concatenation scheduling container execution time must be below 1 hour and exceptionally for CRIRES instrument science+telluric standard concatenation must be below 1.5h. Only in exceptional cases, and provided that a Phase 2 Waiver Request is submitted and approved, longer concatenations may be submitted. In such cases, ESO will consider the concatenated OBs successfully executed if the constraints were fulfilled during the first hour of execution, even if conditions degrade after that time.
- User-provided calibration OBs that need to be executed contiguously with science OBs need to be specified via concatenation scheduling containers.
- Time constraints must be indicated in the OBs. If you intend to observe time-critical events or monitor a target at specific time windows, you need to indicate this under the Time Intervals tab of the OBs. Please note that absolute (UT) time constraints refer to the interval in which the OB can be started, whereas for Local Sidereal Time (LST) time intervals, the time interval refers to the entire duration of the OB. For monitoring observations it is often more appropriate to put OBs in a time-link container. Specifying time windows as broad as possible will reduce the possibilities that your OBs are not executed because of higher priority programmes or because the observing conditions did not allow the observations during the interval that you specified. Usage of absolute time intervals must be scientifically justified in the README file. Please read carefully the time-critial OB execution policy.
- Specify the weakest possible Constraint Set values. OBs that can be executed under a broad range of conditions are easier to schedule. In particular, if photometry is needed of a field, it is normally sufficient to obtain a short integration under photometric conditions (transparency = PHO) and carry out the rest of the integration with OBs having a transparency = CLR constraint.
Some OBs must be executed within precise time windows, rather than any time when the external conditions (moon, seeing, transparency...) would allow the execution. The following types of time-dependencies can be recognized:
- Absolute time constraints, meaning that an OB must be executed at specific dates that can be predetermined. An example is the observation of a binary star at a precise phase of its period.
- Relative time links, implying that an OB must be executed within a time interval after the execution of a previous OB, but not necessarily at a fixed date. Examples of this are monitoring observations of a variable source at roughly constant intervals.
Both types of time-dependency are implemented within p2. Whereas absolute time constraints are available at the level of single OBs, the relative time links are implemented within the new "Time Link" container.
Within a Time Link container, the user can define a series of OBs, having the earliest and latest time when a given OB in the series must be executed with respect to the preceding OB. The time-related information is stored in a database, from where it is retrieved by scheduling tools available to the operator on the mountain in order to build up a short-term schedule that properly takes these constraints into account.
In some cases it may be desired to execute the OBs consecutively, with no other observations in between. This has been implemented in p2 within the "Concatenation" container. The Concatenation container consists of two or more OBs that must be executed "back-to-back" without breaks. The sequence of the execution of OBs in a Concatenation follows the sequence as they are listed in the p2 window. However, please notice that this sequence is not strictly enforced during execution.
In P2PP v2 it was possible to assign an execution priority to each OB, so that the operator is aware of the ones that have a higher scientific importance at the time of deciding on observations to execute for a given programme.
It has been recognized nevertheless that such simple priority scheme is sometimes insufficient to deal with programmes containing large number of OBs, and especially for surveys containing large numbers of target fields observed in a number of instrumental setups. In such cases the need for a prioritization scheme above the individual OB level, which can take into account the past execution history of the programme, becomes clear. One can consider for instance the case of a survey of several target fields to be observed through several different filters, with each field and filter specified in a single OBs. Depending on the science goals of the programme it may be desirable to complete the observations of a given field in all filters before proceeding to the next field, or conversely to observe all the fields in a given filter before proceeding to the next filter, or even ensure that contiguous coverage among the fields takes priority.
The approach adopted to deal with such cases is the definition of Groups of OBs, in which internal priorities within each group are reflected in the form of a contribution of each OB to the total group score. The short-term scheduling tools available on the mountain will take into account the current scores of each group of OBs, and will then apply a number of rules in order to prioritize the possible OBs to be executed according to them. Such rules will for instance give the highest execution priority to those OBs that set a new maximum of the score among the existing groups; and among those, the highest priority will be given in turn to those that produce the largest increase in group score. By assigning to the OBs the appropriate contributions to the scores of their respective groups, the users can make sure that the progress in the execution of the programme will take place in a way that is consistent with the scientific priorities of the observations. In addition, it will be possible to assign different priorities to each group.
The Survey Area Definition Tool (SADT) is a utility developed by the VISTA consortium that allows users to define areas to be covered by surveys executed with either VIRCAM at VISTA or OmegaCam at the VST according to a number of criteria. The SADT determines the central coordinates of the different pointings required to cover the field according to the specifications, as well as ancillary guide star information to allow acquisition and guiding. The output produced is a file to be ingested into P2PP version 3 containing all the target information needed for the preparation of the OBs with which the survey will be executed.
Additional Service Mode Requirements for VIRCAM
The easiest and recommended way to prepare the OBs for VIRCAM on VISTA is to first run the Survey Area Definition Tool (SADT) to generate the list of central coordinates of pointings for each tile, together with the ancillary information about the available guide stars and active optics (aO) stars. In particular, for surveys that are using tile patterns with three or six offsets, the use of SADT is mandatory. It is recommended to use SADT even in cases where only a single pawprint is observed per OB - for that tile1 template should be used.
With the web-tool p2 the user defines the template OB, or alternatively, if necessary, the template container (group, time-link or concatenation of OBs) with its sub-structure, and selects all the parameters relevant for the survey (templates for acquisition and observation, filter(s), exposure times, jittering strategy, observing constraints, and OB execution time windows and priorities), except the target coordinates. The output of SADT, the survey definition file in XML format, is then imported to the template OB or container. This action duplicates the OBs (and containers) and supplies the information about pointing coordinates, guide stars and aO stars, and so automatically generates the OBs ready for execution.
Tutorials that describe how to define a survey area and how to prepare the VIRCAM OBs are available here.
Important notes and OB rules:
- The Tile Pattern has to be chosen already in SADT. Do not change the Tile Pattern in p2 after importing the survey definition (XML) file to your OBs!
- The Maximum Jitter Amplitude has to be set in the SADT configuration file that is located in the SADT installation subdirectory cfg/vista/sadt.cfg. It must have consistent size with the Jitter Pattern selected in the OBs in p2.
- Do not change the target coordinates in p2 after importing the survey definition (XML) file to your OBs!
- Do not manipulate any coordinate in the survey definition (XML) file by hand!
- The use of microsteps is discouraged. Tests during commissioning have shown that microstepping leads to distorted PSF shapes and problems for photometry.
- ToO observations: The most appropriate set of templates to use for TOO observations are the VIRCAM_img_acq_quick acquisition template in combination with the VIRCAM_img_obs_paw science template. The following parameters must be set in the acquisition template for ToO programmes in order place the image of the target (OB pointing coordinates) in Chip 11:
Selection of different parameters in the VIRCAM_img_acq_quick template requires an approved waiver request.
- OBs requesting seeing better than 1.0", which have (DIT+2)*NDIT shorter than 45 seconds, must set AO priority "HIGH" in the OB, or in the first OB of each concatenation. In exceptional cases OBs with AO priority "NORMAL" requiring seeing < 1.0" and having (DIT+2)*NDIT<45 sec may be accepted by ESO provided that a Phase 2 Waiver Request is submitted and approved.
- OBs containing more than one filter must have one filter per each observing template, unless using PFJME nesting. In exceptional cases multiple filters per template may be granted also for other nesting options provided that a Phase 2 Waiver Request is submitted and approved.
- Please run the verify script before submission and carefully read the WARNING messages if they appear