Difference: PackagingScript (37 vs. 38)

Revision 382022-02-10 - DirkPetry

Line: 1 to 1

META TOPICPARENT	name="WebHome"

ALMA QA2 Packaging Script

Line: 18 to 18

For a standard script-generator-assisted analysis, you can continue to run the script in the following way:

Changed:

<
<

QA_Packager(origpath='/pathToMySB', readme='./README.header.txt', packpath='./20XX.1.00XXX.S', PIscript='/science/qa2/scriptForPI.py', style='cycle7-nopipe', mode='copy')

>
>

QA_Packager(origpath='/pathToMySB', readme='./README.header.txt', packpath='./20XX.1.00XXX.S', PIscript='/science/qa2/scriptForPI.py', style='cycle8-nopipe', mode='copy')

If you just want to test, set mode = 'fake'.

Line: 35 to 35

- mode = ’ticket’ : Use this to create the 'ticket.zip' file to attatch to the SCOPS ticket (see below).
- mode = ’copy’ : The files are copied in the normal way.
- mode = ’hard’ : The script generates hard links in the destination folder. This way, the file-pointers at both the origin and the destination folders, refer to the same physical locations (i.e., inodes) in the disk. This is the recommended way of packaging for noms=False, but if you use noms=True better use mode="copy" is better because it works across file systems.

Changed:

<
<

- mode = ’manimgonly’ : only the products of manual imaging (recognized by the string "manual" in the file names) and the corresponding scripts will be packaged using "copy")

>
>

- mode = ’manimgonly’ : only the products of manual imaging (recognized by the string "manual" in the file names) and the corresponding scripts will be packaged using "copy"; supplemental full pol. calibration will be picked up in the case of PL intensity calibration)

append (optional): The appending mode (see below).
- append = ’’ : This is the default. It removes any previous data at the destination folder before the packaging.
- append = ’group’ :The script appends a new group id to the destination folder (so the other groups, if any, are not removed).

Line: 50 to 50

- style = "cycle4-nopipe": so far (v1.49) same as cycle3-nopipe
- style = "cycle4-pipe": so far (v1.49) same as cycle3-pipe1
- style = "cycle5-nopipe", "cycle6-nopipe": same as cycle4-nopipe

Changed:

<
<

- style = "cycle5-pipe", "cycle6-pipe", "cycle7-pipe": taking into account naming changes (manifest, ppr) from the CASA 5.1.1 pipeline onwards

>
>

- style = "cycle5-pipe", "cycle6-pipe", "cycle7-pipe", "cycle8-pipe": taking into account naming changes (manifest, ppr) from the CASA 5.1.1 pipeline onwards

- default = "" (empty): ignore the parameter "style" and use the noms parameter instead

Line: 135 to 135

PIscript="./scriptForPI.py")

Changed:

<
<

NOTE: where it says "top dir of output package", what meant here is the directory that looks like this: origpath='analysis/2015.1.01247.S.MOUS.uid___A001_X2f6_X66.SBNAME.ULASJ1243_a_03_TE

>
>

NOTE: where it says "top dir of the analysis dir", what meant here is the directory that contains the "science_goal" directory, e.g. origpath='analysis/2015.1.01247.S.MOUS.uid___A001_X2f6_X66.SBNAME.ULASJ1243_a_03_TE

See section "Packaging of standard script-generator-assisted analysis products" for an explanation of the different "mode" options.

Line: 154 to 154

The result is QA2_PASS and now the manual imaging results are to be packaged for delivery.

Added:

>
>

NOTE: this also covers the case of full polarisation calibration after PL intensity calibration. The supplemental scriptForPolCalibration and the full pol. diagnostic plots will be picked up.

Then run the packager as follows:

       QA_Packager(origpath='<top dir of the analysis dir>',
                               packpath='<project id = top dir of output package>',
                               readme='<path to readme file>',
                               mode='man-img-only',

Changed:

<
<

style='cycle6-pipe', # this style needs to the chosen in this case

>
>

style='cycleX-pipe', # a -pipe style needs to the chosen in this case

PIscript="./scriptForPI.py") # overwrites the original scriptForPI.py if needed

Example:

Line: 168 to 170

packpath='./2018.100456.S', readme='myREADME.txt', mode='man-img-only',

Changed:

<
<

style='cycle6-pipe',

>
>

style='cycle8-pipe',

PIscript="./scriptForPI.py")

Changed:

<
<

NOTE again: where it says "top dir of output package", what meant here is the directory that looks like this: origpath='analysis/2015.1.01247.S.MOUS.uid___A001_X2f6_X66.SBNAME.ULASJ1243_a_03_TE

>
>

NOTE again: where it says "top dir of the analysis dir", what meant here is the directory that contains the "science_goal" directory, e.g. origpath='analysis/2015.1.01247.S.MOUS.uid___A001_X2f6_X66.SBNAME.ULASJ1243_a_03_TE

Packaging of TP data

Line: 218 to 220

Thanks very much to Ivan Marti-Vidal (Onsala) and Anita Richards (Manchester) for producing the original first useful version of the script.

Changed:

<
<

Dirk Petry - 2018-10-10

>
>

Dirk Petry - 2022-02-10

META FILEATTACHMENT	attachment="documentation.pdf" attr="" comment="September 2014 version of the packager documentation" date="1410523633" name="documentation.pdf" path="packaging_documentation.pdf" size="74934" stream="packaging_documentation.pdf" tmpFilename="/usr/tmp/CGItemp15204" user="DirkPetry" version="5"

View topic | History: r39 < r38 < r37 < r36 | More topic actions...