Experience and future plans for Fermi Gamma-Ray Space Telescope LAT data processing pipeline, collaboration data servers and web based data monitoring tools.

Tony Johnson (SLAC National Accelerator Laboratory)

Abstract

Reconstruction, monitoring and initial automated science processing (ASP) of Fermi LAT data is controlled by a fully automated processing pipeline running at the SLAC National Accelerator Laboratory. This pipeline allows complex graphs of parallel data processing tasks to be constructed and executed with manual intervention by operators only required in exceptional circumstances. A suite of web applications allows the state of the processing pipeline to be monitored in real-time, presents the results of data quality monitoring and ASP analysis to scientists, and makes the final data available to collaborating scientists via a set of data servers. These technologies together make it possible for scientists to contribute to the data processing, data monitoring and data analysis from anywhere with a web connection. This poster will presents lessons learned from the first 3 years of operation, recent improvements and future plans for maintaining these systems for the lifetime of the Fermi mission.

Paper ID: P064

Poster Instructions