Process and tooling recommendations for future Data Releases drawn from the experience of Data Preview 1

DMTN-321

Data Preview 1 was the first release of Rubin acquired, processed and published data. While DP1 achieved its goals and was released on time and to great success, we identified a number concerns that should be resolved before bigger data releases.

This document is a proposal for process and tooling improvements to cover the lifecycle from after the Pipelines processing through to Rubin Science Platform publication of the data release.

Links:

• Publication URL: https://dmtn-321.lsst.io
• Alternative editions: https://dmtn-321.lsst.io/v
• GitHub repository: https://github.com/lsst-dm/dmtn-321
• Build system: https://github.com/lsst-dm/dmtn-321/actions/

Build this technical note

You can clone this repository and build the technote locally if your system has Python 3.11 or later:

git clone https://github.com/lsst-dm/dmtn-321
cd dmtn-321
make init
make html

Repeat the make html command to rebuild the technote after making changes. If you need to delete any intermediate files for a clean build, run make clean.

The built technote is located at _build/html/index.html.

Publishing changes to the web

This technote is published to https://dmtn-321.lsst.io whenever you push changes to the main branch on GitHub. When you push changes to a another branch, a preview of the technote is published to https://dmtn-321.lsst.io/v.

Editing this technical note

The main content of this technote is in index.md (a Markdown file parsed as CommonMark/MyST). Metadata and configuration is in the technote.toml file. For guidance on creating content and information about specifying metadata and configuration, see the Documenteer documentation: https://documenteer.lsst.io/technotes.