Skip to content

Commit

Permalink
Merge pull request #16 from lsst-pst/tickets/DM-43870
Browse files Browse the repository at this point in the history
DM-43870: Add text about FrDF
  • Loading branch information
airnandez authored Jul 30, 2024
2 parents cd8260a + 818df6e commit 826b880
Show file tree
Hide file tree
Showing 2 changed files with 23 additions and 0 deletions.
8 changes: 8 additions & 0 deletions datafacilities.tex
Original file line number Diff line number Diff line change
Expand Up @@ -8,6 +8,14 @@ \subsubsection{US Data Facility} \label{sec:usdf}

\subsubsection{French Data Facility} \label{sec:frdf}

The computing centre of France's National institute of nuclear and particle physics (IN2P3)\footnote{\url{https://cc.in2p3.fr}} hosts and operates Rubin's French Data Facility (FrDF)\footnote{\url{https://doc.lsst.eu}}. This computing and storage infrastructure is sized to store a full copy of the raw images as well as to contribute $40\%$ of the image processing capacity required to produce the Data Releases, for the duration of the observatory's operations phase.

A compute element exposes the site's batch farm to Rubin's central campaign management system and a Butler-compatible storage element (see \autoref{sec:dataabstraction}) stores input data as well as locally-produced data products. At the end of each processing campaign, final products are replicated to the US Data Facility where they are combined for composing the Data Release.

FrDF builds and packages the LSST Science Pipelines for distribution via a software content distribution based on CERN's CernVM File System\footnote{\url{https://sw.lsst.eu}}. This distribution mechanism, which all the Rubin data facilities subscribe to, ensures that they all use an identical copy of the pipelines for the purposes of producing the Data Releases.

In addition, the French Data Facility contributes to perform realistic test campaigns of Rubin's distributed system being developed to prepare the Data Releases, including the development of the inter-facility data replication system. Evaluation instances of the Rubin Science Platform and the catalog database have been locally deployed continuously since several years. The facility also hosts Fink \citep{10.1093/mnras/staa3602}, one of the Rubin community alert brokers.

\subsubsection{UK Data Facility} \label{sec:ukdf}

UK interest in the Vera C. Rubin Observatory is coordinated by the LSST:UK Consortium, which has 36 partners representing all major UK astronomy research groups.
Expand Down
15 changes: 15 additions & 0 deletions local.bib
Original file line number Diff line number Diff line change
Expand Up @@ -46,3 +46,18 @@ @INPROCEEDINGS{2022SPIE12182E..0WT
adsurl = {https://ui.adsabs.harvard.edu/abs/2022SPIE12182E..0WT},
adsnote = {Provided by the SAO/NASA Astrophysics Data System}
}

@ARTICLE{10.1093/mnras/staa3602,
author = {Möller, Anais and Peloton, Julien and Ishida, Emille E O and Arnault, Chris and Bachelet, Etienne and Blaineau, Tristan and Boutigny, Dominique and Chauhan, Abhishek and Gangler, Emmanuel and Hernandez, Fabio and Hrivnac, Julius and Leoni, Marco and Leroy, Nicolas and Moniez, Marc and Pateyron, Sacha and Ramparison, Adrien and Turpin, Damien and Ansari, Réza and Allam Jr, Tarek and Bajat, Armelle and Biswas, Biswajit and Boucaud, Alexandre and Bregeon, Johan and Campagne, Jean-Eric and Cohen-Tanugi, Johann and Coleiro, Alexis and Dornic, Damien and Fouchez, Dominique and Godet, Olivier and Gris, Philippe and Karpov, Sergey and Nebot Gomez-Moran, Ada and Neveu, Jérémy and Plaszczynski, Stephane and Savchenko, Volodymyr and Webb, Natalie},
title = "{fink, a new generation of broker for the LSST community}",
journal = {Monthly Notices of the Royal Astronomical Society},
volume = {501},
number = {3},
pages = {3272-3288},
year = {2020},
month = {11},
issn = {0035-8711},
doi = {10.1093/mnras/staa3602},
url = {https://doi.org/10.1093/mnras/staa3602},
eprint = {https://academic.oup.com/mnras/article-pdf/501/3/3272/35655965/staa3602.pdf},
}

0 comments on commit 826b880

Please sign in to comment.