DES science portal: Creating science-ready catalogs

A. Fausti Neto; L. N. da Costa; A. Carnero; J. Gschwend; R. L.C. Ogando; F. Sobreira; M. A.G. Maia; B. X. Santiago; R. Rosenfeld; C. Singulani; C. Adean; L. D.P. Nunes; R. Campisano; R. Brito; G. Soares; G. C. Vila-Verde; T. M.C. Abbott; F. B. Abdalla; S. Allam; A. Benoit-Lévy; D. Brooks; E. Buckley-Geer; D. Capozzi; M. Carrasco Kind; J. Carretero; C. B. D'Andrea; S. Desai; P. Doel; A. Drlica-Wagner; A. E. Evrard; P. Fosalba; J. García-Bellido; D. W. Gerdes; R. A. Gruendl; G. Gutierrez; K. Honscheid; D. J. James; T. E. Jeltema; K. Kuehn; S. Kuhlmann; N. Kuropatkin; O. Lahav; M. Lima; J. L. Marshall; P. Melchior; F. Menanteau; A. Plazas; E. Sanchez; V. Scarpine; R. Schindler; M. Schubnell; I. Sevilla-Noarbe; M. Smith; R. C. Smith; E. Suchyta; M. E.C. Swanson; G. Tarle; A. R. Walker

doi:10.1016/j.ascom.2018.01.002

DES science portal: Creating science-ready catalogs

A. Fausti Neto, L. N. da Costa, A. Carnero, J. Gschwend, R. L.C. Ogando, F. Sobreira, M. A.G. Maia, B. X. Santiago, R. Rosenfeld, C. Singulani, C. Adean, L. D.P. Nunes, R. Campisano, R. Brito, G. Soares, G. C. Vila-Verde, T. M.C. Abbott, F. B. Abdalla, S. Allam, A. Benoit-LévyD. Brooks, E. Buckley-Geer, D. Capozzi, M. Carrasco Kind, J. Carretero, C. B. D'Andrea, S. Desai, P. Doel, A. Drlica-Wagner, A. E. Evrard, P. Fosalba, J. García-Bellido, D. W. Gerdes, R. A. Gruendl, G. Gutierrez, K. Honscheid, D. J. James, T. E. Jeltema, K. Kuehn, S. Kuhlmann, N. Kuropatkin, O. Lahav, M. Lima, J. L. Marshall, P. Melchior, F. Menanteau, A. Plazas, E. Sanchez, V. Scarpine, R. Schindler, M. Schubnell, I. Sevilla-Noarbe, M. Smith, R. C. Smith, E. Suchyta, M. E.C. Swanson, G. Tarle, A. R. Walker

Research output: Contribution to journal › Article › Research › peer-review

2 Citations (Scopus)

Abstract

© 2018 Elsevier B.V. We present a novel approach for creating science-ready catalogs through a software infrastructure developed for the Dark Energy Survey (DES). We integrate the data products released by the DES Data Management and additional products created by the DES collaboration in an environment known as DES Science Portal. Each step involved in the creation of a science-ready catalog is recorded in a relational database and can be recovered at any time. We describe how the DES Science Portal automates the creation and characterization of lightweight catalogs for DES Year 1 Annual Release, and show its flexibility in creating multiple catalogs with different inputs and configurations. Finally, we discuss the advantages of this infrastructure for large surveys such as DES and the Large Synoptic Survey Telescope. The capability of creating science-ready catalogs efficiently and with full control of the inputs and configurations used is an important asset for supporting science analysis using data from large astronomical surveys.

Original language	English
Pages (from-to)	52-69
Journal	Astronomy and Computing
Volume	24
DOIs	https://doi.org/10.1016/j.ascom.2018.01.002
Publication status	Published - 1 Jul 2018

Keywords

Astronomical databases
Catalogs
Data analysis
Surveys—methods

Access to Document

10.1016/j.ascom.2018.01.002

Fingerprint Dive into the research topics of 'DES science portal: Creating science-ready catalogs'. Together they form a unique fingerprint.

Cite this

Fausti Neto, A., da Costa, L. N., Carnero, A., Gschwend, J., Ogando, R. L. C., Sobreira, F., Maia, M. A. G., Santiago, B. X., Rosenfeld, R., Singulani, C., Adean, C., Nunes, L. D. P., Campisano, R., Brito, R., Soares, G., Vila-Verde, G. C., Abbott, T. M. C., Abdalla, F. B., Allam, S., ... Walker, A. R. (2018). DES science portal: Creating science-ready catalogs. Astronomy and Computing, 24, 52-69. https://doi.org/10.1016/j.ascom.2018.01.002

Fausti Neto, A. ; da Costa, L. N. ; Carnero, A. ; Gschwend, J. ; Ogando, R. L.C. ; Sobreira, F. ; Maia, M. A.G. ; Santiago, B. X. ; Rosenfeld, R. ; Singulani, C. ; Adean, C. ; Nunes, L. D.P. ; Campisano, R. ; Brito, R. ; Soares, G. ; Vila-Verde, G. C. ; Abbott, T. M.C. ; Abdalla, F. B. ; Allam, S. ; Benoit-Lévy, A. ; Brooks, D. ; Buckley-Geer, E. ; Capozzi, D. ; Carrasco Kind, M. ; Carretero, J. ; D'Andrea, C. B. ; Desai, S. ; Doel, P. ; Drlica-Wagner, A. ; Evrard, A. E. ; Fosalba, P. ; García-Bellido, J. ; Gerdes, D. W. ; Gruendl, R. A. ; Gutierrez, G. ; Honscheid, K. ; James, D. J. ; Jeltema, T. E. ; Kuehn, K. ; Kuhlmann, S. ; Kuropatkin, N. ; Lahav, O. ; Lima, M. ; Marshall, J. L. ; Melchior, P. ; Menanteau, F. ; Plazas, A. ; Sanchez, E. ; Scarpine, V. ; Schindler, R. ; Schubnell, M. ; Sevilla-Noarbe, I. ; Smith, M. ; Smith, R. C. ; Suchyta, E. ; Swanson, M. E.C. ; Tarle, G. ; Walker, A. R. / DES science portal: Creating science-ready catalogs. In: Astronomy and Computing. 2018 ; Vol. 24. pp. 52-69.

@article{9fdc4dce84b54fd483c03df8db408c43,

title = "DES science portal: Creating science-ready catalogs",

abstract = "{\textcopyright} 2018 Elsevier B.V. We present a novel approach for creating science-ready catalogs through a software infrastructure developed for the Dark Energy Survey (DES). We integrate the data products released by the DES Data Management and additional products created by the DES collaboration in an environment known as DES Science Portal. Each step involved in the creation of a science-ready catalog is recorded in a relational database and can be recovered at any time. We describe how the DES Science Portal automates the creation and characterization of lightweight catalogs for DES Year 1 Annual Release, and show its flexibility in creating multiple catalogs with different inputs and configurations. Finally, we discuss the advantages of this infrastructure for large surveys such as DES and the Large Synoptic Survey Telescope. The capability of creating science-ready catalogs efficiently and with full control of the inputs and configurations used is an important asset for supporting science analysis using data from large astronomical surveys.",

keywords = "Astronomical databases, Catalogs, Data analysis, Surveys—methods",

author = "{Fausti Neto}, A. and {da Costa}, {L. N.} and A. Carnero and J. Gschwend and Ogando, {R. L.C.} and F. Sobreira and Maia, {M. A.G.} and Santiago, {B. X.} and R. Rosenfeld and C. Singulani and C. Adean and Nunes, {L. D.P.} and R. Campisano and R. Brito and G. Soares and Vila-Verde, {G. C.} and Abbott, {T. M.C.} and Abdalla, {F. B.} and S. Allam and A. Benoit-L{\'e}vy and D. Brooks and E. Buckley-Geer and D. Capozzi and {Carrasco Kind}, M. and J. Carretero and D'Andrea, {C. B.} and S. Desai and P. Doel and A. Drlica-Wagner and Evrard, {A. E.} and P. Fosalba and J. Garc{\'i}a-Bellido and Gerdes, {D. W.} and Gruendl, {R. A.} and G. Gutierrez and K. Honscheid and James, {D. J.} and Jeltema, {T. E.} and K. Kuehn and S. Kuhlmann and N. Kuropatkin and O. Lahav and M. Lima and Marshall, {J. L.} and P. Melchior and F. Menanteau and A. Plazas and E. Sanchez and V. Scarpine and R. Schindler and M. Schubnell and I. Sevilla-Noarbe and M. Smith and Smith, {R. C.} and E. Suchyta and Swanson, {M. E.C.} and G. Tarle and Walker, {A. R.}",

year = "2018",

month = jul,

day = "1",

doi = "10.1016/j.ascom.2018.01.002",

language = "English",

volume = "24",

pages = "52--69",

journal = "Astronomy and Computing",

issn = "2213-1337",

publisher = "Elsevier BV",

}

Fausti Neto, A, da Costa, LN, Carnero, A, Gschwend, J, Ogando, RLC, Sobreira, F, Maia, MAG, Santiago, BX, Rosenfeld, R, Singulani, C, Adean, C, Nunes, LDP, Campisano, R, Brito, R, Soares, G, Vila-Verde, GC, Abbott, TMC, Abdalla, FB, Allam, S, Benoit-Lévy, A, Brooks, D, Buckley-Geer, E, Capozzi, D, Carrasco Kind, M, Carretero, J, D'Andrea, CB, Desai, S, Doel, P, Drlica-Wagner, A, Evrard, AE, Fosalba, P, García-Bellido, J, Gerdes, DW, Gruendl, RA, Gutierrez, G, Honscheid, K, James, DJ, Jeltema, TE, Kuehn, K, Kuhlmann, S, Kuropatkin, N, Lahav, O, Lima, M, Marshall, JL, Melchior, P, Menanteau, F, Plazas, A, Sanchez, E, Scarpine, V, Schindler, R, Schubnell, M, Sevilla-Noarbe, I, Smith, M, Smith, RC, Suchyta, E, Swanson, MEC, Tarle, G & Walker, AR 2018, 'DES science portal: Creating science-ready catalogs', Astronomy and Computing, vol. 24, pp. 52-69. https://doi.org/10.1016/j.ascom.2018.01.002

DES science portal: Creating science-ready catalogs. / Fausti Neto, A.; da Costa, L. N.; Carnero, A.; Gschwend, J.; Ogando, R. L.C.; Sobreira, F.; Maia, M. A.G.; Santiago, B. X.; Rosenfeld, R.; Singulani, C.; Adean, C.; Nunes, L. D.P.; Campisano, R.; Brito, R.; Soares, G.; Vila-Verde, G. C.; Abbott, T. M.C.; Abdalla, F. B.; Allam, S.; Benoit-Lévy, A.; Brooks, D.; Buckley-Geer, E.; Capozzi, D.; Carrasco Kind, M.; Carretero, J.; D'Andrea, C. B.; Desai, S.; Doel, P.; Drlica-Wagner, A.; Evrard, A. E.; Fosalba, P.; García-Bellido, J.; Gerdes, D. W.; Gruendl, R. A.; Gutierrez, G.; Honscheid, K.; James, D. J.; Jeltema, T. E.; Kuehn, K.; Kuhlmann, S.; Kuropatkin, N.; Lahav, O.; Lima, M.; Marshall, J. L.; Melchior, P.; Menanteau, F.; Plazas, A.; Sanchez, E.; Scarpine, V.; Schindler, R.; Schubnell, M.; Sevilla-Noarbe, I.; Smith, M.; Smith, R. C.; Suchyta, E.; Swanson, M. E.C.; Tarle, G.; Walker, A. R.

In: Astronomy and Computing, Vol. 24, 01.07.2018, p. 52-69.

Research output: Contribution to journal › Article › Research › peer-review

TY - JOUR

T1 - DES science portal: Creating science-ready catalogs

AU - Fausti Neto, A.

AU - da Costa, L. N.

AU - Carnero, A.

AU - Gschwend, J.

AU - Ogando, R. L.C.

AU - Sobreira, F.

AU - Maia, M. A.G.

AU - Santiago, B. X.

AU - Rosenfeld, R.

AU - Singulani, C.

AU - Adean, C.

AU - Nunes, L. D.P.

AU - Campisano, R.

AU - Brito, R.

AU - Soares, G.

AU - Vila-Verde, G. C.

AU - Abbott, T. M.C.

AU - Abdalla, F. B.

AU - Allam, S.

AU - Benoit-Lévy, A.

AU - Brooks, D.

AU - Buckley-Geer, E.

AU - Capozzi, D.

AU - Carrasco Kind, M.

AU - Carretero, J.

AU - D'Andrea, C. B.

AU - Desai, S.

AU - Doel, P.

AU - Drlica-Wagner, A.

AU - Evrard, A. E.

AU - Fosalba, P.

AU - García-Bellido, J.

AU - Gerdes, D. W.

AU - Gruendl, R. A.

AU - Gutierrez, G.

AU - Honscheid, K.

AU - James, D. J.

AU - Jeltema, T. E.

AU - Kuehn, K.

AU - Kuhlmann, S.

AU - Kuropatkin, N.

AU - Lahav, O.

AU - Lima, M.

AU - Marshall, J. L.

AU - Melchior, P.

AU - Menanteau, F.

AU - Plazas, A.

AU - Sanchez, E.

AU - Scarpine, V.

AU - Schindler, R.

AU - Schubnell, M.

AU - Sevilla-Noarbe, I.

AU - Smith, M.

AU - Smith, R. C.

AU - Suchyta, E.

AU - Swanson, M. E.C.

AU - Tarle, G.

AU - Walker, A. R.

PY - 2018/7/1

Y1 - 2018/7/1

N2 - © 2018 Elsevier B.V. We present a novel approach for creating science-ready catalogs through a software infrastructure developed for the Dark Energy Survey (DES). We integrate the data products released by the DES Data Management and additional products created by the DES collaboration in an environment known as DES Science Portal. Each step involved in the creation of a science-ready catalog is recorded in a relational database and can be recovered at any time. We describe how the DES Science Portal automates the creation and characterization of lightweight catalogs for DES Year 1 Annual Release, and show its flexibility in creating multiple catalogs with different inputs and configurations. Finally, we discuss the advantages of this infrastructure for large surveys such as DES and the Large Synoptic Survey Telescope. The capability of creating science-ready catalogs efficiently and with full control of the inputs and configurations used is an important asset for supporting science analysis using data from large astronomical surveys.

AB - © 2018 Elsevier B.V. We present a novel approach for creating science-ready catalogs through a software infrastructure developed for the Dark Energy Survey (DES). We integrate the data products released by the DES Data Management and additional products created by the DES collaboration in an environment known as DES Science Portal. Each step involved in the creation of a science-ready catalog is recorded in a relational database and can be recovered at any time. We describe how the DES Science Portal automates the creation and characterization of lightweight catalogs for DES Year 1 Annual Release, and show its flexibility in creating multiple catalogs with different inputs and configurations. Finally, we discuss the advantages of this infrastructure for large surveys such as DES and the Large Synoptic Survey Telescope. The capability of creating science-ready catalogs efficiently and with full control of the inputs and configurations used is an important asset for supporting science analysis using data from large astronomical surveys.

KW - Astronomical databases

KW - Catalogs

KW - Data analysis

KW - Surveys—methods

U2 - 10.1016/j.ascom.2018.01.002

DO - 10.1016/j.ascom.2018.01.002

M3 - Article

VL - 24

SP - 52

EP - 69

JO - Astronomy and Computing

JF - Astronomy and Computing

SN - 2213-1337

ER -