|Meeting Date||20191001 - 20191002||Ref||HELIO-MOM-0003|
|Meeting Place||ETH Zurich||Chairman||Harra, L., MSSL, UK|
|Minute's Date||20190107 (draft)||Participants|
Chen, C., QMW college, UK
|Subject||Minutes of the 4th Heliophysics Archives USer group meeting||Copy|
Scope of this meeting
On the first day, this meeting was mainly dedicated to the following theme: does ESA heliophysics archives shall archive in the long term any of the H2020/FP7 high value added datasets or products based on ESA heliophysics archives data? Would the newly created ESA Guest Storage Facility (GSF) within the Planetary Science Archive (PSA) be the approriate place for some of these products? The GSF makes use of DOIs to link these value added products to the data in the PSA. A report was presented by Guido de Marchi on how DOIs are planned to be implemented for the various data collections contained in the ESA science archives. Finally, an update of the content of the SOHO archives at GSFC and ESDC were also presented as a follow up of the review of the SOHO archive by the HAUS group members.
The second day was mainly focused on science cases that a potential future multi-missions heliophysics archives could be based upon.
October 1, starts at 2 pm
14:00-14:30 Guest Storage Facility (S. Besse)
14:30-15:00 ESDC archives and DOIs (G. DeMarchi)
15:00-15:40 SOHO archive update (B. Fleck/A.Masson)
15:40-16:15 Coffee break/(telecon with SSEWG, GdM/AM)
16:15-16:45 PSA main functionalities (S. Besse)
16:45-17:15 Wrap-up of the review of FP7/H2020 Heliophysics projects (A. Masson)
17:15-18:00 Open discussion on the ESA GSF and its possible use wrt heliophysics value added products (All)
October 2, starts at 08:45 am
08:45-09:00 Actual plans for the future SMILE archive (A. Masson)
09:00-09:45 The new Proba-2 archive and Jupyter Notebook (A. Masson based on a PPT from J. Cook at the Proba 2 given in Feb. 19)
09:45–11:15 Science cases that should be supported by a future ESA overarching heliophysics archive (15 mn each participant)
11:15-11:45 Coffee Break
11:45-12:15 Popular practises to visualize and download helio data, access metadata etc. (5 mn each)
12:15-12:45 List of recommendations to SSEWG (not minuted)
Guest Storage Facility
The Guest Storage Facility (GSF) is at the moment hosted in the FTP server of the Planetary Science Archive (PSA). It allows to archive and preserve in the long term value added products from or highly related to ESA planetary missions data. No data format is required contrary to the PSA where only datasets/bundles in PDS3 or PDS4 data format are stored. Any value added product submitted by a research group to the PSA/GSF shall be described in a few pages long document called product user guide. The value added product and its product user guide are reviewed by the PSA lead scientist and related archive and project scientist. Once approved, an ESA DOI is generated while its related landing page is populated and managed by ESA describing this product and acknowledging the data producer. At the moment, one data product is available in the GSF while several are in the pipeline.
This data product is described in the following paper
Putri, A. R. D., Sidiropoulos, P., Muller, J. P., Walter, S. H., & Michael, G. G. (2019). A New South Polar Digital Terrain Model of Mars from the High Resolution Stereo Camera (HRSC) onboard the ESA Mars Express. Planetary and Space Science. DOI: 10.1016/j.pss.2019.02.010
In the acknowledgement of this paper, the following ESA DOI is mentioned https://doi.org/10.5270/esa-0j79yk8. This DOI is a permanent link to a landing page, managed by ESA, where a direct link to the data stored on the GSF is available.
Discussion: on purpose, there is a grey zone of what can and cannot be accepted/ingested in the GSF, a debate which is still on-going. The GSF will be reviewed internally after one year to check its usage and scientific relevance. Its name may change but it should be underlined that the scientific community pushed for its creation, in particular by research groups who did not find ways for the long term preservation of their year(s)-long effort highly processed (derived) datasets. A discussion started among HAUS group members about the relevance of this approach for similar value added products in the heliophysics archives context.
ESDC archives and DOIs
(G. De Marchi)
Presentation of the ESA current plans to attribute DOIs to the datasets and data collections contained in all ESA science missions (astronomy, planetary and heliophysics). Please note that this presentation reflects a proposal to the missions stakeholders that have not yet fully approved it, hence subject to changes.
SOHO archive update
(B. Fleck/A. Masson)
Update of the content of the SOHO archive at GSFC per SOHO experiment by the SOHO project scientist/mission manager, followed by a report on recent updates performed on the SOHO archive at ESAC to align its content to the GSFC archive while improving the metadata display and content.
PSA main functionalities
In order to fuel the discussion of a potential overarching heliophysics archives, a presentation of the ESA overarching planetary missions archives (PSA) was presented.
Wrap-up of the review of EU FP7/H2020 Heliophysics projects
A number of value added products based or related to ESA heliphysics archives data have been produced in the course of H2020/FP7 supported by the EU. About 10 of these projects have been reviewed by HAUS group members. For a number of these projects, it was recommended ESA ESDC to store at least part of the value added end products produced. The GSF was considered as a possible option to store them. A detailed list of FP7/H2020 products and where to store them will be circulated around the HAUS group members to know if a consensus can be reached to eventually become an HAUS group recommendation, to be reported at the 2020 winter SSEWG meeting. All related project scientists will of course be kept in the loop. In the context of the heliophysics archives, it was underlined that there is a grey area of what can be ingested, as underlined by B. Fleck. Are results of simulations allowed? G. De Marchi commented that a formal document is being prepared on the ESA ESDC rules of the road in this context, with the various missions' stakeholders. B. Fleck commented that all catalogues of SEPs or CMEs for instance that are closed (i.e. related to a specific time period) and based on SOHO data or closely related data (like STEREO) shall/could be included in SOHO archive now. Similar catalogues that are still being populated will be ingested at the end of the SOHO mission or when closed.
Actual plans for the future SMILE archive
This presentation was meant to report on the actual plans of the future SMILE archive. At the moment, SMILE data are proposed to be ingested in the Cluster Science Archive (CSA) which already preserve the Double Star mission archive as well, enabling to combine and display datasets of both missions. This would turn CSA into a multi-missions archive.
The new Proba-2 archive and Jupyter Notebook
(A. Masson based on a PPT from J. Cook at the Proba 2 given in Feb. 19 at a Proba-2 meeting in Redu, Belgium)
The new Proba-2 released early 2019 was presented together with a Jupyter Notebook. This python notebook enables to interact with the Proba-2 archive using a few lines of python script to download a carrington movie related to a specific day. This could be used for instance to try relating jumps or features in in-situ data to solar features.
Science cases of a future ESA overarching heliophysics archives
(presentations from C. Chen, N. Dresing, L. Harra, M. Roth, A. Veronig)
L . Harra expressed the needs of a simple tool to link (solar wind) in-situ and remore sensing data (i.e. ballistic, magnetically connected), especially solar orbiter (core science of this mission include: what are the sources of the slow solar wind? the fast solar wind?). Among the various models, the model from Karpen et al. (2017) with predictable observables from the source at the surface to the in-situ data could be a good candidate to implement. A connectivity tool is being used on HINODE operations to connect to the Parker Solar Probe (PSP) measurements. Magnetically connected positions of the Parker Solar Probe on a magnetogram was presented. P. Osuna underlined that such a tool is in the user requirements of the solar orbiter archive, hence to be eventually implemented. This tool could be applied to all heliophysics archives (Ulysses, SOHO, Cluster, Double Star, Proba-2), not only Solar Orbiter. L. Harra also expressed the need to connect Solar orbiter data to the upcoming DKIST data.
N. Dresing stressed the importance of a simple connectivity tool to backmap all the various in-situ measurements in the heliophysics archives to the Sun: simple ballistic and solar energetic particles connectivity based on solar wind velocity with all available spacecraft mapped. Spice kernels for legacy missions shall be investigated. Inclusion of the SEP inversion method shall be investigated. Catalogues of CMEs and SEP events shall be added.
C. Chen reported his Involvement on the in-situ side of the PSP analysis in the solar wind aceleration and how it connects to the different sources on the Sun, by looking at the fluxes of the turbulence. Due to the actual embargo on the PSP data, his presentation is not incorporated in these minutes.
On SOHO data alone, M. Roth first expressed the need of tools for the joint curation of GOLF, VIRGO and MDI data to reduce noise in order to detect the low-degree modes, like F modes. This is needed to probe the deep interior of the Sun and the rotation of the solar core.
Hot topics in the field of helioseismology related to space weather include
- the emergence and evolution of active regions (frontside+farside)
- Effect on solar atmosphere and corona
- Evolution of CMEs (connection to EUPHORIA)
where SOHO MDI and LASCO together with STEREO data shall be used, with an application on Solar Orbiter data together with SDO/HMI.
M. Roth also reported on-going discussions at international level on how to improve the detection of low mode waves with eventually multi-lines observations, multi-heights observations with DKIST, SOLICE, German solar towers, Solarnet, NSO. The scientific community expressed the need of Doppler measurements with 1 arc second and 1 mn resolution. Additionally, multiple view points such as L5, or mixing GONG and Solar Orbiter on the solar farside could help identify these modes also on the sides of the Sun and the farside.
A. Veronig reported similar points mentioned above but addtionally, she pointed out that for long-term studies there is a need for downloading data with low cadence for long periods, for instance one product per day or per month on the SOHO archive; B. Fleck fully supported that idea.
In terms of how a future ESA overarching heliophysics archives shall be built, it was agreed that first, a series of Jupyter notebook shall be setup and made available to show how to display and download data along clear science cases such as those just mentioned. ESDC heliophysics archives team shall also make sure ESDC archives are accessible through the most used python libraries and IDL data analysis packages (Heliopy, solar soft, sunpy, SPEDAS etc...).