Geomagnetism and the European Plate Observing System (EPOS) What Weve Learned About Integrating Geomagnetic Data Into an Earth Observation Network Simon Flower [1], Pavel Hejda [2], Aude Chambodut [3], Juan-Jose Curto [4], Jrgen Matzka [5], Alan Thomson [1], Maxim Smirnov [6] and Ari Viljanen [7] (1) British Geological Survey, UK Research and Innovation, Edinburgh, UK, (2) Institute of Geophysics, Academy of Sciences of the Czech Republic, Prague, Czech Republic, (3) Ecole et Observatoire des Sciences de la Terre, Universit de Strasbourg, Strasbourg, France, (4) Observatori de lEbre, Roquetes, Spain, (5) Niemegk Observatory, Deutsche GeoForschungsZentrum, Potsdam, Germany, (6) Geosciences and Environmental Engineering Department, Lule University of Technology, Lule, Sweden, (7) Finnish Meteorological Institute, Helsinki, Finland. UKRI All rights reserved EPOS Vision EPOS vision is that the integration of the existing national and trans-national research infrastructures will increase access and use of the multidisciplinary data recorded by the solid Earth monitoring networks, acquired in laboratory experiments and/or produced by computational simulations. The establishment of EPOS
will foster worldwide interoperability in the Earth sciences and services to a broad community of users. [https://www.epos-ip.org/about/what-epos] UKRI All rights reserved EPOS Mission EPOS mission is to integrate the diverse and advanced European Research Infrastructures for solid Earth science, and build on new e-science opportunities to monitor and understand the dynamic and complex solid-Earth System. EPOS will identify existing gaps and promote implementation plans with environmental, marine and space science to help solve the grand challenges facing the Earth and its inhabitants. [https://www.epos-ip.org/about/what-epos] UKRI All rights reserved EPOS
Sarah is a project PI and part of the DeepNL program. She wants to create a model with the purpose of simulating the surface subsidence above the Groningen Gas field for the next decades. The task: Bring together numericalThe model requires input from: Geoscience data and a) Satellite-based surface services
fromsubsidence across data from the past 30 years Europe in a way that b) Location, time,them magnitude, focal mechanism allows to beand easily of earthquakes in the area combined. c) A geological model of the subsurface based on The goal: seismic and
well data New scientific discoveries d) Rock mechanical data (rheology, geochemistry, UKRI All rights reserved failure properties) from the underlying lithologies e) Industrial data (gas production / production cluster position) EPOS Phases CP Conception Phase 2002 2008
PP Preparatory Phase FP 7 2010 2014 IP Implementation Phase Horizon 2020 2014 -2019 ERIC Operational Phase, ERIC Legal entity 2020 - UKRI All rights reserved EPOS Organisation
UKRI All rights reserved EPOS Geoscience Data Sets Data, Data products, Software and Services UKRI All rights reserved EPOS Geomagnetic Data Sets Dataset Source Available Geomagnetic observatory data World Data Centre & INTERMAGNET
2017/18 Variometer data IMAGE + Baltic extensions 2017/18 Geomagenetic indices ISGI 2017/18 Geomagnetic events Obervatori de LEbre
2017/18 Electrojet indices (IE/IL/IU) IMAGE 2017/18 Global magnetic models IGRF and WMM 2017/18 Magnetic survey data World Data Centre
2018 Substorm events IMAGE 2018 Magnetotelluric time series New data repository 2019 Magnetotelluric transfer functions New data repository
2019 Lithospheric conductivity models New data repository 2019 World digital magnetic anomaly map WDMAM 2019 UKRI All rights reserved How Do We Integrate?
Make our data Interoperable Integrate = "ability of a system to work with or use the parts or equipment of another system [Merriam-Webster] Data interoperability addresses the ability of systems and services that create, exchange and consume data to have clear, shared expectations for the contents, context and meaning of that data. [http:// datainteroperability.org] FAIR data principles: Come from data science research, published in 2016 UKRI All rights reserved
EPOS FAIR Data - Findable 1. (meta)data are assigned a globally unique and eternally persistent identifier. 2. data are described with rich metadata. 3. (meta)data are registered or indexed in a searchable resource. 4. metadata specify the data identifier. [https://www.force11.org/group/fairgroup/fairprinciples] UKRI All rights reserved EPOS FAIR Data - Accessible 1. (meta)data are retrievable by their identifier using a standardized communications protocol. A. the protocol is open, free, and universally implementable. B. the protocol allows for an authentication and authorization procedure, where necessary.
2. metadata are accessible, even when the data are no longer available. [https://www.force11.org/group/fairgroup/fairprinciples] UKRI All rights reserved EPOS FAIR Data - Interoperable 1. (meta)data use a formal, accessible, shared, and broadly applicable language for knowledge representation. 2. (meta)data use vocabularies that follow FAIR principles. 3. (meta)data include qualified references to other (meta)data. [https://www.force11.org/group/fairgroup/fairprinciples] UKRI All rights reserved EPOS FAIR Data - Reusable 1. meta(data) have a plurality of accurate and relevant
attributes. A. (meta)data are released with a clear and accessible data usage license. B. (meta)data are associated with their provenance. C. (meta)data meet domain-relevant community standards. [https://www.force11.org/group/fairgroup/fairprinciples] UKRI All rights reserved EPOS Metadata & Geomagnetism Source Transport Storage UKRI All rights reserved Geomagnetism Community Metadata A database schema for global geomagnetic metadata
Peer reviewed (geomagnetic community and database experts) EPOS Data Catalogue Vocabulary Application Profile (EPOS DCAT AP) DCAT is an RDF vocabulary designed to facilitate interoperability between data catalogs published on the Web [https:// en.wikipedia.org/wiki/Data_Catalog_Vocabulary] Status: W3C draft standard Syntax: Terse RDF Triple Language (Turtle) Common European Research Information Format (CERIF) Describes research entities and their relationships A database model and implementation [https://www.eurocris.org/cerif/main-features-cerif] Geomag Metadata - What We Record Institutes Instruments People Data
Locations UKRI All rights reserved 180 active, 360 inactive observatories 200 contacts in 125 institutions Many instruments creating thousands of data sets Geomag Metadata Design Goals Need to ensure both these things UKRI All rights reserved
A single database for the whole community Easy for data providers to understand and update Easy for users to query and obtain data Contains information needed for the INTERMAGNET website, INTERMAGNET data DVD, World Data Centre web site (amongst others) Ideal: Be able to create a yearbook Conform to metadata standards (such as ISO 19115) to allow our data to be understood by users outside our community Geomag Metadata The Schema
v e R r e e P UKRI All rights reserved d e w e i Geomag Metadata - Progress Self service data entry
Web services Feed to INTERMAGNET web site Feed to EPOS data portal UKRI All rights reserved
Tools to create INTERMANGET DVD metadata Other clients Geomagnetic metadata database Tools for database administration EPOS Metadata EPOS DCAT AP 27 Entities, including: Dataset Dataset distribution,
Web service, Web service operation Facility, Equipment Person, Contact point, Organisation UKRI All rights reserved EPOS DCAT EG INTERMAGNET a schema:Person; schema:identifier [ a schema:PropertyValue; schema:propertyID "mailto"; schema:value "[email protected]"; ]; schema:familyName "Flower"; schema:givenName "Simon"; schema:address [ a schema:PostalAddress; schema:streetAddress "The Lyell Centre, Research Avenue South"; schema:addressLocality "Edinburgh";
schema:postalCode "EH14 4AP"; schema:addressCountry "United Kingdom"; ]; schema:email "[email protected]"; schema:telephone "+44 131 650 0238"; schema:url "http://www.bgs.ac.uk/staff/profiles/0447.html"^^xsd:anyURI; schema:affiliation ; schema:contactPoint ; UKRI All rights reserved EPOS DCAT EG INTERMAGNET a hydra:Operation; hydra:method "GET"^^xsd:string; hydra:returns "text/xml"; hydra:returns "application/json"; hydra:returns "application/covJson"; hydra:returns "text/plain";
hydra:property[ a hydra:IriTemplate; hydra:template "http://geomag.bgs.ac.uk/EPOS/WP13/intermagnet/{?Request, observatoryIagaCode, SamplesPerDay, dataStartDate, dataDuration, publicationState, recordTermination, traceList, colourTraces, pictureSize, pdfSize, dataScale, Format}"^^xsd:string; hydra:mapping[ a hydra:IriTemplateMapping; hydra:variable "observatoryIagaCode"^^xsd:string; rdfs:label "Observatory IAGA code"; rdfs:range "xsd:string" ; schema:defaultValue "ESK"; hydra:required "true"^^xsd:boolean; ]; UKRI All rights reserved EPOS Metadata - CERIF UKRI All rights reserved
EPOS Metadata & Geomagnetism Geomagnetism UKRI All rights reserved EPOS DCAT AP CERIF EPOS Data - User Interface UKRI All rights reserved EPOS Data - User Interface Missing any way to view time series data
UKRI All rights reserved EPOS Data Time Series We need a single format that can support: Data type Geo-referenced points Geo-referenced images GUI pre-visualisation Map Geo-referenced time series Non-geo-referenced elements Time Series Other
Coverage JSON (CovJSON) Point Series: https://covjson.org/domain-types/#pointseries UKRI All rights reserved EPOS Data Time Series UKRI All rights reserved EPOS Data Data Processing UKRI All rights reserved EPOS Other Work UKRI All rights reserved
Geomagnetic indices Magnetotelluric data Data management plans Licensing Supplier letters User feedback forums Consortium agreement Financial plan
EPOS Future Magnetotelluric services to be implemented Add to EPOS DCAT AP metadata Populate Geomagnetism community metadata Standardise our web formats (JSON) Respond to user feedback
UKRI All rights reserved