EUMETSAT Destination Earth Data Lake (DEDL) Cube
The Destination Earth Data Lake Cube (DEDL Cube) project is financed by EUMETSAT and it aims to facilitate the data discovery, access and process of the products offered within the Destination Earth Harmonized Data Access (HDA). The HDA offers an extended data portfolio with hundreds of products, including the most recent atmospheric Digital Twins produced by ECMWF.
The DEDL Cube will be formed by several components, each implemented and maintained by experts from the consortium. The DataCube Generation Component is responsible for the conversion of selected datasets into analysis-ready cloud optimised (ARCO) data collections. It incorporates capabilities for discovering data via the HDA - STAC API, download and reprocess them to the cloud native Zarr format on a discrete global grid system (DGGS). The second main component is an openEO API service, which will offer data discovery and processing capabilities in the cloud with the openEO standard, fostering portability, reproducibility and avoiding vendor lock-in. The implementation will be built re-using and extending open-source projects with an established user base, bringing new functionalities to the whole openEO community.
The Advanced Computing group of the Institute for Earth Observation has extensive experience in processing and managing cloud-native geospatial data and will contribute with its expertise to the DEDL Cube architecture design, to the openEO API implementation and validation and finally to the project documentation.
This project consolidates the uptake of the openEO API, introducing it to a large data producer such as EUMETSAT. Eurac Research played a key role for the openEO development from the initial project and it continues to use and develop it in many other projects.
Contact: Michele Claus michele.claus@eurac.edu
Eurac Research activities in the project are divided among the three work packages:
Service Design & Architecture: we will be responsible for coordinating the requirements analysis, the update of the system architecture documenting the rationale for chosen stack and finally updating the identified design constraints. The work will result in the deliverable D01 due to KO+3 months (end of February).
Minimum Viable Product: we will contribute to the DataCube Generation component development, testing out the products converted by DevelopmentSeed with openEO. We will extend the openEO Python software stack to be compatible with the EUMETSAT products (Sentinel-3 WFR, MSG, MTG, ASCAT), initiating the integration of data projected on the HEALPix DGGS.
Increment A: we will contributor the the openEO API deployment, focusing on the User Defined Functions (UDFs) implementation to run custom workflows, based on either custom Python scripts or on containers defined by a Common Workflow Language (CWL) document.
Eurac Research is also responsible for the whole project documentation, covered in all the work packages
- Project duration: -
- Project status:
- Funding: Public institutions (Other projects /Project)
- Institute: Institute for Earth Observation
Discover
See related experts, publications, and research topics.
My cookie preferences
