EOPEN A PLATFORM FOR DEVELOPING DISTRIBUTED APPLICATIONS Bernard - - PowerPoint PPT Presentation

▶
eopen a platform for
SMART_READER_LITE
LIVE PREVIEW

EOPEN A PLATFORM FOR DEVELOPING DISTRIBUTED APPLICATIONS Bernard - - PowerPoint PPT Presentation

Sep 15, 2022 203 likes •494 views

EOPEN External Advisory Board Seminar February 28, 2020 EOPEN A PLATFORM FOR DEVELOPING DISTRIBUTED APPLICATIONS Bernard Valentin Space Applications Services Platform Development and Integration Lead Overview EOPEN, a Framework for

slide-1
SLIDE 1

EOPEN External Advisory Board Seminar February 28, 2020

EOPEN – A PLATFORM FOR DEVELOPING DISTRIBUTED APPLICATIONS

Bernard Valentin Space Applications Services Platform Development and Integration Lead

slide-2
SLIDE 2

2 H2020 EOPEN – A Platform for Developing Distributed Applications EOPEN EAB Seminar – 28 April 2020

 EOPEN, a Framework for Interoperability  Application development cycle  Core capabilities and extensions  EOPEN End-User Portal  EOPEN Pilot Use Cases  Live Demonstration

Overview

slide-3
SLIDE 3

3 H2020 EOPEN – A Platform for Developing Distributed Applications EOPEN EAB Seminar – 28 April 2020

 The EOPEN Platform provides

  • Integrated tools allowing to develop, test and share services

and applications, and visualise the results.

  • Generic re-usable processes for data transfer, transformation

and storage, messaging, …

  • Extensions for supporting specific data sources (e.g. tweets)

in the workflows.

 Three Pilot Use Cases demonstrate the capabilities of the

platform by addressing crucial contemporary issues: Flood risk assessment and prevention, food security, and climate change.

EOPEN, a Framework for Interoperability

slide-4
SLIDE 4

4 H2020 EOPEN – A Platform for Developing Distributed Applications EOPEN EAB Seminar – 28 April 2020

 EOPEN Supports the development cycle:

  • 1. Import user algorithms
  • 2. Integrate the algorithm in a workflow
  • 3. Select and execute the workflow
  • 4. Analyse the performances and the resulting products
  • 5. Share / publish the workflow as an application

 Supports this with

  • Core capabilities
  • EO and non-EO data processing extensions

Support to Service and Application Developers

slide-5
SLIDE 5

5 H2020 EOPEN – A Platform for Developing Distributed Applications EOPEN EAB Seminar – 28 April 2020

 Core layer running at

SpaceApps:

  • Controller node
  • Process images registry
  • Centralized datastore

 Worker nodes running at

SpaceApps and in DIAS platforms

 Compute node available in

HPC and HPDA at HLRS

EOPEN Platform – Deployment and Operation

Controller Node

slide-6
SLIDE 6

6 H2020 EOPEN – A Platform for Developing Distributed Applications EOPEN EAB Seminar – 28 April 2020

Main Technical Concepts

  • A Workflow is an application defined by

inter-connected Processes.

  • The Platform includes a graphical Workflow Editor for

creating workflows interactively.

  • Workflows can be executed on-demand, scheduled or

externally triggered.

  • Parameterization forms are automatically generated.
  • Interfaces are included for monitoring and control,

reporting and data access.

  • A Process is a unit of execution.
  • A Process is implemented as a Dockerised Algorithm.
  • A Process has (typed) input and output parameters.
  • The Platform includes a tool for that automates the

packaging and the registration of custom processes.

slide-7
SLIDE 7

7 H2020 EOPEN – A Platform for Developing Distributed Applications EOPEN EAB Seminar – 28 April 2020

EOPEN Core Capabilities

slide-8
SLIDE 8

8 H2020 EOPEN – A Platform for Developing Distributed Applications EOPEN EAB Seminar – 28 April 2020

Workflow Editor Graphical configuration of workflows including target processing environment selection

EOPEN Core Capabilities

Process Importer Package and register user processes

slide-9
SLIDE 9

9 H2020 EOPEN – A Platform for Developing Distributed Applications EOPEN EAB Seminar – 28 April 2020

Parameterisation Forms dynamic generated based on unresolved workflow inputs

EOPEN Core Capabilities

Execution monitoring and reporting Visualisation of execution results

slide-10
SLIDE 10

10 H2020 EOPEN – A Platform for Developing Distributed Applications EOPEN EAB Seminar – 28 April 2020

EOPEN Core Capabilities

Resources Sharing Based on the concept of workspaces Unattended Workflow Executions

  • Single future execution
  • Repeated executions at fixed interval
  • Executions at specific month days
slide-11
SLIDE 11

11 H2020 EOPEN – A Platform for Developing Distributed Applications EOPEN EAB Seminar – 28 April 2020

 Sentinel missions product catalogue  Water body mask generation  Social media crawling, filtering  Event detection in social media  Community detection and topic

identification

EOPEN Extensions

(support to application developers)

Water body mask Tweets filtering, visualisation and geo-localisation

slide-12
SLIDE 12

12 H2020 EOPEN – A Platform for Developing Distributed Applications EOPEN EAB Seminar – 28 April 2020

EOPEN End-User Portal

slide-13
SLIDE 13

13 H2020 EOPEN – A Platform for Developing Distributed Applications EOPEN EAB Seminar – 28 April 2020

EOPEN End-User Portal

slide-14
SLIDE 14

14 H2020 EOPEN – A Platform for Developing Distributed Applications EOPEN EAB Seminar – 28 April 2020

  • New dashboard pages can be created and populated with available

visualisation components

A Customisable Web-Portal

slide-15
SLIDE 15

16 H2020 EOPEN – A Platform for Developing Distributed Applications EOPEN EAB Seminar – 28 April 2020

  • Geo-temporal data may be published in GIS Server (e.g. GeoServer)
  • Visualisation in OGC compliant GIS Client (e.g. QGIS, OpenSphere)

Visualisation of generated outputs – GIS Clients

QGIS (Desktop Client) OpenSphere (Web Client)

slide-16
SLIDE 16

17 H2020 EOPEN – A Platform for Developing Distributed Applications EOPEN EAB Seminar – 28 April 2020

  • PUC1: Flood Risk Assessment and Prevention
  • PUC2: Food Security
  • PUC3: Climate Change Impact in Finnish Lapland

EOPEN Pilot Use Cases

slide-17
SLIDE 17

18 H2020 EOPEN – A Platform for Developing Distributed Applications EOPEN EAB Seminar – 28 April 2020

PUC1: Flood Risk Assessment and Prevention

Eastern Alps river basin district AAWA is the Authority competent for a district covering an area of

  • ver 37,000 km2.

Background: Floods in Italy The average annual precipitation is highly variable with increasing trend

slide-18
SLIDE 18

19 H2020 EOPEN – A Platform for Developing Distributed Applications EOPEN EAB Seminar – 28 April 2020

PUC1: Precipitation Levels Warning System

slide-19
SLIDE 19

20 H2020 EOPEN – A Platform for Developing Distributed Applications EOPEN EAB Seminar – 28 April 2020

PUC1: Flood Risk Assessment and Prevention

slide-20
SLIDE 20

21 H2020 EOPEN – A Platform for Developing Distributed Applications EOPEN EAB Seminar – 28 April 2020

HIRLAM weather forecast EOPEN Check the forecast total rain on sub-basins Hydrological model Less than threshold Over threshold Do nothing Alarm to AAWA, creation

  • f EVENT in EOPEN

Setup of Basement simulation Run in EOPEN (on-demand) AAWA EWS Copernicus Land Service maps

Planned interactions to provide information for flood risk reduction

PUC1: Hydrological model for flood prediction

slide-21
SLIDE 21

22 H2020 EOPEN – A Platform for Developing Distributed Applications EOPEN EAB Seminar – 28 April 2020

Rice Paddy Detection using Machine Learning

 Based on Sentinel-1 SAR data  Rice paddy fields classification

using RNN

 Rice yield estimation on time

series

 Visualisation on the EOPEN

platform interface (GIS client)

PUC2: Food Security

slide-22
SLIDE 22

23 H2020 EOPEN – A Platform for Developing Distributed Applications EOPEN EAB Seminar – 28 April 2020

Rice Paddy Detection (RNN) Workflow:

  • “Monthly_mosaic” corresponds to a mask for

selecting a year and a shape and produces monthly mean composite images.

  • “Time_series_list” generates a regular

expression for a list of input data .

Example: re_path = ‘./PUC_2/*_’, Month_list = ‘4, 5_1’ Images to be searched = ‘./PUC_2/*_4.tif’ and ‘./PUC_2/*_5_1.tif’

  • “rp_detection” performs the rice pad detection
  • ver a list of images.

PUC2: Food Security

slide-23
SLIDE 23

24 H2020 EOPEN – A Platform for Developing Distributed Applications EOPEN EAB Seminar – 28 April 2020

Rice Paddy Fields detected using:

  • Machine Learning / RNN (KUEGIRS) (left)
  • K-means (NOA) (right)

PUC2: Food Security

slide-24
SLIDE 24

25 H2020 EOPEN – A Platform for Developing Distributed Applications EOPEN EAB Seminar – 28 April 2020

 Impact on the reindeer herding livelihoods, infrastructure and

transportation.

 The herders' livelihood depends directly on the environmental and

seasonal variation in snow cover, snow depth, temperature and the start of snow melting.

 EOPEN provides

  • Historical data of both air temperature and snow depth in Finland.
  • Weather forecasts.
  • FMI GlobSnow and Freeze/Thaw products for monitoring purposes.
  • Tools to plot the data and estimate both temporal/areal statistics.

PUC3: Impact of Climate Change in Finnish Lapland

slide-25
SLIDE 25

27 H2020 EOPEN – A Platform for Developing Distributed Applications EOPEN EAB Seminar – 28 April 2020

Animation shows the

  • ccurrence of snow

melting in different reindeer herding areas

  • ver Northern Finland.

This information is important both for the herders and researchers.

 Snow depth animation in reindeer herding areas during late Spring

PUC3 – Example Product in GIS Viewer

slide-26
SLIDE 26

28 H2020 EOPEN – A Platform for Developing Distributed Applications EOPEN EAB Seminar – 28 April 2020

  • Developer Portal:

End-to-end walkthrough from algorithm development to workflow execution and access to the results.

  • Dashboard:

Configuration of new pages with existing components. Visualisation of geospatial data.

  • Pilot Use Cases

Presentation of the key workflows and visualisation of the results.

Live Demonstration

slide-27
SLIDE 27

Thanks you! Any questions?

Contact: Bernard.Valentin@spaceapplications.com

slide-28
SLIDE 28

30 H2020 EOPEN – A Platform for Developing Distributed Applications EOPEN EAB Seminar – 28 April 2020

Backup slides