.. toctree:: :maxdepth: 2 :caption: Contents: General Flow Description ======================== The EO4EU platform enables users to access, process, and analyse Earth observation data by integrating various data sources, automating workflows, and providing advanced visualisation tools. It supports data discovery, workflow creation, fusion algorithms, and machine learning applications to extract meaningful insights from geospatial data. **Steps to Use the EO4EU Platform:** 1. **Register and Log In** .. Create an account and log in to access your profile, manage applications, and configure settings (see Account). 2. **Search for Data** .. Use the Data Search tool to find relevant datasets by selecting a data source, applying filters such as area of interest and date range, and retrieving the necessary data. 3. **Create a Workflow** .. In the Workflow Creator, define a new workflow by selecting datasets and structuring the workflow. You can also upload in situ data if needed. 4. **Edit the Workflow** .. Open the Workflow Editor to design and configure your workflow by dragging and dropping components, setting parameters, and applying processing techniques (see Fusion Functions). 5. **Execute and Monitor Workflow** .. Save and publish the workflow to start processing. Track progress through the platform’s status indicators and notification system. 6. **Visualize and Analyse Data** .. Explore processed results using Data Visualization for graphs, Map Visualization for geospatial overlays, and XR/VR Visualization for 3D analysis. 7. **Manage Files and Track History** .. Access workflow outputs in the File Explorer, execute advanced commands in the Console, and review past workflows in the History section for tracking and iteration. Authentication ============== To access the EO4EU platform, the user must be registered either as a local service user or through the DestinE federated IAM. Access to the Web Portal requires authentication via the sign-in screen. .. image:: media/image1.png :width: 2.63621in Dashboard ========= The dashboard provides an overview of your data and workflows. .. image:: media/image3.png :width: 5.3522in :height: 2.90426in Data Search =========== The first step in using the EO4EU platform is to search for the data needed. One of the platform's main contributions is that it allows semantic data search through various data sources, including the option to upload datasets. Once the user logs in to the portal, the first accordion section is entitled "Dataset Search", which is the tool used to search through data sources semantically. From the drop-down menu, the user can choose the data source and provide a keyword. .. image:: media/image5.png :width: 5.21277in :height: 2.33683in Once the data source and keyword are defined, the user can search using the search button on the top right and the most matching results will be shown. .. image:: media/image6.png :width: 6.10618in :height: 3.69633in Once the user chooses the dataset of interest, a specialised menu provides more details/options. The example for the ADAM data source includes a description of the dataset, its variables, file formats, and data types. .. image:: media/image7.png :width: 6.1967in :height: 3.55979in Additionally, another section of this menu is the ADAM Advanced Filter where the user can choose the area of interest on the map. .. image:: media/image8.png :width: 6.29521in :height: 3.79327in Once the area is defined, the user can choose the date ranges. .. image:: media/image9.png :width: 3.96997in :height: 3.3617in Once the date range is defined you can filter them to identify the correct products to download and select the button **“Filter now”.** .. image:: media/image10.png :width: 6.72094in :height: 2.51064in When the products are chosen, the user can choose whether the EO4EU visualisation tool should be used. Then, the user uses the Generate Script button to create the Python Script and the Meta Info JSON that will be passed to the Workflow Editor Component. .. image:: media/image11.png :width: 5.29756in :height: 1.52156in The user as a final step shall select the button “Save WF product”. The next thing is the Workflow Creator. .. image:: media/image12.png :width: 6.73041in :height: 2.86892in Workflow Creator ================ Workflow creator is the common space where a user can have an overview of all the saved workflow products in their account. In this section a user shall type a workflow name in the respective field. Afterwards the user shall either select some workflow products to be used in this workflow or can select none in order to create an empty workflow. An empty workflow can be used in order to upload in the next step a user its own data, i.e. in situ. The user, after selecting the preferred workflow products, if needed, and adds a name, can press the create workflow button to create the workflow in the workflow editor. .. image:: media/image13.png :width: 6.5in :height: 4.23681in For the specific use case we named our use case as “test-case”, we selected 2 workflow products, and we selected the “Create workflow” button. A user can check if the workflow has created correctly by the notification area and the message success in the left part of the platform .. image:: media/image14.png :width: 2.10387in :height: 2.00369in The next step is for the user to create a chain of actions in the Workflow Editor for the specific data input. Workflow Editor =============== WFE is a component of the EO4EU platform that a user can manage (publish, delete and save as draft) a workflow. In the application there are two basic views. The view that the user can see and manage all the workflows that have been created, as well as their status and the editing view named as Workflows List. .. image:: media/image15.png :width: 5.18126in :height: 3.28977in The status of each workflow is visible in each workflow item. All possible statuses are: - compiling - compiled - publishing - published - stopping - Stopped - completed - error With 3-dots menu, in the top right corner of the item, a user can see publish, view or delete an item depending on the state of this. .. image:: media/image16.png :width: 6.0in :height: 3.0in .. image:: media/image17.png :width: 6.0in :height: 3.0in In a user selects view, the workflow editor builder opens. The editor is divided into three main sections. The top bar where the user can save his work or publish it. The editing canvas and the marketplace of the components available, on the left, for insertion into the workflow. A user can return in the previous page by clicking the left arrow close to the workflow name. Items in the marketplace are searchable A workflow building process is by drag-and-drop items from the marketplace to the canvas and connecting them. .. image:: media/image18.png :width: 5.0in :height: 5.0in .. image:: media/image19.png :width: 6.0in :height: 4.0in Editable items have a 3-dot menu. Clicking on it opens a new window in which the user can edit the parameters of each component. Items can be deleted if the pointer hovers at the right up corner. The information for the use cases can be shown if you press the three dots of the components .. image:: media/image20.png :width: 4.44783in :height: 2.682in In the data source, users can upload new files and manage their files and directories. .. image:: media/image21.png :width: 4.95063in :height: 2.36002in All the insitu data shall be registered with the same notation that all data sources are integrated in KG. The in situ data then can be permantly stored in the KG as an added datasource. The new data can be characterized as a new Data source with title .. image:: media/image22.png :width: 4.73586in :height: 3.26956in .. image:: media/image23.png :width: 4.69255in :height: 2.5047in When the chain of the actions is completed then the user can either save the workflow or publish the workflow, which is translated to start the workflow. .. image:: media/image24.png :width: 7.0in :height: 4.0in Finally, if the user wants to go back to the first screen of the WFE, the user should press on the arrow at the top left of the Workflow Editor section. Once the workflow is started, the progress of the workflow can be found in the notifications section of the EO4EU portal. .. image:: media/image25.png :width: 7.0in :height: 4.0in The results of the Workflow =========================== Once the workflow processing has been completed, whether raw or processed data, the output files can be visualised in three ways. If the results are geotiffs, they can be visualised on maps by overlaying layers in 2D through the "Map Visualisation" component. The results can be visualised on graphs or tables through the "Data Visualisation" component if the results are arithmetic data. Finally, the platform provides the option to visualise the data in a 3D mode through the XR/VR component. More details on the three components can be found in the following subsections. The files can also be accessible in the File Explorer section. Data Visualization ------------------ The Data Visualization tool provides various charts and graphs to help users understand and analyse their data. Users can customise their visualisations and save them for future reference. The users can choose their workflow of interest from the dropdown list and generate charts using the Add Chart button. .. image:: media/image26.png :width: 6.5in :height: 1.25556in When the users press on the Add Chart button, the below menu appears to choose the file to visualise. .. image:: media/image27.png :width: 6.5in :height: 2.32153in Once the file is chosen, another menu appears to configure what the chart will present. .. image:: media/image28.png :width: 5.71025in :height: 6.13303in When all the configurations are provided, the user will press on Create Chart and the chart will be created. The user can create as many chart as needed with either 1 or 2 charts per row. .. image:: media/image29.png :width: 8.5in :height: 2.80208in Map Visualization ----------------- The Map Visualization tool allows users to visualise geospatial data on a map. Users can overlay different datasets and use various spatial data analysis tools. The user can choose the Workflow with available data from the Workflow dropdown menu and select the file (or multiple files) they want to visualise. The tool can visualise tiff, NetCDF and shapefiles. .. image:: media/image30.png :width: 7.51425in :height: 4.66357in XR/VR ----- This tool allows the user to explore the output data and the intermediate results of a specific workflow in an Extended Reality (XR) environment, namely Virtual Reality (VR) environment and Augmented Reality (AR) environment. Currently it is available on the dashboard only the possibility to visualize the data in a Virtual Reality environment. To enable the XR visualization on a specific workflow, during its creation within the Workflow Editor application, the AR/XR task needs to be linked to the data output task as shown in the following image: .. image:: media/image31.jpg :width: 7.1383in :height: 3.89029in When a specific workflow is selected using select workflow section in the dashboard, if the XR visualization was enabled during the creation phase of the workflow, the VR visualization of its resulting data is available opening the XR/VR tab in the dashboard Home section. In the VR interface home page, all the areas covered by the data resulting from the selected workflow are displayed as selectable bounding boxes on a globe. If a device supporting VR sessions is detected, a button appears on the top-right corner of the application and can be used to start a VR session. .. image:: media/image32.jpg :width: 3.42317in :height: 1.92553in Selecting a specific bounding box, it is possible to visualize the data related to the selected area jointly with a basic set of metadata. During a VR session a wrist mounted User Interface is available to navigate between the different data layers and display the metadata information. .. image:: media/image33.jpg :width: 6.1383in :height: 3.89029in File Explorer ------------- The File Explorer allows the user to browse through uploaded and generated files. The File Explorer contains a hierarchical directory structure that the user can navigate. In order to visualize the files in the bucket of the workflow a user shall select the name of the relevant workflow. Console and History =================== At the left part of the GUI you can also overview the Console and the history tabs. Console ------- The Console provides a command-line interface for advanced users to interact with the EO4EU platform. Users can execute scripts and commands directly from the console. .. image:: media/image34.png :width: 6.80562in :height: 4.96809in History ------- The User History section keeps track of all user activities and workflows. Users can view their history to review past actions and results. .. image:: media/image35.png :width: 7.05319in :height: 5.01356in .. Use Case Tutorials .. We are providing the steps to run all the use cases in the EO4EU .. platform. All the insitu files can be found in the following .. `:mark:`link` `__ .. UC1 .. ==== .. This use case will run with in situ data. The original data are created .. through an API of Pasyfo. .. 1. Create an empty workflow. In the example with name UC1 .. .. image:: media/image36.png .. :alt: A screenshot of a computer AI-generated content may be .. incorrect. .. :width: 4.30851in .. :height: 2.10408in .. 2. Open Workflow editor and find the draft workflow with the name of UC1 .. 3. We add the following components and connected as described below .. .. image:: media/image37.png .. :alt: A screenshot of a computer AI-generated content may be .. incorrect. .. :width: 6.5in .. :height: 3.18819in .. 4. We select data source in order to upload the uc1.zip as in situ data .. .. image:: media/image38.png .. :alt: A screenshot of a computer AI-generated content may be .. incorrect. .. :width: 6.5in .. :height: 2.99653in .. 5. Save the workflow .. 6. Publish the workflow .. 7. When the workflow ends a Netcdf is published .. .. .. .. image:: media/image39.png .. :alt: A screenshot of a computer AI-generated content may be .. incorrect. .. :width: 6.5in .. :height: 4.17153in .. UC2-a .. This use case will run with in situ data. .. 1. | Create an empty workflow .. | |image3| .. 2. Open Workflow editor and find the draft workflow with the name of .. uc2-a .. 3. | We add the following components and connect as described below .. | |image4| .. 4. We select data source in order to upload the uc2(1.csv).zip as in .. situ data .. 5. Save the workflow .. 6. Publish the workflow .. 7. When the workflow ends Numpy Array and CSV are published for .. computing the Fuel Consumption .. UC2-b .. Data search .. :mark:`Sentinel-3 OLCI Level 1B- (04/01/2024 - 10/01/2024) close to the .. area of Suez` .. - Select Source: Sentinel - Data search: :mark:`Sentinel-3 OLCI Level .. 1B`) .. - Choose the following data source: :mark:`Sentinel-3 OLCI Level .. 1B`)\ |image5| .. - Define area of interest\ |image6| .. - Define Date range (:mark:`4/01/24-10/01/24`)\ |image7| .. - Generate Script and Save WF product\ |image8| .. - Workflow Creator: Create a workflow named :mark:`uc2-b` with the .. product :mark:`Sentinel-3 OLCI Level 1B`) selected\ |image9| .. - Open Workflow editor and find the draft workflow with the name of .. :mark:`uc2-b. In the menu on the top right corner click .. view.`\ |image10| .. - Add the following components and connect as described .. below\ |image11| .. - Save the workflow .. - Publish the workflow .. - When the workflow ends a Numpy Array and a CSV are published to .. identify the wind prediction .. UC3 .. This use case will run with in situ data. .. - Create an empty workflow with name uc3 |image12| .. - Open Workflow editor and find the draft workflow with the name of .. uc3. Click view.\ |image13| .. - We add the following components and connect as described .. below\ |image14| .. - We select data source in order to upload the UC3_INSITU.zip) as in .. situ data\ |image15| .. - Save the workflow .. - Publish the workflow .. - When the workflow ends a numpy array and a csv are published .. UC4 .. Hint: UC4 is for forest recognition so we need at least an area of land. .. Data search - .. Sentinel-1 GRD :mark:`- (02/01/2018 - 31/12/2018) an area inside .. Austria` .. - Select Source: Adam or Sentinel - Data search: Sentinel-1 .. GRD\ |image16| .. - Choose the following data source: Sentinel-1 GRD .. - Define area of interest\ |image17| .. - Define Date range (02:mark:`/01/24-10/01/24`)\ |image18| .. - Generate Script and Save WF product .. - Workflow Creator: Create a workflow named :mark:`uc4` with the .. product Sentinel-1 GRD selected\ |image19| .. - Open Workflow editor and find the draft workflow with the name of .. :mark:`uc4. Click view.` .. - Add the following components and connect as described .. below\ |image20| .. - Save the workflow .. - Publish the workflow .. - When the workflow ends a tiffs of the prediction of a specific area .. identified as forest are published .. .. .. Map visualazation .. .. image:: /media/image4c.png .. :width: 6.5in .. :height: 3.125in .. .. image:: /media/image4d.png .. :width: 6.5in .. :height: 3.09375in .. File explorer .. .. image:: /media/image4e.png .. :width: 6.5in .. :height: 3.15625in .. Data visualization .. .. image:: /media/image4f.png .. :width: 6.5in .. :height: 3.16667in .. AR/XR .. .. image:: /media/image50.png .. :width: 6.5in .. :height: 3.14583in .. .. image:: /media/image51.png .. :width: 6.5in .. :height: 3.16667in .. UC5 .. === .. - Data search .. - Sentinel-2 Bands 2,3,4 (04/01/2024 - 05/01/2024). For each dataset .. - Define area of interest – like Sicily .. - Define Date range (04/01/2024 - 05/01/2024). .. - Push Filter now, select all products, Generate and Save workflow .. .. image:: media/image56.png .. :alt: A screenshot of a computer AI-generated content may be .. incorrect. .. :width: 6.5in .. :height: 3.70486in .. .. image:: media/image57.png .. :alt: A screenshot of a computer AI-generated content may be .. incorrect. .. :width: 6.5in .. :height: 3.70486in .. .. image:: media/image58.png .. :alt: A map of the world AI-generated content may be incorrect. .. :width: 6.5in .. :height: 3.70486in .. .. image:: media/image59.png .. :alt: A screenshot of a computer AI-generated content may be .. incorrect. .. :width: 6.5in .. :height: 3.70486in .. .. image:: media/image60.png .. :alt: A screenshot of a computer AI-generated content may be .. incorrect. .. :width: 6.5in .. :height: 3.70486in .. - In the workflow creator, we select the two datasets and we name .. UC5-test the workflow and we select Create Workflow .. .. image:: media/image61.png .. :alt: A screenshot of a computer AI-generated content may be .. incorrect. .. :width: 6.5in .. :height: 3.70486in .. - In the Workflow editor, we are using the components as shown in the .. picture below, we save and publish the workflow .. .. image:: media/image62.png .. :alt: A screenshot of a computer AI-generated content may be .. incorrect. .. :width: 6.5in .. :height: 3.70486in .. .. image:: /media/image52.png .. :width: 6.5in .. :height: 3.14583in .. .. image:: media/image64.png .. :alt: A screenshot of a computer AI-generated content may be .. incorrect. .. :width: 6.5in .. :height: 3.70486in .. - When the workflow ends a tiffs are published .. .. image:: /media/image53.png .. :width: 6.5in .. :height: 3.14583in .. .. image:: media/image65.png .. :alt: A screenshot of a computer AI-generated content may be .. incorrect. .. :width: 6.5in .. :height: 2.57778in .. .. image:: media/image66.png .. :alt: A screenshot of a map AI-generated content may be incorrect. .. :width: 6.5in .. :height: 4.16528in .. .. image:: /media/image54.png .. :width: 6.5in .. :height: 3.17708in .. .. image:: /media/image55.png .. :width: 6.5in .. :height: 3.125in .. UC6 .. === .. Data search .. ERA5 Land: 2m temperature (hourly) (04/01/2024 - 10/01/2024) close to .. the area of Suez .. 1. Data search ERA5 Land: 2m temperature (hourly) .. 2. Define area of interest .. .. image:: media/image67.png .. :alt: A screenshot of a map AI-generated content may be incorrect. .. :width: 4.68335in .. :height: 2.78949in .. 3. Define Date range (4/01/24-10/01/24) .. .. image:: media/image68.png .. :alt: A screenshot of a computer AI-generated content may be .. incorrect. .. :width: 6.5in .. :height: 2.56944in .. 4. Push Filter now, select all products, Generate and Save workflow .. 5. Data Source Era5 land: total precipitation (hourly) .. 6. Define area. In the right part above the map, a user can select the .. last bounded bpx selected in the previous search .. .. image:: media/image69.png .. :alt: A screenshot of a computer AI-generated content may be .. incorrect. .. :width: 6.5in .. :height: 3.73264in .. 7. Define the Date range (4/01/24-10/01/24) and Filter now .. .. image:: media/image70.png .. :alt: A screenshot of a calendar AI-generated content may be .. incorrect. .. :width: 6.5in .. :height: 2.48333in .. 8. Select all, True and Generate Script .. 9. Save workflow .. .. image:: media/image71.png .. :alt: A screenshot of a computer AI-generated content may be .. incorrect. .. :width: 6.5in .. :height: 3.2875in .. 10. In the workflow creator, we select the two datasets and we name .. uc1_11_01 the workflow and we select Create Workflow .. .. image:: media/image72.png .. :alt: A screenshot of a computer AI-generated content may be .. incorrect. .. :width: 6.5in .. :height: 3.47847in .. 11. In the Workflow editor, we are using the components as shown in the .. picture below, we save and publish the workflow .. .. image:: media/image73.png .. :alt: A screenshot of a computer AI-generated content may be .. incorrect. .. :width: 5.95728in .. :height: 4.01416in .. UC7 .. This use case will run with in situ data. .. Data search .. - Create an empty workflow as in Uc1 or UC2 .. - .. image:: media/image74.png .. :alt: A screenshot of a computer AI-generated content may be .. incorrect. .. :width: 6.5in .. :height: 2.98194in .. - Open Workflow editor and find the draft workflow with the name of uc7 .. - We add the following components and connected as described below .. .. image:: media/image75.png .. :alt: A screenshot of a computer AI-generated content may be .. incorrect. .. :width: 5.62064in .. :height: 2.58333in .. - We select data source in order to upload the uc7.zip as in situ data .. - Save the workflow .. - Publish the workflow .. - When the workflow ends a tiff is published going to zixel app .. .. .. .. image:: media/image76.png .. :width: 5.57995in .. :height: 3.77421in .. .. image:: media/image77.png .. :alt: A map of land with land and water AI-generated content may be .. incorrect. .. :width: 6.5in .. :height: 3.75069in .. .. |Screens screenshot of a computer AI-generated content may be incorrect.| image:: media/image16.png .. :width: 2.84042in .. :height: 1.40412in .. .. |A screenshot of a computer AI-generated content may be incorrect.| image:: media/image17.png .. :width: 3.13448in .. :height: 1.37981in .. .. |Screenshot_2024-05-28_at_2.12.21_PM| image:: media/image18.png .. :width: 2.12587in .. :height: 2.28895in .. .. |image1| image:: media/image19.png .. :width: 4.09193in .. :height: 2.3804in .. .. |image2| image:: media/image24.png .. :width: 6.5in .. :height: 3.57014in .. .. |image3| image:: media/image40.png .. :width: 6.25in .. :height: 3.125in .. .. |image4| image:: media/image41.png .. :width: 6.25in .. :height: 2.95833in .. .. |image5| image:: media/image42.png .. :width: 6.25in .. :height: 3.22516in .. .. |image6| image:: media/image43.png .. :width: 6.25in .. :height: 3.23958in .. .. |image7| image:: media/image44.png .. :width: 6.25in .. :height: 3.23958in .. .. |image8| image:: media/image45.png .. :width: 6.25in .. :height: 3.1875in .. .. |image9| image:: media/image46.png .. :width: 6.25in .. :height: 3.17708in .. .. |image10| image:: media/image47.png .. :width: 6.25in .. :height: 3.22917in .. .. |image11| image:: media/image48.png .. :width: 6.25in .. :height: 2.89583in .. .. |image12| image:: media/image49.png .. :width: 6.25in .. :height: 3.19792in .. .. |image13| image:: media/image25.png .. :width: 6.25in .. :height: 3.16667in .. .. |image14| image:: media/image50.png .. :width: 6.25in .. :height: 2.88542in .. .. |image15| image:: media/image51.png .. :width: 6.25in .. :height: 3.17708in .. .. |image16| image:: media/image52.png .. :width: 6.25in .. :height: 3.1875in .. .. |image17| image:: media/image43.png .. :width: 6.25in .. :height: 3.23958in .. .. |image18| image:: media/image44.png .. :width: 6.25in .. :height: 3.23958in .. .. |image19| image:: media/image53.png .. :width: 6.25in .. :height: 3.20833in .. .. |image20| image:: /media/image4b.png .. :width: 6.25in .. :height: 3.05208in