Description of the innovative procedures in the use case.
POPIMPACT-Innovative Procedures
-
-
Innovative Procedures:Project in which this issue occured
POPIMPACT
Tool used
Hale studio 4.1.0 ,win64, 32 GB de RAM
postgreSQL 14+ postGIS 3.1,win64, 32 GB de RAM
Description
High-Value Process
POPIMPACT presents as an innovative aspect that it is thinking as a High-Value process, and not just as a High-Value data set. Through postGIS functions it is obtained that the processed data can be different, and the process adapts to them.
The buildings layer can have different origins: from OSM, from cadastre inspire, from data models specific to each member country, etc. And each layer can allow one method or another, for example one has the number of dwellings, and another the residential area, etc.
The population layer can also have many origins: Eurostat 1 kilometre grid, 250 m regional grid, census sections, etc.
The process established in POPIMPACT adapts to these circumstances, through a dynamic and parameter-based procedure. The functions created in PostGIS receive as input a JSON with parameters that is the one that establishes the steps to be taken in the transformations: if the EPSG spatial information must be reprojected, what methods should be calculated, etc.
The attributes to be calculated are also defined: area, volume, height, etc. And if the buildings must be filtered by use, the value of the attribute to be filtered is defined.
Several Methods
An innovative aspect of POPIMPACT is that we can not only use a methodology to know the affected population in an emergency area.
4 methods are defined, -disaggregation methodologies based on the building footprint, volume, number of dwellings and residential area- and 1 to 4 of them can be applied in the same procedure, it only depends on the input data and what type of method can be applied to them. In this way, we can check the data of the methods indicated in the results.
These; It is observed that the most precise method is the volume method, it offers a distribution that is closer to reality.
Process Metadata
Another innovative aspect is that as a result of the process, not only high-value data is obtained, but also a metadata of the process is obtained. This metadata informs us of important aspects of the process, such as date, duration, unique identifier, input layers, etc. But it also gives us information on the quality of the result.
The metadata will have the following structure:
Microservices-based Architecture
POPIMPACT uses postGIS as a tool to calculate the disaggregation of the population in buildings. but we propose the implementation of an architecture based on microservices, through a REST API. In which, for each population area, a parallel procedure could be executed.
With this architecture, more scalability and speed in processing would be achieved. These are the necessary services:
• A service that returns the metadata of the service: its purpose, list of services, parameters, and so on.
• A service that sends you the data and parameters and returns the processed data and metadata.
• A service that is sent a zone to query, read from a spatial inventory, and returns the processed data and the metadata.
Spatial data source inventory
To facilitate access to the data of any person, with or without spatial knowledge, an inventory of the data to be used is proposed. It is a spatial index where the data or layers are associated with a hexagonal grid with the necessary data and already to apply the methodology.
This inventory involves establishing a grid, such as a spatial index, that allows knowing in each area what data is available for this procedure.
Innovative Procedures:Project in which this issue occured
POPIMPACT
Tool used
Hale studio 4.1.0 ,win64, 32 GB de RAM
postgreSQL 14+ postGIS 3.1,win64, 32 GB de RAM
Description
High-Value Process POPIMPACT presents as an innovative aspect that it is thinking as a High-Value process, and not just as a High-Value data set. Through postGIS functions it is obtained that the processed data can be different, and the process adapts to them. The buildings layer can have different origins: from OSM, from cadastre inspire, from data models specific to each member country, etc. And each layer can allow one method or another, for example one has the number of dwellings, and another the residential area, etc. The population layer can also have many origins: Eurostat 1 kilometre grid, 250 m regional grid, census sections, etc. The process established in POPIMPACT adapts to these circumstances, through a dynamic and parameter-based procedure. The functions created in PostGIS receive as input a JSON with parameters that is the one that establishes the steps to be taken in the transformations: if the EPSG spatial information must be reprojected, what methods should be calculated, etc. The attributes to be calculated are also defined: area, volume, height, etc. And if the buildings must be filtered by use, the value of the attribute to be filtered is defined.
Several Methods An innovative aspect of POPIMPACT is that we can not only use a methodology to know the affected population in an emergency area.
4 methods are defined, -disaggregation methodologies based on the building footprint, volume, number of dwellings and residential area- and 1 to 4 of them can be applied in the same procedure, it only depends on the input data and what type of method can be applied to them. In this way, we can check the data of the methods indicated in the results. These; It is observed that the most precise method is the volume method, it offers a distribution that is closer to reality.
Process Metadata Another innovative aspect is that as a result of the process, not only high-value data is obtained, but also a metadata of the process is obtained. This metadata informs us of important aspects of the process, such as date, duration, unique identifier, input layers, etc. But it also gives us information on the quality of the result. The metadata will have the following structure:
Microservices-based Architecture POPIMPACT uses postGIS as a tool to calculate the disaggregation of the population in buildings. but we propose the implementation of an architecture based on microservices, through a REST API. In which, for each population area, a parallel procedure could be executed.
With this architecture, more scalability and speed in processing would be achieved. These are the necessary services: • A service that returns the metadata of the service: its purpose, list of services, parameters, and so on. • A service that sends you the data and parameters and returns the processed data and metadata. • A service that is sent a zone to query, read from a spatial inventory, and returns the processed data and the metadata.
Spatial data source inventory To facilitate access to the data of any person, with or without spatial knowledge, an inventory of the data to be used is proposed. It is a spatial index where the data or layers are associated with a hexagonal grid with the necessary data and already to apply the methodology.
This inventory involves establishing a grid, such as a spatial index, that allows knowing in each area what data is available for this procedure.
Type of issue
other issue: Innovative Procedures
Workflow
None
Impact
Impact to arquitecture
Related issue(s)
POPIMPACT - Data harmonisation #16