User:NEOers

From OpenStreetMap Wiki
Jump to navigation Jump to search

Goals

The goal of the import is to update the power datasets for Liberia, Dominican Republic and Bangladesh which was produced under a World Bank Group assignment on Electricity Transmission Grid Mapping. A deep learning model and smart tracing method was developed to map the transmission towers automatically with human aided quality control based on 50cm high resolution satellite imagery. The power datasets contain point data layers of power transmission towers, power plants, (sub)stations and powerlines for three countries, Liberia, Dominican Republic and Bangladesh.

The power dataset of OpenStreetMap for these countries is of various quality and not always up-to-date reflecting current situation, and the attribute information can be bare or missing. This dataset will enable us to bridge the gaps. In the case of where the data already exists, additional information were added to enrich the dataset while in the areas of no electricity transmission infrastructures the dataset are added to contribute to the completeness of the power transmission network which can be used for various development and planning activities.

Schedule

Community outreach and agreement is currently ongoing and planned for the month of May and June 2023.

Data import and editing is planned for 2023 June/July.

The import list will follow the sequence below:

  • Liberia
  • Dominican Republic
  • Bangladesh

Import Data

Background

This import is one component of the Global Electricity Transmission Grid Mapping assignment by the World Bank Group to create a global transmission network dataset for supporting countries in undertaking development project activities such as least-cost electrification planning studies, renewable energy resources mapping and system integration studies etc. The data produced under the assignment will be published on open platforms to be accessible for free to the public.

The data is produced using a smart tracing and deep learning method developed under the project and has gone through human quality control. The method uses Mapbox Very High Resolution (VHR) satellite image (50cm) raster tiles at zoom level 18. Open datasets from online resources and documentation such as power grid master plan etc. are used for referencing and validation. The data imported to OSM will be released under Creative Commons Attribution License and ODbL license (to be further comfirmed).

Data source site: https://energydata.info/ (This is a temporary link which reflect the data source. The link will be updated to a more specific link) pointing to the dataset.)

Data license: Creative Commons Attribution License ( CC BY 4.0)

Type of license (if applicable): Creative Commons Attribution License ( CC BY 4.0)

Link to permission (if required): https://energydata.info/about_us

OSM attribution (if required): http://wiki.openstreetmap.org/wiki/Contributors#yourdataprovider

ODbL Compliance verified: To be confirmed.

OSM Data Files

Link to your source data files: https://energydata.info/ (This is a temporary link which reflect the data source. The link will be updated to a more specific link) pointing to the dataset.)

Attributes information for data to be imported and the corresponding OSM tags
Layer Name Attributes OSM Tags
Power plant Name

Capacity

power=*
Power station Name

Voltage

power=*
Power line Voltage

Length

power=*
Power tower Image product

Timestamp Elevation ElevSource

power=*

Import Type

This is a one time import where we will upload data country by country. This will be done in a semi-automated manner with script and manual monitoring for the quality control purpose.

It is planned to start with a pilot area. The response from the pilot will serve as learning phase for further imports. Once the changes are accepted, imports for the entire areas will be performed..

The data will be converted to GeoJSON format for uploading.

API and JOSM will be tested and the most suitable approach will be used for data uploading.

Data Preparation

Data Reduction & Simplification

The dataset will be checked against OSM power dataset to reduce the duplication and redundancy. The cleaned data will be used for conversion and import.

The power line dataset will be smoothed to reduce the unnecessary vertices.

Changeset Tags

All tags essential for each type of layer will be included into the layer prior to the upload.

We will add these changeset tags

  • comment = 'updated dataset from energydata.info'

Data Transformation

The attributes of the datasets as well as format of the dataset will be adjusted to match OpenStreetMap publish standards.

Tools

FME workspace and QGIS will be used for the data check, filtering and conversion.

Java Open Street Map Editor will be used for validation of data, conflicts resolving and data uploading.

Data Merge Workflow

Team Approach

The import work are done in a team with clear roles and tasks defined as following:

  • Requirements checking and validation
  • Development of workflow and scripts
  • Testing the workflow and process
  • Quality assurance of the import process

Workflow

  1. Create OSM wiki page of data import plan
  2. Community reach out for requesting data import permission
  3. Follow import plan for data preparation
  4. Pilot area define and data preparation ( clean, filtering, conversion etc)
  5. Run validation checks for geolocation, overlaps and other errors as stated in the OSM guidelines.
  6. Address identified errors/warnings
  7. Import data to OSM once all issues are resolved.
  8. Perform the above actions for the rest of the areas to compete the import

Conflation

The dataset will be compared with existing OSM dataset for the country to categorize point, lines which are in or not in the current OSM dataset. The ones that are not in is the additional dataset which will be imported to the OSM to provide more up to date information while avoiding redundancy.

Disclaimer

The World Bank does not necessarily own each component of the content contained within this work. Any input dataset or simulation outcome produced in this project does not represent the official position of the World Bank Group. The World Bank does not guarantee the accuracy of the data included in this work. The boundaries, colours, denominations, and other information shown on the outputs do not imply on the part of the World Bank any judgment, endorsement, or acceptance of such boundaries.