User:NEOers
Goals
The goal of the import is to update the power datasets for Liberia, Dominican Republic and Bangladesh which was produced under a World Bank Group assignment on Electricity Transmission Grid Mapping. A deep learning model and smart tracing method was developed to map the transmission towers automatically with human aided quality control based on 50cm high resolution satellite imagery. The power datasets contain point data layers of power transmission towers, power plants, (sub)stations and powerlines for three countries, Liberia, Dominican Republic and Bangladesh.
The power dataset of OpenStreetMap for these countries is of various quality and not always up-to-date reflecting current situation, and the attribute information can be bare or missing. This dataset will enable us to bridge the gaps. In the case of where the data already exists, additional information were added to enrich the dataset while in the areas of no electricity transmission infrastructures the dataset are added to contribute to the completeness of the power transmission network which can be used for various development and planning activities.
Schedule
Community outreach and agreement is currently ongoing and planned for the month of May and June 2023.
Data import and editing is planned for 2023 June/July.
The import list will follow the sequence below:
- Liberia
- Dominican Republic
- Bangladesh
Import Data
Background
This import is one component of the Global Electricity Transmission Grid Mapping assignment by the World Bank Group to create a global transmission network dataset for supporting countries in undertaking development project activities such as least-cost electrification planning studies, renewable energy resources mapping and system integration studies etc. The data produced under the assignment will be published on open platforms to be accessible for free to the public.
The data is produced using a smart tracing and deep learning method developed under the project and has gone through human quality control. The method uses Mapbox Very High Resolution (VHR) satellite image (50cm) raster tiles at zoom level 18. Open datasets from online resources and documentation such as power grid master plan etc. are used for referencing and validation. The data imported to OSM will be released under Creative Commons Attribution License and ODbL license (to be further comfirmed).
Data source site: https://energydata.info/ (This is a temporary link which reflect the data source. The link will be updated to a more specific link) pointing to the dataset.)
Data license: Creative Commons Attribution License ( CC BY 4.0)
Type of license (if applicable): Creative Commons Attribution License ( CC BY 4.0)
Link to permission (if required): https://energydata.info/about_us
OSM attribution (if required): http://wiki.openstreetmap.org/wiki/Contributors#yourdataprovider
ODbL Compliance verified: To be confirmed.
OSM Data Files
Link to your source data files: https://energydata.info/ (This is a temporary link which reflect the data source. The link will be updated to a more specific link) pointing to the dataset.)
Layer Name | Attributes | OSM Tags |
---|---|---|
Power plant | Name
Capacity |
power=* |
Power station | Name
Voltage |
power=* |
Power line | Voltage
Length |
power=* |
Power tower | Image product
Timestamp Elevation ElevSource |
power=* |
Import Type
This is a one time import where we will upload data country by country. This will be done in a semi-automated manner with script and manual monitoring for the quality control purpose.
It is planned to start with a pilot area. The response from the pilot will serve as learning phase for further imports. Once the changes are accepted, imports for the entire areas will be performed..
The data will be converted to GeoJSON format for uploading.
API and JOSM will be tested and the most suitable approach will be used for data uploading.
Data Preparation
Data Reduction & Simplification
The dataset will be checked against OSM power dataset to reduce the duplication and redundancy. The cleaned data will be used for conversion and import.
The power line dataset will be smoothed to reduce the unnecessary vertices.
Changeset Tags
All tags essential for each type of layer will be included into the layer prior to the upload.
We will add these changeset tags
- comment = 'updated dataset from energydata.info'
Data Transformation
The attributes of the datasets as well as format of the dataset will be adjusted to match OpenStreetMap publish standards.
Tools
FME workspace and QGIS will be used for the data check, filtering and conversion.
Java Open Street Map Editor will be used for validation of data, conflicts resolving and data uploading.
Data Merge Workflow
Team Approach
The import work are done in a team with clear roles and tasks defined as following:
- Requirements checking and validation
- Development of workflow and scripts
- Testing the workflow and process
- Quality assurance of the import process
Workflow
- Create OSM wiki page of data import plan
- Community reach out for requesting data import permission
- Follow import plan for data preparation
- Pilot area define and data preparation ( clean, filtering, conversion etc)
- Run validation checks for geolocation, overlaps and other errors as stated in the OSM guidelines.
- Address identified errors/warnings
- Import data to OSM once all issues are resolved.
- Perform the above actions for the rest of the areas to compete the import
Conflation
The dataset will be compared with existing OSM dataset for the country to categorize point, lines which are in or not in the current OSM dataset. The ones that are not in is the additional dataset which will be imported to the OSM to provide more up to date information while avoiding redundancy.
Disclaimer
The World Bank does not necessarily own each component of the content contained within this work. Any input dataset or simulation outcome produced in this project does not represent the official position of the World Bank Group. The World Bank does not guarantee the accuracy of the data included in this work. The boundaries, colours, denominations, and other information shown on the outputs do not imply on the part of the World Bank any judgment, endorsement, or acceptance of such boundaries.