Address data import from ADS

From OpenStreetMap Wiki
Jump to navigation Jump to search

Address data import from ADS is an import from ADS (Address Data System, maintained by Maa-amet), covering Estonia.

Goals

Estonia has public, high quality address data available in ADS. This can be used to improve the quality of address data for existing buildings.

Schedule

First import was performed on July 12th, 2023. Regular sequential imports are planned as well.

Import Data

Background

Imported dataset: ADS extract

Data source site: https://xgis.maaamet.ee/adsavalik/extracts
Data license: https://avaandmed.eesti.ee/datasets/aadressiandmed:-jousolevad-aadressiobjektid
Type of license: CC0-1.0
ODbL Compliance verified: yes

Additional ETAK dataset is used for matching building geometry, but not imported:

Data source site: https://geoportaal.maaamet.ee/eng/Maps-and-Data/Estonian-Topographic-Database/Download-Topographic-Data-p618.html
Data license: https://geoportaal.maaamet.ee/opendata-licence
Link to permission: https://lists.openstreetmap.org/pipermail/talk-ee/2009-September/000171.html

OSM Data Files

Address tags for buildings are fetched from Overpass API, building geometry is downloaded Geofabrik.

Import Type

During initial import, over 10% (~100k) of Estonian buildings will be updated. Sequential imports are planned as well, but these will be tiny. Automated script will be used with upload.py to upload changesets.

Data Preparation

Tagging Plans

Special attention is used to make sure tagging is aligned with previous imports from Maa-amet and by using locally established tagging conventions.

Only following tag keys will be updated:

List of tag keys that can be deleted, if no longer relevant:

Changeset Tags

Key Value
comment ADS address update
import yes
import:page https://wiki.openstreetmap.org/wiki/Address_data_import_from_ADS
source Maa-amet
source:date YYYY-MM
source:license CC0-1.0
source:url https://xgis.maaamet.ee/adsavalik/

Data Transformation

Script is using Python/GDAL/PostgreSQL for data transformation and outputs a single CSV file that reflects the changes in address tags.

Data Transformation Results

Transformed results have been converted into augmented diffs. All the imported data can be previewed here.

Data Merge Workflow

Team Approach

Solo

Import workflow

Detail the steps you'll take during the actual import:

  • Running and observing the script that does the data transformation steps with the latest data.
  • Verifying the number of updated buildings is in line with previous test runs.
  • Running a script that generates osmChange file and sends it to OSM by upload.py.

Conflation

No elements (nodes/ways/relations) are created or deleted. Only address tags for existing buildings are being updated. External dataset is joined by matching building geometry during data transformation step.

QA

Visual comparison of changesets is done will be done by Achavi vs import preview, also based on Achavi.

See also

Discussion in the community forum was started on 2023-07-03 and can be found here

Retrieved from "https://wiki.openstreetmap.org/w/index.php?title=Address_data_import_from_ADS&oldid=2562118"