Import/Catalogue/Vicmap Address
Vicmap Address is an import of Vicmap Address, address data covering Victoria, Australia. The import is currently June 2021 at the planning stage.
Goals
The goal is to increase the coverage of address data in OSM from <10% currently to >95%, to allow for most addresses to be found by users searching with OSM. It's acknowledged that not all Vicmap addresses will be imported (due to low confidence on conflicts with existing OSM data).
It's is expected that Vicmap data once imported into OSM will be treated as native OSM data that can be further improved over time by mappers and not treated as "untouchable" or absolutely correct.
Schedule
Mon 23rd May 2022 - Import proposal sent to imports and cc talk-au mailing list.
Mon 30th May 2022 - Import executed per plan (date may be moved back if there is unresolved feedback or discussion from the proposal sent to imports)
Import Data
Background
Data source site: https://www.land.vic.gov.au/maps-and-spatial/spatial-data/vicmap-catalogue/vicmap-address
Data license: https://www.land.vic.gov.au/maps-and-spatial/spatial-data/vicmap-catalogue/vicmap-address
Type of license (if applicable): CC BY 4.0.
Link to permission (if required): https://wiki.openstreetmap.org/wiki/File:Vicmap_CCBYPermission_OSM_Final_Jan2018_Ltr.pdf
OSM attribution (if required): https://wiki.openstreetmap.org/wiki/Contributors#Victorian_Government_data
ODbL Compliance verified: yes
The import preparation code and further technical documentation is at https://gitlab.com/alantgeo/vicmap2osm/.
OSM Data Files
Being finalised at https://gitlab.com/alantgeo/vicmap2osm/ direct links TBA
Import Type
One time automated import via upload.py and other tools per https://gitlab.com/alantgeo/vicmap2osm#import-process.
Data Preparation
Data Reduction & Simplification
The import repository readme documents how the source Vicmap data has been processed into upload ready OSM data, but to summarise:
- Convert into OSM schema
- Remove duplicates where all address attributes match at the same location or within a small proximity
- Reduce address points with the exact same coordinates but different address attributes
Tagging Plans
The import repository readme documents tags and the mapping, but to summarise it's roughly:
OSM Tag | Vicmap Attrtibutes | ||
---|---|---|---|
addr:unit=* | ${BUNIT_PRE1}${BUNIT_ID1}${BUNIT_SUF1}-${BUNIT_PRE2}${BUNIT_ID2}${BUNIT_SUF2}
|
||
addr:housenumber=* | ${HSE_PRE1}${HSE_ID1}${HSE_SUF1}-${HSE_PRE2}${HSE_ID2}${HSE_SUF2}
|
||
addr:street=* | ${ROAD_NAME} ${ROAD_TYPE} ${RD_SUF}
|
Community feedback mostly preferred to omit addr:suburb=*, addr:state=* and addr:postcode=* tags, so these have been omitted.
Changeset Tags
Per https://gitlab.com/alantgeo/vicmap2osm/#changeset-tags changeset tags for the import are:
- source=Vicmap Address
- source:ref=https://www.land.vic.gov.au/maps-and-spatial/spatial-data/vicmap-catalogue/vicmap-address
Data Transformation
See the import repository readme.
Data Transformation Results
Post a link to your OSM XML files.
Data Merge Workflow
Team Approach
Currently the import has been developed and planned to be executed by aharvey (on osm, edits, contrib, heatmap, chngset com.), with the help of community feedback on talk-au. Anyone is free to volunteer to assist or be involved with this import.
References
List all factors that will be evaluated in the import.
Workflow
The import process is documented at https://gitlab.com/alantgeo/vicmap2osm#import-process.
The main part of the import will be done with a changeset per suburb. If for some reason a revert is needed, then likely this would be done with the JOSM reverter.
Conflation
This is described in full at the import repository readme, but to summarise:
Addresses were grouped by city block as it is rare that both OSM addresses and Vicmap addresses are incorrectly positioned in a different block.
- All the blocks without a single OSM address are considered to have no conflicts and therefore all Vicmap addresses in that block are imported as low risk for duplication.
- Where a candidate Vicmap address was found inside an existing address polygon from OSM, this is manually reviewed.
QA
Add your QA plan here.
See also
The email to the Imports mailing list was sent on YYYY-MM-DD and can be found in the archives of the mailing list at [1].
The email to the local Australian community was sent in May 2021, archived at https://lists.openstreetmap.org/pipermail/talk-au/2021-May/014622.html