Sardegna/Import/Address import for Sardinia
About
This page talks about importing addresses using the data provided by the Sardinia Region (Italy).
The import has been announced in the Talk-IT ad Talk-IT-Sardinia ML.
Import Plan Outline
Goals
This import goal is to use the high-quality dataset provided by the Sardinia Region in order to steadily improve the addresses available in OSM. It will cover 57 city/town and also will improve the name and the number of the streets mapped in Sardinia
Schedule
TBD.
Import Data
Background
Address format in Sardinia database
House numbering in Sardinia follows the European scheme.
An address in Sardinia is composed by housenumber, street name, city name and postcode.
Tagging Plans
The data is presented as a shapefile. We will use the strato03.zip and strato09zip files.
ST03TE01CL01.dbf that has the street names (corrected with an ogr2osm script to normalize the names, a slightly different version found here, already used in the address import of Biella. ST03TE01CL02.dbf that has the housenumbers ST03TE01CL05PTS.shp and ST03TE01CL06PTS.shp has the position of the housenumbers.
For city name i'll use the administration boundaries from OSM Boundaries 1.6 plus the data from the ST09TE01CL01PLG.shp that has the administration boundaries and the names of the cities and merge them from position on QGIS.
For postcode we extract the data from a CSV file from the Italian Government, that includes all the adddress from the Public Administration. The data is released with the IODL 2.0 (Italiano Open Data License 2.0).
All this shapes merged will result in a final shp that will be splitted by cities.
The shapefile will be converted to OSM XML using ogr2osm. The projection is correctly detected automatically as EPSG:4326 (WGS84 latitude-longitude).
The tags that will be used in the final upload are addr:housenumber, addr:street, addr:postcode and addr:city.
Legal
Data source site: http://www.sardegnageoportale.it/index.php?xsl=1598&s=269925&v=2&c=8831&t=1
Openstreetmap Foundation was explicitely authorized by the copyright owner to use and import all the data of Sardegna Geoportale:
https://wiki.openstreetmap.org/w/images/7/77/Autorizzazione_sardegna_openstreetmap.pdf
Import Type
The dataset will be imported in 57 changesets.
The datasets will be loaded in JOSM and they will be merged with existing OpenStreetMap data manually and prior to the upload.
Data Preparation
Tagging Plans
The data is presented as a shapefile. This shapefile consists in a collection of punctual elements, one for each housenumber.
The shapefile will be converted to EPSG:4326 (WGS84 latitude-longitude).
The tags that will be used in the final upload are addr:housenumber, addr:street, addr:postcode and addr:city.
Dedicated upload account
The account DarkSwan_Import will be used to upload the imported data.
Changeset Tags
Changeset will be tagged with source=Regione Autonoma della Sardegna.
Data Transformation
A python script will be used to normalize street names. The generated file will be manually edited to correct errors (i.e.: normalization failures, apostrophes instead of accents, person spelled with surname + name instead of name + surname, mispelled names, etc). It's better to edit one time now than multiple times later after the import.
Data Merge Workflow
Addresses already in OSM will be extracted using the following Overpass query wizard:
"addr:housenumber" = * in CITY NAME
Addresses already present will be merged manually.
In case of import problem the changeset will be reverted using the JOSM Reverter Plugin
QA Assurance
It will be used the Coloured Street Plugin for JOSM and OSM Inspector for correcting/adding the missing streets name and checking existing data against the imported one.
Sample data
Here is sample data of the final product of conversion.
Table of imported address
Fluminimaggiore (Portixeddu)||1| Name | Changeset |
|---|---|
| Aglientu | 1 |
| Alghero | 1 |
| Arborea | 1 |
| Arbus | 1 |
| Ardauli | 1 |
| Arzachena | 1 2 |
| Assemini | 1 |
| Badesi | 1 |
| Bari Sardo | 1 |
| Baunei | 1 |
| Boroneddu | 1 |
| Bosa | 1 |
| Budoni | 1 |
| Buggerru | 1 |
| Burcei | 1 |
| Cabras | 1 |
| Cagliari | 1 |
| Calasetta | 1 |
| Capoterra | empty |
| Carbonia | 1 |
| Cardedu | 1 |
| Carloforte | 1 |
| Castelsardo | 1 |
| Castiadas | 1 |
| Cuglieri (marina) | 1 |
| Decimomannu | 1 |
| Decimoputzu | 1 |
| Dolianova | 1 |
| Domus De Maria | 1 |
| Dorgali | 1 |
| Elmas | 1 |
| Flussio | 1 |
| Furtei | 1 |
| Gairo | empty |
| Galtellì | 1 |
| Giba | 1 |
| Girasole | 1 |
| Golfo Aranci | 1 |
| Gonnesa | 1 |
| Iglesias (Binda and Nebida) | 1 |
| Irgoli | 1 |
| Lanusei | 1 |
| Loculi | 1 |
| Lodine | 1 |
| Loiri Porto San Paolo | |
| Lotzorai | 1 |
| Magomadas | 1 |
| Maracalagonis | 1 |
| Marrubiu | 1 |
| Masainas | 1 |
| Modolo | 1 |
| Monastir | 1 |
| Monserrato | 1 |
| Muravera | 1 |
| Narbolia | empty |
| Nuoro | 1 |
| Nurachi | 1 |
| Olbia | 1 |
| Oliena | 1 |
| Onifai | 1 |
| Oristano | 1 |
| Orosei | [1 |
| Orotelli | 1 |
| Ottana | 1 |
| Palau | 1 |
| Perdaxius | 1 |
| Pompu | 1 |
| Porto Torres | 1 |
| Portoscuso | empty |
| Posada | 1 |
| Pula | 1 |
| Quartu Sant'Elena | 1 2 |
| Quartucciu | 1 |
| San Giovanni Suergiu | 1 |
| San Sperate | 1 |
| San Teodoro | 1 |
| San Vero Milis | |
| San Vito | 1 |
| Sanluri | 1 |
| Santa Giusta | 1 |
| Santa Maria Coghinas | 1 |
| Santa Teresa Gallura | 1 |
| Sant'Anna Arresi | 1 |
| Sant'Antioco | 1 |
| Sarroch | 1 |
| Sassari | 1 2 |
| Selargius | 1 |
| Sennori | 1 |
| Serdiana | 1 |
| Serramanna | 1 |
| Sestu | 1 |
| Settimo San Pietro | [1 |
| Siniscola (costa) | 1 |
| Sinnai | 1 |
| Soddì | 1 |
| Soleminis | 1 |
| Sorso | 1 |
| Stintino | 1 |
| Suni | 1 |
| Tempio Pausania | 1 |
| Tergu | 1 |
| Terralba | 1 |
| Tertenia | empty |
| Teulada | 1 |
| Thiesi | 1 |
| Tinnura | 1 |
| Torpè | 1 |
| Tortolì | 1 |
| Tramatza | 1 |
| Tresnuraghes | 1 |
| Triei | empty |
| Trinità D'Agultu e Vignola | 1 |
| Ussana | 1 |
| Uta | 1 |
| Valledoria | 1 |
| Viddalba | 1 |
| Villa San Pietro | 1 |
| Villanova Monteleone | 1 |
| Villaputzu | [1 |
| Villasimius | 1 |
| Villasor | |
| Villaspeciosa | 1 |