Sardegna/Import/Address import for Sardinia

From OpenStreetMap Wiki
Jump to: navigation, search

About

This page talks about importing addresses using the data provided by the Sardinia Region (Italy).

The import has been announced in the Talk-IT ad Talk-IT-Sardinia ML.

Import Plan Outline

Goals

This import goal is to use the high-quality dataset provided by the Sardinia Region in order to steadily improve the addresses available in OSM. It will cover 57 city/town and also will improve the name and the number of the streets mapped in Sardinia

Schedule

TBD.

Import Data

Background

Address format in Sardinia database

House numbering in Sardinia follows the European scheme.

An address in Sardinia is composed by housenumber, street name, city name and postcode.

Tagging Plans

The data is presented as a shapefile. We will use the strato03.zip and strato09zip files.

ST03TE01CL01.dbf that has the street names (corrected with an ogr2osm script to normalize the names, a slightly different version found here, already used in the address import of Biella. ST03TE01CL02.dbf that has the housenumbers ST03TE01CL05PTS.shp and ST03TE01CL06PTS.shp has the position of the housenumbers.

For city name i'll use the administration boundaries from OSM Boundaries 1.6 plus the data from the ST09TE01CL01PLG.shp that has the administration boundaries and the names of the cities and merge them from position on QGIS.

For postcode we extract the data from a CSV file from the Italian Government, that includes all the adddress from the Public Administration. The data is released with the IODL 2.0 (Italiano Open Data License 2.0).

All this shapes merged will result in a final shp that will be splitted by cities.

The shapefile will be converted to OSM XML using ogr2osm. The projection is correctly detected automatically as EPSG:4326 (WGS84 latitude-longitude).

The tags that will be used in the final upload are addr:housenumber, addr:street, addr:postcode and addr:city.

Legal

Data source site: http://www.sardegnageoportale.it/index.php?xsl=1598&s=269925&v=2&c=8831&t=1

Openstreetmap Foundation was explicitely authorized by the copyright owner to use and import all the data of Sardegna Geoportale:

https://wiki.openstreetmap.org/w/images/7/77/Autorizzazione_sardegna_openstreetmap.pdf

Import Type

The dataset will be imported in 57 changesets.

The datasets will be loaded in JOSM and they will be merged with existing OpenStreetMap data manually and prior to the upload.

Data Preparation

Tagging Plans

The data is presented as a shapefile. This shapefile consists in a collection of punctual elements, one for each housenumber.

The shapefile will be converted to EPSG:4326 (WGS84 latitude-longitude).

The tags that will be used in the final upload are addr:housenumber, addr:street, addr:postcode and addr:city.

Dedicated upload account

The account DarkSwan_Import will be used to upload the imported data.

Changeset Tags

Changeset will be tagged with source=Regione Autonoma della Sardegna.

Data Transformation

A python script will be used to normalize street names. The generated file will be manually edited to correct errors (i.e.: normalization failures, apostrophes instead of accents, person spelled with surname + name instead of name + surname, mispelled names, etc). It's better to edit one time now than multiple times later after the import.

Data Merge Workflow

Addresses already in OSM will be extracted using the following Overpass query wizard:

"addr:housenumber" = * in CITY NAME

Addresses already present will be merged manually.

In case of import problem the changeset will be reverted using the JOSM Reverter Plugin

QA Assurance

It will be used the Coloured Street Plugin for JOSM and OSM Inspector for correcting/adding the missing streets name and checking existing data against the imported one.

Sample data

Here is sample data of the final product of conversion.

Table of imported address

Fluminimaggiore (Portixeddu)||1
Name Changeset
Aglientu 1
Alghero 1
Arborea 1
Arbus 1
Ardauli 1
Arzachena 1 2
Assemini 1
Badesi 1
Bari Sardo 1
Baunei 1
Boroneddu 1
Bosa 1
Budoni 1
Buggerru 1
Burcei 1
Cabras 1
Cagliari 1
Calasetta 1
Capoterra empty
Carbonia 1
Cardedu 1
Carloforte 1
Castelsardo 1
Castiadas 1
Cuglieri (marina) 1
Decimomannu 1
Decimoputzu 1
Dolianova 1
Domus De Maria 1
Dorgali 1
Elmas 1
Flussio 1
Furtei 1
Gairo empty
Galtellì 1
Giba 1
Girasole 1
Golfo Aranci 1
Gonnesa 1
Iglesias (Binda and Nebida) 1
Irgoli 1
Lanusei 1
Loculi 1
Lodine 1
Loiri Porto San Paolo
Lotzorai 1
Magomadas 1
Maracalagonis 1
Marrubiu 1
Masainas 1
Modolo 1
Monastir 1
Monserrato 1
Muravera 1
Narbolia empty
Nuoro 1
Nurachi 1
Olbia 1
Oliena 1
Onifai 1
Oristano 1
Orosei [1
Orotelli 1
Ottana 1
Palau 1
Perdaxius 1
Pompu 1
Porto Torres 1
Portoscuso empty
Posada 1
Pula 1
Quartu Sant'Elena 1 2
Quartucciu 1
San Giovanni Suergiu 1
San Sperate 1
San Teodoro 1
San Vero Milis
San Vito 1
Sanluri 1
Santa Giusta 1
Santa Maria Coghinas 1
Santa Teresa Gallura 1
Sant'Anna Arresi 1
Sant'Antioco 1
Sarroch 1
Sassari 1 2
Selargius 1
Sennori 1
Serdiana 1
Serramanna 1
Sestu 1
Settimo San Pietro [1
Siniscola (costa) 1
Sinnai 1
Soddì 1
Soleminis 1
Sorso 1
Stintino 1
Suni 1
Tempio Pausania 1
Tergu 1
Terralba 1
Tertenia empty
Teulada 1
Thiesi 1
Tinnura 1
Torpè 1
Tortolì 1
Tramatza 1
Tresnuraghes 1
Triei empty
Trinità D'Agultu e Vignola 1
Ussana 1
Uta 1
Valledoria 1
Viddalba 1
Villa San Pietro 1
Villanova Monteleone 1
Villaputzu [1
Villasimius 1
Villasor
Villaspeciosa 1