Fortaleza/PMF Addresses Import

From OpenStreetMap Wiki
Jump to navigation Jump to search
Proposal Data Conversion Work Plan Import Guide Progress


Addresses Import describes a proposal being developed to import data provided by the Secretariat of Finances of the Fortaleza City Council in Brazil. If you want to participate actively go to the import guide. If you want to know all the details of the proposal, read on.

It is important to note that this import is semi-automated, due to the nature of the available data, that is, it is not possible to import the data all at once. This requires a higher user experience, taking more time to perform the import and the necessary adjustments for OSM upload.

Goal

This project aims to manually conflate addresses available from the Secretariat of Finances' Spatial Data Infrastructure platform provided by the city council.

Schedule

  1. August 2021: Preparation of the import proposal in the wiki, discussion in the OSM Ceará Telegram group and data testing and validation.
  2. September 2021: Disclosure in talk-br list (in Portuguese), discussion in the OSM Brazil Telegram group, and submission of the import proposal to the Imports List.
  3. September 2021: Annotation in the Import Catalog.
  4. September 2021: Import beginning
  5. future: Import ending

Data to be imported

Data description

The data is provided by the Secretariat of Finances of Fortaleza City Council, through its Spatial Data Infrastructure (SDI) platform. The data is constantly updated, and is available in different formats, such as CSV or SHP. The data, originally, refers to the tax parcels, that contains many information such as address (the only data that matters for this import). The data is of a good quality (positioning and correctness), but does not cover all addresses (varying a lot, depending on the neighborhood).

Data source

The data can be accessed on the aforementioned SDI (in Portuguese), through the following procedure:

  • Click on Downloads;
  • Cartografia Base (Base Cartography);
  • Quadras Fiscais (Tax Parcels) and;
  • Select CSV or SHP file, and then download it.

Warning: it could take a while to start the download, it is normal.

License of access and use

The OSM community has explicit permission to use the SDI's data, according to the user User icon 2.svgmatheusgomesms (on osm) and the Secretariat's e-mail exchanges.

Size of the data set

The SHP file is 175MB and the compressed SHP is 62MB. After filtering and cleaning, there are a total of 377,451 addresses.

Data conflation

This is the strategy to avoid conflicts with existing data:

  • If possible, initially a filtering must be made in Overpass Turbo, observing addresses that are already mapped in the OSM, and then remove those addresses from those provided by the city council. If not possible, a manual check is mandatory.
  • In principle, the addresses that are already mapped in the OSM must remain, as recommended. Eventually, if they are in significant disagreement, they can be complemented by those from the city council layer, maintaining the OSM tagging data. The total replacement comes as a last case, to not lose the history of the previous address in the OSM.

Data import

A more detailed tutorial is available on the Import Guide tab.

However, given that there may be problems with imported data that require manual intervention, a manual import is planned with a review of each object to be imported.

Work plan

The volume of data to be imported is very large. Therefore, it is proposed to carry out the work by regions, starting from the smallest to the largest. It is thought to carry out the division by neighborhoods, using the number of addresses as a parameter. In larger neighborhoods, work can be divided into blocks, if it is of interest to the volunteers. More details are shown in the Work Plan tab.

Regression plan

If necessary, the changes will be undone using the JOSM/Plugins/Reverter plugin.

Acknowledgments

We would like to thank the contribution of the Fortaleza City Council in providing the data. We also gratefully acknowledge the support from Kaart, which allowed us to work on this import.