Import/Catalogue/sous-surveillance.net

From OpenStreetMap Wiki
Jump to navigation Jump to search

Cameras from surveillance.net is an import of a dataset build and managed by the website sous-surveillance.net. The dataset is of type GeoJson containing a FeatureCollection of cameras. The features are already, nearly compliant with man_made=surveillance. The dataset is covering many cities in France, Belgium, Luxembourg and also with less importance few cities elsewhere in the world (Montréal, Seattle, Moscow and Minsk).

Note for mappers: don't hesitate to update the cameras information in OSM if you found some of them with the tag source=sous-surveillance.net. You can even remove this tag if you survey it by yourself but please leave the tag ref:sous-surveillance_net=*.

Context

Sous-surveillance.net was created 7 years ago in order to develop the inventorisation of cameras by local groups. For technical reasons, their inventory was not stored in Openstreetmap but in their own database. Their database was filled by multiple contributors and there is also a validation process for each camera. The size of their inventory is quite impressive as it includes around 20 000 cameras mostly located in France and Belgium where OSM includes around 80 000 cameras in the whole world. Today, they are ready to join the mapping effort with OSM. Therefore, discussions are currently happening with them to realize this import. Adaptation of their website to work with OSM is also discussed which would avoid future divergence of the databases and would bring new valuable indirect contributors to OSM. Note the final quantity of cameras imported in OSM will probably determined if sous-surveillance.net switches to OSM as back-end database. This should not push us to import their data at any price but we should consider carefully their valuable data.

Goals

The goal of the import is to merge the cameras inventoried by Sous-surveillance.net that are not already in Openstreetmap.

Schedule

✔️ 10/2019 - Discussion with sous-surveillance.net and Openstreetmap Belgium.
✔️ 10/2019 - Proposition to sous-surveillance.net

✔️ 03/2020 - Import limited to Brussels in OSM (authorization granted)

✔️ 09/2020 - Authorization granted to import the full dataset

✔️ 09/2020 - Communication towards OSM France

  • Import in OSM

Import Data

Background

Data source site: https://www.sous-surveillance.net/

Link to permission:

extract from ******@sous-surveillance.net:

C'est ok pour le transfert.

OSM Data Files

The OSM data file are available [???here???].

Import Type

The import will be a one-time import that will be prepared with python and then performed in JOSM.

In python, the dataset will be converted according to the translation table. The ipynb is available https://gitlab.com/vucod/osm-import-sous-surveillance.net-brussels/-/tree/master.

Data Preparation

The source dataset is nearly compliant with the values associated to the man_made and the related tags. The data preparation is described in the translation table.

Tagging Plans

The cameras will be added as nodes according the following translation table:

Translation table

Original data OSM tagging Comment
man_made=surveillance Will be added to every nodes
surveillance:type=camera Will be added to every nodes
survey:date=* Will be added based on the submission date of the camera on the sous-surveillance.net website.
apparence camera:type=* Type "dome" will be kept. "radar" will be not kept but surveillance:type will be set to "ALPR".

"boîte", "nue", "encastre" will be converted to "fixed" except if camera:feature=motion is set. Then, type will be set to camera:type=panning

camera:mount=* If apparence is set to "encastre". The value "wall" will be set.
direction camera:direction=*
angle camera:angle=*
camera_zoom camera:feature=* If camera_zoom is true, "zoom" will be added to the key camera:feature
camera_rotation camera:feature=* If camera_rotation is true, "motion" will be added to the key camera:feature
op_type surveillance=* "private" value will be converted to "outdoor" value
title name=*
op_name operator=*
id_camera ref:sous-surveillance_net=*
description description=*
zone Not imported (geographical area)

The latitude and the longitude in the sous-surveillance dataset will be used for the longitude=*and latitude=* of the nodes associated to cameras.

Note that some of the keys come from this proposal for the extension of man_made=surveillance : https://wiki.openstreetmap.org/wiki/Proposed_features/Extended_tags_for_Key:Surveillance

Changeset Tags

Data Merge Workflow

Team Approach

The import will be done by User:Vucod via a dedicated account (User:VucodImport) with support of Openstreetmap Belgium.

Workflow

In the following, an osm camera is : man_made=surveillance and surveillance:type=camera. Several steps will be done to ensure a successful merge process :

  • Any camera from source that is closer than 5 meters from an OSM camera will excluded unless there is a closer camera in source.
  • Any camera from source that is located between 5 and 10 meters from an OSM camera will be marked with fixme="This may be a duplicated camera" , unless there is a closer camera in source.
  • Any camera with a survey:date=* older than 10 years will be marked with fixme="This may be disused"

The other cameras will be directly added to OSM. In case of problem, the one-time import changeset will be reverted.

Following our current estimations:

  • 92.5% of the cameras will be directly imported (~16k)
  • 7% of the cameras will not be imported (~1k)
  • 0.5% of the cameras will be marked with fixme=* (~100)

Conflation

Conflation process is described in the workflow

QA

Reviewing process can performed in sous-surveillance.net if the website has migrated to Openstreetmap or on [1] where cameras are shown in details and where there is specific icons if the nodes contain the key fixme=*


Cameras not found

Please add the sous-surveillance id of cameras that were not found so that later imports ignore ithem.

- id51example456189

See also

Retrieved from "https://wiki.openstreetmap.org/w/index.php?title=Import/Catalogue/sous-surveillance.net&oldid=2684848"