OSMer in residence Program data import

From OpenStreetMap Wiki
Jump to navigation Jump to search

Project goal

The data to be imported in this campaign in Nigeria is part of the OSMer in Residence program, a collaboration between HOT's North and West Africa HUB and Médéçins Sans Frontières. This is a win-win collaboration between the two organizations, in which the expertise of a member of a local OSM community is made available to an organization with a well-defined technical need. The data to be imported are historical data relating to health structures from MSF's various missions where they have been involved in Nigeria in the past. For more information on the OSMer in Residence program, please consult the following link.

Nigeria

You can consult the OSM Nigeria Wiki page here.

Schedule

The planning of the import started in mid January 2024, we would like to have the import completed in February 2024.

Import account

For this campaign we encourage contributors from Nigeria to use a different account from their personal account. We therefore strongly encourage them to create new accounts for this campaign if they do not already have one .

Data to import

Data background

The data to be imported here are historical data collected by MSF concerning health structures in Nigeria. It is difficult to give the context and date of data collection for these health structures. Nevertheless, these data have been stored in the MSF Master database and are being used by the MSF operations.

Osm data files

Import type

The best approach to import this data is manually by the Nigerian volunteers community, with data split in a number of challenges in Maproulette.

Advantages:

  • Any volunteers may join the import effort, at any time (although only skilled mappers should join).
  • We can check, at any time, the mapping progress of the import.
  • We can easily validate each task too, and check the validation progress.

Data preparation

Tagging plan

The MSF database has its own nomenclature for tagging healthcare facilities. In this case, we have five categories of health facility, namely: health_center; health_post, hospital, clinic and dispensary. The data attribute fields selected in the MDB are: iso3; name_en; operated_b; hlfac_typ and source. These fields were selected because their equivalents exist on osm and the other fields had empty contents.

Find here a list with all original attributes and their corresponding translation into the OSM tagging schema:

MDB Attributes MDB Attributes meaning OSM Tag
ISO 3 Country code of Nigeria where the health facilities have been collected /
name_en Name of the health facilities in english that have been collected name=*
operated_b Name of the institution responsible of the health facility operator=*
hlfac_typ=

clinic

hospital

dispensary

health-centre

health post

Type of the health facilities amenity=clinic

amenity=hospital

health_facility:type=dispensary

health_facility:type=health_centre

amenity=health post

source Source of the health facility data collected source=*

Changeset tag

We will use the following changeset tags generated automatically when you want to upload a data:

Data transformation

  1. The original file (in shapefile) comes from the MSF Master Data base after having been applied the query on health structures present in Nigeria found in this base and whose source is MSF.
  2. In Qgis, empty and irrelevant tags were removed, while those easily adaptable to the OSM language were left.
  3. We then opened this cleaned file in QGIS on JOSM using the opendata plugin and saved it in osm format.
  4. The file, saved in osm servira format, will be integrated into maproulette and will propose different tasks to be mapped.

Note: We have retained the msf attributes in maproulette because the data contained several themes with different attributes. As a result, the transformation of this data into the osm language will take place directly during import.

Data merge workflow

Team Approach

This import (data integration) will be done through Maproulette, so the number of people who will import the data is unknown, but we expect volunteers mapper from the Nigeria community as they have a good knowledge of their country and the context of data. Training will be done beforehand to build the community's capacity to use maproulette, understand msf attributes and how to tag them in order to produce quality data: Some necessary skills:

  • Have an import account different from the personal account;
  • Have JOSM installed in your workstation;
  • Basic knowledge of tagging on osm

Reference

Workflow

We will use the JOSM editor for this import.

Step by step instructions

There are several ways to reach the same results. We have tried to find the simplest one, the less error-prone and the one that assures a higher level of consistency across different import volunteers. The proposed workflow is as follows:

  • The editor

We encourage contributors to use the editor they prefer. This may be JOSM . The choice of editor is made after selecting the challenge to map.

  • Imagery

Bing imagery is strongly encouraged for this data import campaign. However, should contributors encounter problems associated with imagery (cloudy areas or clarity issues), they can change imagery to better appreciate the area.

  • How to map
  1. Enable remote control on josm, which will enable communication between the maproulette server and josm.
  2. Create a point approximately where it is located on maproulette in the selected editor
  3. Copy the object's properties from maproulette and paste them into the editor . These properties will be indicators, but you'll need to adapt them to a language that osm can understand. For this reason, please refer to the tagging plan for this campaign, to see what each property corresponds to and how it fits in OSM.
  4. If a health structure already exists, make a property comparison between the health structure on OSM with the properties that you have with maproulette. If there is a property in the MSF data that the OSM data does not contain, add it to the properties of the existing data on OSM.
  5. For health structures that don't come across buildings directly, identify the nearest building and, if no building exists nearby, move on to a challenge.
  6. If you're faced with challenges whose object properties are unknown, don't add them to osm, skip the challenge.
  7. When the task is complete, the modifications can be sent, remembering to describe the operation performed and the campaign hashtag.

Conflation

To compare data from the MSF database with that already present on OSM, we're going to do this manually. We're going to look at the attribute names of the data from the different sources. If we have similar names even though the positions of the objects are different, we consider that the data already exists on OSM.  If the msf data has more complete attributes than the data in OSM, we will integrate them into the OSM data.

Quality assessment

Project update

Niger

You can consult the OSM Niger Wiki Page here

Schedule

The planning of the import started in mid January 2024, we would like to have the import completed in February 2024.

  • 11th January 2024: Meeting with the OSM community in Niger to present the OSMer in Residence program, the data to be imported and the different expectations of the community.
  • 24th January 2024: Training on Maproulette

Import account

For this campaign we encourage contributors from Niger to use a different account from their personal account. We therefore strongly encourage them to create new accounts for this campaign if they do not already have one

Data to import

Data background

The data to be imported here are historical data collected by MSF concerning health facilities and villages in Niger. It is difficult to give the context and date of data collection for these health structures but for the villages they have been collected in 2022. Nevertheless, these data have been stored in the MSF Master database and are being used by the MSF operations. MSF has given full authorization for the use of their data in OpenStreetMap by communities. A scan of the document can be found here

289 data to be imported into OSM, 183 for health facilities and 106 for villages.

Osm data files

Import type

The best approach to import this data is manually by the community, with data split in a number of challenges in Maproulette.

Advantages:

  • Any volunteers may join the import effort, at any time (although only skilled mappers should join).
  • We can check, at any time, the mapping progress of the import.
  • We can easily validate each task too, and check the validation progress.

Data preparation

Tagging plan

The MSF database has its own nomenclature for tagging healthcare facilities. for the import campaign in Niger, we have four categories of health facility, namely: health_center (hc); health_post (hp), hospital, clinic . The data attribute fields selected in the MDB are: iso3; name_fr; operated_b; hlfac_typ and source. These fields were selected because their equivalents exist on osm and the other fields had empty contents.

Find here a list with all original attributes and their corresponding translation into the OSM tagging schema:

MDB Attributes MDB Attributes meaning OSM Tag
ISO3=ner Country code of Niger where the health facilities have been collected iso3=ner
name_fr Name of the health facilities in French that have been collected name=*
hlfac_typ=

clinic

hospital

hc (health_centre)

hp (health post)

Type of the health facilities amenity=clinic

amenity=hospital

health_facility:type=health_centre

amenity=health post

source=msf Source of the health facility data collected source=MSFsurvey
Villages attributes
ISO3=ner Country code of Niger where the villages have been collected iso3=ner
name_fr Name of the villages in French that have been collected name=*
type=village Type of village place=village
source=msf Source fo the village data collected source=MSFsurvey

Changeset tag

We will use the following changeset tags generated automatically when you want to upload a data:

comment=#osmerinresidence_niger #maproulette #missingMaps #MSF #WNAH

Data transformation

  1. The original file (in shapefile) comes from the MSF Master Data base after having been applied the query on health structures present in Nigeria found in this base and whose source is MSF.
  2. In Qgis, empty and irrelevant tags were removed, while those easily adaptable to the OSM language were left.
  3. We then opened this cleaned file in QGIS on JOSM using the opendata plugin and saved it in osm format.
  4. The file, saved in osm servira format, will be integrated into maproulette and will propose different tasks to be mapped.

Note: We have retained the msf attributes in maproulette because the data contained several themes with different attributes. As a result, the transformation of this data into the osm language will take place directly during import.

Data merge workflow

Team Approach

This import (data integration) will be done through Maproulette, so the number of people who will import the data is unknown, but we expect volunteers mapper from the Niger community as they have a good knowledge of their country and the context of data. Training will be done beforehand to build the community's capacity to use maproulette, understand msf attributes and how to tag them in order to produce quality data: Some necessary skills

  • Have an import account different from the personal account;
  • Have JOSM installed in your workstation;
  • Basic knowledge of tagging on osm

Reference

Following the imports guidelines, We first have a meeting with the communities leaders especially the OSM Niger president to explain him the project. Then an additional meeting was organised with the osm local community in Niger via a meeting on Google meeting.

Meeting with the OSM Niger community

Workflow

We will use the JOSM editor for this import.

Step by step instructions

There are several ways to reach the same results. We have tried to find the simplest one, the less error-prone and the one that assures a higher level of consistency across different import volunteers. The proposed workflow is as follows:

  • The editor

We encourage contributors to use the editor they prefer. This may be JOSM . The choice of editor is made after selecting the challenge to map.

  • Imagery

Bing imagery is strongly encouraged for this data import campaign. However, should contributors encounter problems associated with imagery (cloudy areas or clarity issues), they can change imagery to better appreciate the area.

  • How to map
  1. Enable remote control on josm, which will enable communication between the maproulette server and josm.
  2. Create a point approximately where it is located on maproulette in the selected editor
  3. Copy the object's properties from maproulette and paste them into the editor . These properties will be indicators, but you'll need to adapt them to a language that osm can understand. For this reason, please refer to the tagging plan for this campaign, to see what each property corresponds to and how it fits in OSM.
  4. If a health structure already exists, make a property comparison between the health structure on OSM with the properties that you have with maproulette. If there is a property in the MSF data that the OSM data does not contain, add it to the properties of the existing data on OSM.
  5. For health structures that don't come across buildings directly, identify the nearest building and, if no building exists nearby, move on to a challenge.
  6. If you're faced with challenges whose object properties are unknown, don't add them to osm, skip the challenge.
  7. When the task is complete, the modifications can be sent, remembering to describe the operation performed and the campaign hashtag.

Conflation

To compare data from the MSF database with that already present on OSM, we're going to do this manually. We're going to look at the attribute names of the data from the different sources. If we have similar names even though the positions of the objects are different, we consider that the data already exists on OSM.  If the msf data has more complete attributes than the data in OSM, we will integrate them into the OSM data.

Mapathon and Results

Flyer Mapathon

After consultation with members of the OpenStreetMap community in Niger, a mapathon was organized on April 19 to map data relating to the village and health facilities. In collaboration with the MSF teams in Niger, who provided us with the premises, we organized the event as a hybrid. In addition to members of the OSM Niger community, the GIS Specialist from MSF in Niger was also present.The alternative found today was to give a brief introduction to tasking manager, another organized editing tool, and to map the Niger projects that are present in this tool. With regard to the MSF data present on Maproulette and to be imported into OSM, the individual mapping approach was prioritized, enabling contributors to map where they wished, when they wished, while avoiding any server overload.

Out of 289 data entries in Maproulette relating to health structures and villages, 228 new data entries were integrated into OSM during the mapathon period. The 61 data entries that were not added were data that already existed in OSM and integration was not necessary.

The results of the data added to OpenStreetMap can be seen here

Mapathon with OSM Niger in MSF Niamey Office
Mapathon with OSM NIGER online

Quality assessment

Maproulette evolves as HOT's Tasking Manager. As a result, when a task was mapped by a contributor, another contributor took charge of validation, using the editor that suited them best.

Project update

Chad

You can consult the OSM Chad Wiki Page here

Schedule

The planning of the import started in mid January 2024, we would like to have the import completed in February 2024

Import account

Data to import

Data background

The data to be imported here are historical data collected by MSF concerning health structures in Chad . It is difficult to give the context and date of data collection for these health structures. Nevertheless, these data have been stored in the MSF Master database and are being used by the MSF operations.

Osm data files

Import type

Data preparation

Tagging plan

The MSF database has its own nomenclature for tagging healthcare facilities. for the import campaign in Chad, we have five categories of health facility, namely: health_center (hc/hc_reference), hospital, clinic dispensary, pharmacy . The data attribute fields selected in the MDB are: iso3; name_fr; operated_b; hlfac_typ and source. These fields were selected because their equivalents exist on osm and the other fields had empty contents.

Find here a list with all original attributes and their corresponding translation into the OSM tagging schema:

MDB Attributes MDB Attributes meaning OSM Tag
ISO 3 Country code of Chad where the health facilities have been collected /
name_fr Name of the health facilities in French that have been collected name=*
operated_b Name of the institution responsible of the health facility operator=*
hlfac_typ=

clinic

hospital

dispensary

health-centre (hc/hc_reference)

Pharmacy

Type of the health facilities amenity=clinic

amenity=hospital

health_facility:type=dispensary

health_facility:type=health_centre

amenity=pharmacy

source Source of the health facility data collected source=*

Changeset tag

Data transformation

Data merge workflow

Team Approach

Reference

Workflow

Conflation

Quality assessment

Validation of the import will be done by a second user in the Tasking Manager.

Project update