- 1 Import for Taiwan Shelters
- 1.1 Goals
- 1.2 Schedule
- 1.3 Import Data
- 1.4 Data Preparation
- 1.5 Data Merge Workflow
- 1.6 QA
Import for Taiwan Shelters
"Import for Taiwan Shelters" is an import of "避難收容處所開設情形" (http://portal.emic.gov.tw/pub/DSP/OpenData/EEA/Shelter.xml) dataset on Open Data Platform (http://data.gov.tw/node/12849) from National Fire Agency. This dataset has all the shelters location and information in Taiwan. The importation has done and cleaned up on 9th June, 2017.
To tag more than 6800 shelters in Taiwan is a huge effort. The shelter information includes the name of shelter, address, the number of people of the shelter can accommodate, and so on. It allows either the citizens or the visitors in Taiwan know better about the shelter, in case of the disaster strikes.
Start Importation: 2nd June, 2017 Cleaned up: 9th June, 2017
The raw data is from National Fire Agency, Ministry of Interior of Taiwan government. ‘’’Data source site:’’’ DATA.GOV.TW ‘’’Data license:’’’ Open Government Data License, version 1.0 ODbL Compliance verified: yes/no
OSM Data Files
This is a one-time import and it is doing with automated scripts.
Data Reduction & Simplification
The following is one of the shelter information in raw data.
The field is described as below.
- Is the shelter is suitable for the weak
- contain: 是/否 (yes/no)
- The shelter address
- The county where the shelter is located
- Estimated village of the shelter to accommodate
- The type of disaster that the shelter can
- contain: 水災/震災/土石流/海嘯 (floods/earthquake/mudslide/tsunami)
- Is the shelter indoor
- contain: 是/否 (means yes/no)
- Is shelter outdoor
- contain: 是/否 (means yes/no)
- The shelter latitude
- The shelter longitude
- The shelter name
- The status of the shelter
- contain: 開設/已滿/撤除 (means open/full/closed)
- Estimated number of people of the shelter can accommodate
- The numbering of the shelter
- It is a temporary shelter if the first 2 letters is TW
- The shelter id
- The town where the shelter is located
- The coordinate of TWD97 x-axis
- The coordinate of TWD97 y-axis
- The village where the shelter is located
- Case 1：Usually, school or public building will be leveraged as shelter during a disaster. If OSM building exists for the given coordinates of shelter location from dataset, update the tags of that building with an emergency prefix.
- Case 2
- If there is no OSM building, add POI with the following tags.
The changeset tags are proposed according to the discussion in mapping events and the Facebook interactions of OpenStreetMap Taiwan.
addr:full county, town, village, address
We developed the Python code as a script and run that from the Virtual Machine hosted on Microsoft Azure.
Data Transformation Results
As a result, we transformed 6359 shelter objects into OSM.
Data Merge Workflow
- Download the XML data with shelter information from National Fire Agency in Taiwan.
- Parse the XML data to shelter objects in Python.
- For each shelter object, get the bounding box of this shelter with 3 km distance.
- Use Overpass Query API to get all polygon objects with building tag inside the bounding box.
- For each polygon object, check if the shelter is inside this polygon, if yes, update the tags of the polygon object, else, create a POI object with tags.
If there is an existing object on shelter coordinate, we keep the existing data(including nodes, tags, and relations) and just add additional tags to it.
There are some incorrect data in the raw data. We will clean them up by the following steps.
- Remove the shelter which location is out of Taiwan boundary.
- Use GeoCoding API of Google Maps to converting addresses into geographic coordinates. Compare the longitude and latitude of results with the raw data, and remove the shelters which the gap is more than 3 km.
- Manually double check every shelter which the gap is more than 3 km to verify if it is incorrect.
- Request assistance of the local community to assist correcting the shelter information.
This changeset was created by GeoThings Inc.