Import/Catalogue/NYC Buildings Addresses
NYC building and address import
Proposal to import building perimeter outline and address point data by NYC DoITT City Wide GIS Services to OpenStreetMap
In March 2012, New York City released all government data to the public. Of particular interest to OpenStreetMap are building perimeter outlines and address point data, both datasets are of high quality and labor intensive to collect manually. This proposal suggests a full community supported import of all NYC building and address data, reconciling overlaps with OSM data. This proposal is complementary to changewithin a tool used by the NYC government to detect building and address changes in OSM to drive updates to their public datasets.
The idea of this proposal is not only to improve OpenStreetMap in New York City with vital building and address data, but set a strong example of how governments can engage with OpenStreetMap by opening geo data and thus benefiting by gaining an additional vector for detecting changes in the real world. Further we would like to take this effort as an opportunity to further strengthen the New York City OpenStreetMap community.
- Liz Barry - OSM NYC / Public Laboratory (TBC)
- Alex Barth - MapBox / OSM US
- Eric Brelsford - OSM NYC
- Colin Reilly - NYC DoITT city wide GIS services
- Matt Greene - MapBox
- Serge Wroclawski - OSM NYC
NYC building data
Current status: test imports
We have started test imports with a small group of testers (Liz Barry, Eric Brelsford, Serge Wroclawski, Matt Greene, Alex Barth). Get in touch with lxbarth for details.
Join the effort by attending the first community import session on Saturday October 12
Please report any issues here https://github.com/osmlab/dcbuildings/issues
Per Local Law 11 of 2012, all NYC government data is to be provided "without any registration requirement, license requirement or restrictions on their use" (23-502 d), effectively putting it in the public domain.
Both, address point data and building data fall under this law, hence have the label "Public" under access on the web site:
- Local Law of 2012 establishing the public status of NYC data
- NYC Open Data Policy and Technical Standards Manual
- Process building+address shapefiles into election district size .osm files (done)
- Peer review by NYC community, imports-us and imports working group (current stage)
- Upload data by advance group of mappers (not started)
- Based on (3) involve a larger group of mappers (not started)
The import will be conducted in two phases. In a first phase, a handful of mappers will start the import and get a direct feel for the intricacies of the task. This group is currently made up of Liz Barry (TBC), Alex Barth, Eric Brelsford, Matt Greene and Serge Wroclawski. Individuals who’d like to join this advance group, please open a ticket on http://github.com/osmlab/nycbuildings.
Based on findings and progress in the first phase, tasks will be opened to broader group of people kicking off with a community session in New York City in mid October.
The .osm files generated by the conversion scripts are all to be reviewed manually and then uploaded with JOSM. We will use a tasking manager job to coordinate the effort. Most users won’t need to run the script, but just pick off a task from the tasking manager, which will open the right import file in JOSM.
- Reserve an election district size area on the NYC task on tasks.openstreetmap.us
- Open corresponding area in JOSM. This loads the relevant .osm file with buildings and addresses and downloads existing OSM data from OSM.org
- Manually conflate duplicate buildings, addresses and attributes.
- Run JOSM validation
- Address validation warnings and errors
- Upload under a dedicated upload account per user
Dedicated upload account
Uploads need to be done with dedicated upload accounts. Follow this pattern for creating a user account name just for this import:
So for user lxbarth, the name for the import account would be:
Conversion code and converted data
We have created scripts that process NYC building and address shapefiles into election district size .osm files. They relate addresses to buildings, concatenate and clean up addresses and export addresses separate from buildings where more than one address relates to a building. The script simplifies building polygons and handles multipolygons.
- See all details in the script’s README.
- Sample: Building and address OSM file ready for manual review and upload http://cl.ly/2f0E1d3e2k1z
Each building is a closed way tagged with:
building="yes" height="HEIGHT_ROO" # In meters, if available addr:housenumber="HOUSE_NUMB" # If available addr:streetname="STREET_NAM" # If available addr:postcode="ZIPCODE" # If available nycdoitt:bin="BIN" # NYC DoITT building identifier
(All "addr" entities in CAPS are from address file.)
Each address is a node tagged with:
addr:housenumber="HOUSE_NUMB" addr:streetname="STREET_NAM" addr:postcode="ZIPCODE"
(All entities in CAPS from address file.)
- Proposal review September 3rd - September 13th 2013.
- Full release of data on NYC Open Data - ~ September 15th 2013.
- Incorporate feedback and test imports by September 20th 2013
- First small group imports September 20th - October 12th
- Community import sessions October 12 and 13
- Finalize import throughout end of October and beginning of November