Planet.osm/full
There is a full history dump at http://planet.openstreetmap.org/full-experimental/ that includes almost all OSM data:
- For nodes, ways, and relations created after the introduction of API 0.5 (in October 2007), the file includes all versions that ever existed, even if the objects have been deleted since.
- For nodes and ways created before the introduction of API 0.5, the file includes only the version that was visible when the changeover occurred, plus all later versions. If the object had already been deleted when API 0.5 was introduced, then it is not included.
- Since segments were dropped with the introduction of API 0.5, they are not included.
This full history dump is only useful if you want to develop something like Historical Coverage and to do more statistical analyses. If you are just interested in the current data, use Planet.osm instead.
Contents |
Data Format
The full history dump uses the same XML scheme as a normal planet file, with the exception that there will usually be several change versions of the same object.
The file is ordered by object type (node-way-relation), then id, then version.
The file does not have any newline characters. Code that tries to read this file line-by-line will fail.
The uncompressed size of this file is about 500 GB. Code that tries to parse this file into a DOM tree will fail.
The compressed file is created with a parallel bzip2, resulting in a multi-stream file. This file cannot be read by the BZ2file module in Python. You have to convert it to a single stream first
You can convert the file to a single stream like this:
bzip2 -cd full-planet-110115-1800.osm.bz2 | bzip2 -c > full-planet.new.osm.bz2
This may take a long time (about 36 hours on an 2.66Ghz Intel Core i7 with 8GB of RAM). The resulting file will be slightly smaller than the original.
Processing
Osmosis does not have explicit support for this type of file but some Osmosis operations seem to work with it.
There is a simple, dedicated history excerpt script that allows you to pick an area of interest from the file http://trac.openstreetmap.org/browser/applications/utils/osm-extract/history-excerpt.pl
There is further information on User:MaZderMind/Reading_OSM_History_dumps
Generating
Full history dumps are generated with Lars Francke's historydump tool.
Extracts
- MaZderMind is generating extracts of the Full-History-Dump which can be downloaded from his server. If you can't find your own region, read this Mailing-List Post on how to generate or request it.
- Extracts by Simon Poole: http://odbl.poole.ch/extracts/
