Planet.osm/full

From OpenStreetMap Wiki
Jump to: navigation, search
Available languages
English español

There is a full history dump at http://planet.openstreetmap.org/planet/full-history/ that includes almost all OSM data:

  • For nodes, ways, and relations created after the introduction of API 0.5 (in October 2007), the file includes all versions that ever existed, even if the objects have been deleted since.
  • For nodes and ways created before the introduction of API 0.5, the file includes only the version that was visible when the changeover occurred, plus all later versions. If the object had already been deleted when API 0.5 was introduced, then it is not included.
  • Since segments were dropped with the introduction of API 0.5, they are not included.
  • The file does not include redacted elements which cannot be published under ODbL.

This full history dump is only useful if you want to develop something like Historical Coverage and to do more statistical analyses. If you are just interested in the current data, use Planet.osm instead.

Contents

Data Format

The full history dump uses the same XML scheme as a normal planet file, with the exception that there will usually be several change versions of the same object.

The file is ordered by object type (node-way-relation), then id, then version.

The file does not have any newline characters. Code that tries to read this file line-by-line will fail.

The uncompressed size of this file is about 500 GB. Code that tries to parse this file into a DOM tree will fail.

The compressed file is created with a parallel bzip2, resulting in a multi-stream file. This file cannot be read by the BZ2file module in Python. You have to convert it to a single stream first

You can convert the file to a single stream like this:

bzip2 -cd full-planet-110115-1800.osm.bz2 | bzip2 -c > full-planet.new.osm.bz2

This may take a long time (about 36 hours on an 2.66Ghz Intel Core i7 with 8GB of RAM). The resulting file will be slightly smaller than the original.

Processing

Osmosis does not have explicit support for this type of file but some Osmosis operations seem to work with it.

There is a simple, dedicated history excerpt script that allows you to pick an area of interest from the file http://trac.openstreetmap.org/browser/applications/utils/osm-extract/history-excerpt.pl

There is further information on User:MaZderMind/Reading_OSM_History_dumps

Generating

Full history dumps are generated with Lars Francke's historydump tool.

Extracts

Personal tools
Namespaces

Variants
Actions
site
Toolbox