Planet.osm

From OpenStreetMap Wiki
(Redirected from Planet)
Jump to: navigation, search
Help
Available languages
Deutsch English Français 日本語 Русский

Planet.osm is the OpenStreetMap data in one file: all the nodes, ways and relations that make up our map. A new version is released every week. It's a big file (XML variant over 250GB uncompressed, 16GB compressed).

There are also files called Extracts which contain OpenstreetMap Data for individual continents, countries, and metropolitan areas.

Contents

Format

The two main formats used are PBF (efficient binary) or compressed OSM XML. PBF may help to reduce processing time.

For an overview over all osm file formats have a look at OSM file formats.

Downloading

See below for usage instructions.

Worldwide data

Mirror Updated Diffs?
ftp://ftp.spline.de/pub/openstreetmap/ Weekly Yes
http://ftp.ecki-netz.de/osm/ Weekly No
http://ftp.snt.utwente.nl/pub/misc/openstreetmap/ Daily No
http://ftp.heanet.ie/mirrors/openstreetmap.org/ and ftp and rsync Weekly with 10h delay Yes
http://ftp5.gwdg.de/pub/misc/openstreetmap/ Daily Yes
http://download.bbbike.org/osm/ Weekly No
ftp://ftp.up.ac.za/mirrors/openstreetmap/ Weekly Yes
ftp://ftp.pucpr.br/osm/mirror/ Daily No

Country and area extracts

Mirror Area Updated Diffs?
http://ftp5.gwdg.de/pub/misc/openstreetmap/ Germany and EU Daily Yes
http://download.geofabrik.de/osm/ daily extracts in PBF:
  • entire continents (except North America)
  • all European countries plus some regions
  • some countries outside Europe
Daily No
http://downloads.cloudmade.com/ Most countries Weekly or Monthly No
http://www.osmaustralia.org/downloads.php Australia and New Zealand Daily No
http://hypercube.telascience.org/planet/ Netherlands, Scandinavia and Taiwan Daily Yes
http://download.freemap.sk/slovakia.osm/ Slovakia Daily No
http://osm.kyblsoft.cz/archiv/ Czech Republic Daily No
http://osm.stilpu.org Romania Daily Yes
http://planet.openstreetmap.nl Benelux (Netherlands, Belguim and Luxemburg), Aruba, Bonaire, Curaçao, Saba, Sint Eustatius and Sint Maarten Daily Yes
http://www.overpass-api.de Overpass API excerpts up to ~300MB uncompressed Hourly No
http://gis-lab.info/projects/osm_dump/index.html Russia regions, Belarus, Lithuania, Latvia, Ukraine and other xUSSR coutries Daily Yes
http://archive.mmu.edu.my/openstreetmap/ Malaysia Daily Yes
http://data.osm-hr.org/ Croatia and Croatia, Slovenia, Bosnia, Monte Negro (hrsibame) Daily No
http://download.gfoss.it/osm/ Italy and regions Weekly No
http://download.bbbike.org/osm/ More than 200 cities and regions worldwide Weekly No
http://metro.teczno.com/ Individual metropolitan areas:
  • OSM and PBF
  • Up-to-date coastline extracts
Weekly or Monthly No
http://osm.kewl.lu/luxembourg.osm/ Luxembourg (beta) Hourly No

Global thematic extracts

BitTorrent

Original source

The originating URL is http://planet.openstreetmap.org/ for bz2 compressed xml and http://planet.openstreetmap.org/pbf/ for the pbf-version. Please use a mirror if you can.

Update frequency

A new version of planet.osm is released weekly (currently every Thursday morning). We have these, going back to the start of April 2006. The current size of a planet.osm file is about 250 GB (reduced to 14GB with PBF compression) as of July 2011.

The weekly dump normally starts at around 01:10am UK time on Wednesday morning and is guaranteed to contain all updates prior to that time. The dump is run within database transactions, but don't expect referential integrity. See Planet.osm/FAQ. The dump normally takes around 12 hours to complete.

Additionally we offer regular diffs. These are produced daily (under the 'daily' subdirectory) and more recently we also offer hourly diffs and minutely diffs. These have been produced with Osmosis and can be used to reconstruct the full dataset (see examples under the osmosis page for usage in various scenarios). Since these only contain the differences, they are much smaller files; A daily diff is generally about 40 MB compressed. For more information please see Planet.osm/diffs

Technical notes

Processing the file

See Databases#Database_Schemas and Databases#Tools_to_Populate_Databases on how to load an planet file into a database

See OSM_file_formats#Map-data on a list of tools which are able to manipulate osm files

See Frameworks for accessing osm files from your software.

Unpacking .bz2 files

Osmosis and osm2pgsql allow you to use the files in compressed form. If you need to unpack it from bz2 format, use 7-zip on Windows; on Linux just type bzip2 -d planet.osm.bz2; or your OS may support double-click unpacking. See Wikipedia's list of compression programs.

If you are handling the compression yourself with libbzip2, then note that the files are compressed with pbzip2 and contain multiple streams that need to be handled as described in section 3.4.8 of the bzip2 documentation.

During download, the network will be your bottleneck. Once you have the file you will need to unpack it, and then disk I/O will be your bottleneck. Or you can work with the bzip'ed file, but then the CPU will be your bottleneck. If you have sufficient space to unpack the full planet file, you can save a lot of time and disk thrashing by unpacking it on the fly while downloading it: try wget -O - http://planet.openstreetmap.org/planet_latest.osm.bz2 |bzcat >planet_latest.osm

Additional technical notes

wget: Due to the size of the planet files, some older distributions of wget do not work any more. They are restricted to files of < 2GB, and attempting to download files larger than that will report a negative file size and fail -- obtain a newer version of wget if that happens to you.

Other planet files

Personal tools
Namespaces
Variants
Actions
site
Toolbox