Planet.osm

From OpenStreetMap Wiki
Jump to: navigation, search
Available languages — Planet.osm
Deutsch English español français Nederlands русский 日本語

Planet.osm is the OpenStreetMap data in one file: all the nodes, ways and relations that make up our map. A new version is released every week. It's a big file (XML variant over 576.6GB uncompressed, 42GB bz2 compressed and 28.8GB PBF at 2015/05/19).

There are also files called Extracts which contain OpenstreetMap Data for individual continents, countries, and metropolitan areas.

Format

The two main formats used are PBF or compressed OSM XML. PBF is a binary format that is smaller to download and much faster to process and should be used when possible. Most common tools using OSM data support PBF.

For an overview over all osm file formats have a look at OSM file formats.

If you are using traditional GIS tools you may want to look at Processed data providers.

Downloading

See below for usage instructions.

Planet.osm mirrors

Mirror Updated Diffs? PBF?
ftp://ftp.spline.de/pub/openstreetmap/ Weekly No Yes
http://ftp.osuosl.org/pub/openstreetmap/ Weekly No Yes
http://ftp.snt.utwente.nl/pub/misc/openstreetmap/ Weekly No Yes
http://ftp.heanet.ie/mirrors/openstreetmap.org/ and ftp and rsync Weekly with 10h delay Yes Yes
http://ftp5.gwdg.de/pub/misc/openstreetmap/planet.openstreetmap.org/ Daily Yes Yes
ftp://ftp.pucpr.br/osm/mirror/ Daily No No
http://download.bbbike.org/osm/planet/ Weekly No Yes
Internet Archive (available under various items) Daily No Yes

Country and area extracts

Worldwide extract sources

Mirror Area Updated Diffs?
http://download.gisgraphy.com/ weekly extracts in PBF: Weekly No
http://download.geofabrik.de/ daily extracts in PBF:
  • entire continents
  • all European countries
  • sub-country admin regions for France, Germany, UK
  • many countries outside Europe
  • States in the USA and Provinces in Canada
Daily Yes
http://osmdata.thinkgeo.com/ Most countries in the world (shp file) Not for free! Weekly No
http://www.overpass-api.de Overpass API excerpts up to ~300MB uncompressed
Permanent updates
Yes, since v0.7.50
http://download.bbbike.org/osm/ More than 200 cities and regions worldwide or extract your own individual area (OSM, PBF, Garmin cycle map, Osmand, mapsforge, Navit and ESRI shapefile format) Weekly No
http://mapzen.com/metro-extracts/ Individual cities: Weekly No
Trimble Data Marketplace Worldwide coverage:
  • Clip to any area you want - draw a polygon by hand or use a KML (1,000 vertice limit) to define your clip area
  • Choose any and all Map Features tags
  • Reproject
  • Supported formats: SHP, Esri FGDB, Safe FFS, GML, CSV, KML and DWG

view quick walkthrough

Monthly No

Regional extract sources

Mirror Area Updated Diffs?
http://ftp5.gwdg.de/pub/misc/openstreetmap/ Germany and EU Daily Yes
http://gis-lab.info/projects/osm_dump/index.html Russia regions, Belarus, Lithuania, Latvia, Ukraine and other xUSSR coutries Daily Yes
http://planet.openstreetmap.nl Benelux (The Netherlands, Belgium and Luxemburg), Aruba, Bonaire, Curaçao, Saba, Sint Eustatius and Sint Maarten Unknown
(last updated 2014-11-22)
Yes
http://download.freemap.sk/slovakia.osm/ Slovakia Daily No
http://osm.kyblsoft.cz/archiv/ Czech Republic Daily No
http://osm.stilpu.org Romania - Dead link Daily Yes
http://data.osm-hr.org/ Croatia, Slovenia, Bosnia-Herzegovina, Montenegro, Albania, Bulgaria, Hungary, Kosovo, Latvia(Geofabrik copy), Macedonia, Romania, Serbia
  • daily extracts in PBF
  • daily garmin maps
  • daily osmand maps
  • croatia archive
  • croatia diff's
  • planet thematic extracts
Daily No
http://download.gfoss.it/osm/ Italy and regions Weekly No
http://osm.kewl.lu/luxembourg.osm/ Luxembourg (beta) Hourly No
planet.osm.ch Swiss extract from the Swiss OpenStreetMap association. Including all lakes crossing the Swiss boundary and a few km of the surrounding countries. Hourly Yes
http://planet.openstreetmap.ie Island of Ireland extract Hourly Yes
http://osm.ramuno.lt/downloads/ Lithuania
  • daily extracts in PBF and O5m
  • daily garmin maps
  • daily osmand maps
  • daily extracts of transport layer
Daily No

Global thematic extracts

BitTorrent

Original source

The originating URL is http://planet.openstreetmap.org/. Please use a mirror if you can.

Update frequency

A new version of planet.osm is released weekly (currently every Wednesday morning). We have these, going back to the start of April 2006.

The size of a planet.osm file is about can be seen in the header information on the planet download page. Planet files are very large (tens of GBs) so please check the size before starting to download.

The weekly dump normally starts at around 01:10am UK time on Monday morning and is guaranteed to contain all updates prior to that time. The dump is constructed from a database dump using conversion software, and the result should ensure referential integrity. Please note that this doesn't always apply to extracts - see Planet.osm/FAQ. The dump and conversion normally takes around 48 hours to complete, in total, and the result is usually ready on Wednesday morning.

Note : The timestamp of the file is recorded in it like this : <osm version="0.6" generator="OpenStreetMap planet.c" (...) timestamp="2013-01-02T01:10:14Z"> it will be usefull to decide what "diffs" to use if you want them :

Additionally we offer regular diffs. These are produced daily (under the 'daily' subdirectory) and more recently we also offer hourly diffs and minutely diffs. These have been produced with Osmosis and can be used to reconstruct the full dataset (see examples at OSM Wiki pages Osmosis and osmupdate). Since these only contain the differences, they are much smaller files; A daily diff is generally about 40 MB compressed. For more information please see Planet.osm/diffs

Technical notes

Processing the file

See Databases and data access APIs#Database Schemas for loading a planet file into a database.

See OSM file formats#Map-data for a list of tools which are able to manipulate osm files.

See Frameworks for accessing osm files from your software.

Unpacking .bz2 files

Osmosis and osm2pgsql allow you to use the files in bz2-compressed form. If you need to unpack it from bz2 format, use 7-zip on Windows; on Linux just type bzip2 -d planet.osm.bz2; or your OS may support double-click unpacking. See Wikipedia's list of compression programs.

If you are handling the compression yourself with libbzip2, then note that the files are compressed with pbzip2 and contain multiple streams that need to be handled as described in section 3.4.8 of the bzip2 documentation.

During download, the network will be your bottleneck. Once you have the file you will need to unpack it, and then disk I/O will be your bottleneck. Or you can work with the bzip'ed file, but then the CPU will be your bottleneck. If you have sufficient space to unpack the full planet file, you can save a lot of time and disk thrashing by unpacking it on the fly while downloading it: try curl http://planet.openstreetmap.org/planet_latest.osm.bz2 | pbzip2 -cd >planet_latest.osm

Additional technical notes

wget: Alternatively to curl, wget -O - may be used. Due to the size of the planet files, older distributions of wget may fail to work since they may not support file sizes larger than 2 GiB, and attempting to download files larger than that will report a negative file size and fail.

pbzip2: may be replaced by the single-threaded bzip2 -cd / bzcat as well.

Other planet files

License

Planet files remain licensed under the same license as the master OpenStreetMap geo-database from which they are extracted - currently this is the Open Database License. Planet files from before September 12, 2012 have a Creative Commons Attribution-ShareAlike 2.0 license.