Planet.osm

From OpenStreetMap Wiki

Planet.osm is a snapshot of the OpenStreetMap database.

What's included?

Planet.osm is the latest revision of the nodes, ways, relations and changesets in the database. This of course includes all the tags. It does not include the editing history. It does not include GPS traces behind the data.

The file is an XML formatted .osm file.

Update frequency

A new version of planet.osm is released weekly (currently every Thursday morning). We have these, going back to the start of April 2006. The current size of a planet.osm file is over 160 gigabytes (reduced to 7.3GB with bzip2 compression) as of November 2009.

The weekly dump normally starts at around 01:10am UK time on Wednesday morning and is guaranteed to contain all updates prior to that time. The dump is run within database transactions, but don't expect referential integrity. See Planet.osm/FAQ. The dump normally takes around 12 hours to complete.

Additionally we offer regular diffs. These are produced daily (under the 'daily' subdirectory) and more recently we also offer hourly diffs and minutely diffs. These have been produced with Osmosis and can be used to reconstruct the full dataset (see examples under the osmosis page for usage in various scenarios). Since these only contain the differences, they are much smaller files; A daily diff is generally under 10 MB compressed. For more information please see Planet.osm/diffs

Downloading

Due to the size of the planet files, some older distributions of wget do not work anymore. They are restricted to files of < 2GB, and attempting to download files larger than that will report a negative file size and fail -- obtain a newer version if that happens to you.

Originating URL:

• http://planet.openstreetmap.org/

Please check a mirror first!

Mirrors

Full Mirrors - FASTER and doesn't disturb the OSM server

• http://ftp.heanet.ie/mirrors/openstreetmap.org/ (updated 4 times/day, also available via ftp and rsync)(update frequency seems wrong. Daily diffs are visible 10 hours after OSM).
• http://planet.king-nerd.com (updated every 4 hours) (Back online w/ new 100mbit NY,US host)
• http://ftp5.gwdg.de/pub/misc/openstreetmap/ (full planet.openstreetmap.org mirror, plus Geofabrik extracts of Europe and Germany, daily updates) (2gbit, Göttingen, DE )

planet.osm-only Mirrors

• http://ftp.snt.utwente.nl/pub/misc/openstreetmap/planet-latest.osm.bz2 (Updates daily as of 16 September 2008)
• http://ftp.ecki-netz.de/osm/planet-latest.osm.bz2 (updated weekly) (One week old as of 20th June 2008)
• http://mirror.openstreet.nl/ - last updated in April
• http://www.openstreetmap.ca/planet/ (updated weekly plus periodic extracts of regions in North America) (seems to offline now)

Extracts

Bittorrent

Currently an experiment, I might automate this, maybe talking to the other mirror people aswell. --Skinkie 20:31, 4 April 2009 (UTC) The origin is powered by Oxilion.

• http://thepiratebay.org/torrent/4824136/ (2009-04-01)
• http://thepiratebay.org/torrent/4838395/ (2009-04-08)
• http://thepiratebay.org/torrent/4853782/ (2009-04-15)
• http://thepiratebay.org/torrent/4858504/ (2009-04-18) LAST API0.5!
• http://mirror.openstreet.nl/planet/planet-090421.torrent (2009-04-21) API 0.6

Unpacking the File

Many tools allow you to use the files in compressed form but if need to unpack it for some reason, on Windows download the 7-zip uncompression tool. On Linux just write bzip2 -d planet.osm.bz2. If you want to do it differently, then check out this list of compression programs.

If you are handling the compression yourself with libbzip2, then note that the files are compressed with pbzip2 and contain multiple streams that need to be handled as described in section 3.4.8 of the bzip2 documentation.

Processing the File

The file is in the OSM XML format. There are a number of scripts to process the file available in SVN, including ones to put it back into a database.

• Osmosis is a Java tool that can import a planet file into your db.
• planetosm-to-db.pl creates a current-ruby-server-database too (or a slightly different one for PostgreSQL, as used by Where Are They, including the db schema). It stores the node and segment ids in memory, so it can import only some of the data (exclude or include), and normally only uses about 100MB. It is not fast, taking several hours to load a UK-only planet excerpt.
• If you need a db for testing purposes only, http://richard.dev.openstreetmap.org/osm05.sql.gz is a 75Mb SQL dump of the UK from January 2008. (current_ tables only - but you can populate the other tables from there - and no relations tables.)
• (Other tools in svn have not been updated for the 0.5 database structure and are consequently not usable.)
• Tagwatch contains code that processes OSM files
• There is a PERL module which can work on normal and compressed osm files here: osm.pm. Examples can be found here User:Gary68

Stuff done with planet.osm

• "OSM Aware" is an awareness tool and repository transforming OSM diff. files in different KML versions which are updated each day, hour and minute. Activity can be viewed in Google Earth, Google Maps, Open Layers and World Wind (see website for links and informations).
• OSM Data converted with mapnik in the GpsDrive routing application.
• Map of OSM coverage in Europe is just a picture of the coverage of OSM of Europe as of April 2006
• Importing Planet.osm into QGIS
• Print OpenStreetMap with Gnuplot print the world into PDF files.
• Little-osm is a stand-alone webserver capable of importing planet.osm and deliver /map requests. It works with JOSM as an off line, read-only installation.
• Where Am I? and Where Is It? - Python script to find places, nodes, roads etc. near to your given location - see Where Are They
• Osmarender, Mapnik, Kosmos and Tiles@home used to draw maps - now mostly use the protocol interface
• Gosmore viewer with incremental search
• Importing Planet.osm into ArcGIS
• Instructions for building a slippy map using planet.osm on the Fedora Linux distribution
• create custom map for GpsMid java device
• Script to clip Planet.osm into smaller data file but still keep osm data format (goto www.digitalmobilemap.com and click on FAQ to download the script) using java to clip Planet.osm into a smaller data file that contains only osm map data (nodes/segments/ways) within bounds. The clipped data file not only keeps osm data format but also keeps node's labels and way's labels in Unicode UTF-8 format. The java script does not require much memory and can process large planet.osm file very fast (< 8 minutes). You can use this script to create a smaller planet.osm file. A smaller planet.osm file may be useful for you if you want to import it to your local database server for local development as it will take less time to import and debug.
• Downloading, updating, & extracting regions yourself

Past versions of the planet file

Old versions of the planet file are available at http://planet.openstreetmap.org/ as well. The Historical Coverage page describes a service that allows you to view data from the past and how it developed.

Statistics

• tagstathas statistics on the tag for nodes, ways and relations.
• Stats page on the wiki