Database

From OpenStreetMap Wiki
Jump to navigation Jump to search

The main database is a key component of OpenStreetMap, because obviously it's where we keep all our data.

Please note that this is not the only database used to generate maps. Have a look at Component overview to see what other databases exist.

The main database is accessed for editing via the API. If you want to get data see APIs for multiple available options.

Data model

Main OSM database schema, presented by Navicat software

The database contains tables for each Element type (nodes, ways, and relations). In fact, for each of these there are several database tables: current, history, current_tags, and history_tags. In addition, there are database tables for storing changeset, gpx_files, users, diary entries, sessions, OAuth, etc.

Database schema: https://github.com/openstreetmap/openstreetmap-website/blob/master/db/structure.sql, Rails port/Database schema.

Table sizes on the main database cluster: Database/TableInfoDump

QuadTiles indexes for all nodes are used for faster querying (using a B-tree index in PostgreSQL).

Databases elsewhere will be structured differently. For example, most applications only need the current map data. Different OSM tools use different database setups (see Databases#Database_Schemas).

Postgres server instance

For problems see Platform Status.

The cluster configuration is managed via the Chef configuration, found at https://github.com/openstreetmap/chef

What happens on each machine is defined in the roles, and the set-up of database-related machines is controlled by the "db" cookbook. https://github.com/openstreetmap/chef/tree/master/roles https://github.com/openstreetmap/chef/tree/master/cookbooks/db

Database statistics

For all servers we have Munin monitoring (realtime graphs showing server resource usage).

https://hardware.openstreetmap.org/, which is generated from the Chef configuration automatically.

See also Statistics.

History

19 April 2009 - OpenStreetMap switched from MySQL to a PostgreSQL server for its main site [1] that is part of the rails port.

1 April 2012 - a process of moving to a new server commenced.