Osm2pgsql/benchmarks/Dell R610 import 1

From OpenStreetMap Wiki
Jump to: navigation, search
$ ../osm2pgsql/osm2pgsql --number-processes=24 -C 16000 -s -S ./default.style -G -m -d osm /data/work/osm2pgsql/planet-latest.osm.bz2
osm2pgsql SVN version 0.80.0-sly-s hack (32bit id space)

Using projection SRS 900913 (Spherical Mercator)
Setting up table: planet_osm_point
NOTICE:  la table « planet_osm_point » n'existe pas, poursuite du traitement
NOTICE:  la table « planet_osm_point_tmp » n'existe pas, poursuite du 
traitement
Setting up table: planet_osm_line
NOTICE:  la table « planet_osm_line » n'existe pas, poursuite du traitement
NOTICE:  la table « planet_osm_line_tmp » n'existe pas, poursuite du 
traitement
Setting up table: planet_osm_polygon
NOTICE:  la table « planet_osm_polygon » n'existe pas, poursuite du traitement
NOTICE:  la table « planet_osm_polygon_tmp » n'existe pas, poursuite du 
traitement
Setting up table: planet_osm_roads
NOTICE:  la table « planet_osm_roads » n'existe pas, poursuite du traitement
NOTICE:  la table « planet_osm_roads_tmp » n'existe pas, poursuite du 
traitement
Allocating memory for dense node cache
Allocating dense node cache in one big chunk
Allocating memory for sparse node cache
Sharing dense sparse
Node-cache: cache=16000MB, maxblocks=2048001*8192, allocation method=11
Mid: pgsql, scale=100
Setting up table: planet_osm_nodes
NOTICE:  la table « planet_osm_nodes » n'existe pas, poursuite du traitement
NOTICE:  CREATE TABLE / PRIMARY KEY créera un index implicite « 
planet_osm_nodes_pkey » pour la table « planet_osm_nodes »
Setting up table: planet_osm_ways
NOTICE:  la table « planet_osm_ways » n'existe pas, poursuite du traitement
NOTICE:  CREATE TABLE / PRIMARY KEY créera un index implicite « 
planet_osm_ways_pkey » pour la table « planet_osm_ways »
Setting up table: planet_osm_rels
NOTICE:  la table « planet_osm_rels » n'existe pas, poursuite du traitement
NOTICE:  CREATE TABLE / PRIMARY KEY créera un index implicite « 
planet_osm_rels_pkey » pour la table « planet_osm_rels »

Reading in file: /data/work/osm2pgsql/planet-latest.osm.bz2
Unknown node type 8
Processing: Node(1387718k 128.5k/s) Way(128021k 16.62k/s) Relation(567200 
210.00/s)
Standard exception processing way_id 1082366: TopologyException: side location 
conflict at 822832 8.30585e+06
Processing: Node(1387718k 128.5k/s) Way(128021k 16.62k/s) Relation(1110800 
227.53/s)
Standard exception processing way_id 1792031: TopologyException: side location 
conflict at -734926 5.24355e+06
Processing: Node(1387718k 128.5k/s) Way(128021k 16.62k/s) Relation(1172990 
229.55/s)
Standard exception processing way_id 1868906: TopologyException: side location 
conflict at 1.22428e+06 5.69149e+06
Processing: Node(1387718k 128.5k/s) Way(128021k 16.62k/s) Relation(1328665 
236.29/s)  parse time: 24300s

Node stats: total(1387718716), max(1663547740) in 10800s
Way stats: total(128021735), max(153729100) in 7705s
Relation stats: total(1328665), max(2071746) in 5623s
Committing transaction for planet_osm_point
Committing transaction for planet_osm_line
Committing transaction for planet_osm_polygon
Committing transaction for planet_osm_roads

Going over pending ways

Using 24 helper-processes
WARNING: Failed to fork helper processes. Falling back to only using 1
processing way (72288k) at 5.14k/s
Process 0 finished processing 72288752 ways in 14076 sec

All child processes exited

72288752 Pending ways took 14076s at a rate of 5135.60/s
Committing transaction for planet_osm_point
Committing transaction for planet_osm_line
Committing transaction for planet_osm_polygon
Committing transaction for planet_osm_roads

Going over pending relations

Using 24 helper-processes
WARNING: Failed to fork helper processes. Falling back to only using 1

Process 0 finished processing 0 relations in 0 sec

All child processes exited

node cache: stored: 1387718716(100.00%), storage efficiency: 89.47% (dense 
blocks: 1344149, sparse nodes: 116404781), hit rate: 100.00%
Sorting data and creating indexes for planet_osm_point
Sorting data and creating indexes for planet_osm_polygon
Sorting data and creating indexes for planet_osm_line
Sorting data and creating indexes for planet_osm_roads
Stopping table: planet_osm_nodes
Stopping table: planet_osm_ways
Stopping table: planet_osm_rels
Building index on table: planet_osm_rels (fastupdate=off)
Building index on table: planet_osm_ways (fastupdate=off)
Stopped table: planet_osm_nodes in 0s
Analyzing planet_osm_polygon finished
Stopped table: planet_osm_rels in 207s
Analyzing planet_osm_roads finished
Analyzing planet_osm_point finished
Analyzing planet_osm_line finished
Copying planet_osm_point to cluster by geometry finished
Copying planet_osm_roads to cluster by geometry finished
Creating indexes on  planet_osm_roads finished
All indexes on  planet_osm_roads created  in 1965s
Completed planet_osm_roads
Creating indexes on  planet_osm_point finished
All indexes on  planet_osm_point created  in 3848s
Completed planet_osm_point
Copying planet_osm_line to cluster by geometry finished
Copying planet_osm_polygon to cluster by geometry finished
Creating indexes on  planet_osm_line finished
All indexes on  planet_osm_line created  in 16800s
Completed planet_osm_line
Creating indexes on  planet_osm_polygon finished
All indexes on  planet_osm_polygon created  in 17647s
Completed planet_osm_polygon
Stopped table: planet_osm_ways in 30778s

Osm2pgsql took 69156s overall