User:Ppawel/OWL Technical Notes

From OpenStreetMap Wiki
Jump to navigation Jump to search

About this page

This page is a collection of mad notes related to testing OWL (the "resurrection" branch) on errol dev server.

Data processing benchmarks

errol test import

  • Oracle JDK 7
  • Started populating changes/changesets from scratch, data tables (nodes/ways/relations etc.) left intact from the previous import.
  • Data at the start - October 2007.
Date Nodes Ways Way_nodes Changesets Changes
2012-10-29 1:00 61,049,444 / 13 GB 5,746,870 / 5.3 GB 68,973,576 / 3.5 GB 0 / 0.0 GB 0 / 0.0 GB
2012-10-29 9:00 68,565,220 / 15 GB 6,192,308 / 8.3 GB 77,294,522 / 4 GB 5,379 / 11 MB 10,375,943 / 3.5 GB
2012-10-29 16:00 74,165,632 / 16 GB 6,435,598 / 8.3 GB 83,212,884 / 4.2 GB 8,788 / 17 MB 16,930,240 / 5.6 GB
2012-10-30 0:00 82,005,944 / 18 GB 7,263,705 / 8.3 GB 92,082,286 / 4.8 GB 13,435 / 26 MB 26,560,965 / 9 GB
2012-10-30 13:00 ? / 23 GB ? / 8.3 GB ? / 6.0 GB 19,534 / 38 MB 46,382,654 / 15 GB
2012-10-31 9:00 ? / 29 GB ? / 8.3 GB ? / 7.6 GB 28,705 / 52 MB 74,121,560 / 25 GB
2012-11-02 0:00 ? / 40 GB ? / 10 GB ? / 9.7 GB 42,763 / 83 MB 121,319,848 / 41 GB
2012-11-02 10:00 ? / 43 GB ? / 11 GB ? / 10 GB 48,750 / 95 MB 135,811,952 / 46 GB

suncobalt test import

  • Data in the database - Europe.
  • Running current replication.
  • Not doing count queries because of slow I/O.
Date Nodes Ways Way_nodes Changesets Changes
2012-10-29 16:00 ? / 83 GB ? / 63 GB ? / 52 GB 19,342 / 49 MB 3,269,561 / 632 MB
2012-10-30 0:00 ? / 83 GB ? / 63 GB ? / 52 GB 29,672 / 75 MB 4,967,810 / 981 MB
2012-10-30 13:00 ? / 83 GB ? / 63 GB ? / 52 GB 29,672 / 100 MB 6,567,401 / 1.3 GB
2012-10-31 12:00 ? / 84 GB ? / 63 GB ? / 53 GB 71,495 / 179 MB 11,753,626 / 2.2 GB