Talk:Overpass API/status

From OpenStreetMap Wiki
Jump to: navigation, search


Maintenance work 2016-07-13

To fix data damage caused by a software bug, the main instance and later on the Rambler instance will lag behind by some hours for some hours. The general availability is hopefully not affected. Work is scheduled to start at around 07h00 UTC --Roland

overpass-api.de is back to normal operations.

Yes but it is still extremely slow, and too many requests are failing before even reaching completion (no HTTP reply, failure to connect, or fatal error in execution due to lack of memory). I suspect there's heavy load caused by many background processes for some reconstruction or indexing (e.g. to reconstruct the preset "areas"). Only very simple queries are working, provided they don't return more than about 1MB of data. — Verdy_p (talk) 20:02, 26 July 2016 (UTC)
That's no longer the case. Mmd (talk) 07:46, 4 August 2016 (UTC)
It is still the case, I have examples of queries that need to return about 6MB of data after about 20 seconds of processing, that currently work perfectly with the French instance but fail with the German and Russian instance (probably because of lack of memory/resources or some internal SQL deadlock causing an uncaught exception): there not even a HTTP status return, the connection is accepted but gets closed abruptly after a few seconds before returning anything). — Verdy_p (talk) 14:47, 4 August 2016 (UTC)
overpass turbo shortlink, please. Mmd (talk) 15:08, 4 August 2016 (UTC)
If the maintenance work is terminated (internal knowledge of the local processing logs), please update the status page (indepednantly for the German and Russian instances). This will tell when to start the same maintenance on the French instance (which for now is not affected at all: I don't know which kind of bug you're correcting, I've not seen something wrong or missing on any instance, except some normal delays to reflect recent changes in the main DB). — Verdy_p (talk) 16:34, 4 August 2016 (UTC)
Again my question. can you please post an overpass turbo shortlink to support your statement I have examples of queries that need to return about 6MB of data after about 20 seconds of processing, that currently work perfectly with the French instance but fail with the German and Russian instance. Mmd (talk) 16:37, 4 August 2016 (UTC)

Rambler will still take a while. --Roland

Same effect for now as on the German instance. For now the French instance has no such problem and may be used if your querties are failing on the Russian or German instances. It's unfortunate that two major instances are under maintenance in the same time (but the French instance still seems to absorb the shock). We really need to secure this Overpass service (which is essential for development, QA tools, checking map progresses, or just for some simple apps), with more instances. But who can provide and host it? Should'nt the OSM Foundation run its own instance (recoverting some servers that are now disused such as the one that was running the OWL Beta) ?
I would like that this OSM support be proposed and added in the next SOTM World conference (where other develomments should be proposed to facilitate the mounting of additional mirrors and distribute the work load). This is more critical now that Mapquest stopped its free service and is now selling similar services for building custom maps with custom queries. Of course we'll need now to solidify also the tile serving CDN (with more caches). — Verdy_p (talk) 20:02, 26 July 2016 (UTC)
Basically, the French instance is affected by the same bug as the main instance and rambler. Sylvain is already informed, but hasn't yet started to rebuild the database. Expect some maintenance work for the French instance as well in the very near future. Also, I don't really see a massive impact on the French instance according to munin stats. Mmd (talk) 21:05, 26 July 2016 (UTC)