Statusmeldungen | RescueOperator Vorfälle und Wartungen, die auf der Statusseite für RescueOperator gemeldet wurden https://status.rescue-operator.com/de https://d1lppblt9t2x15.cloudfront.net/logos/4dcc71ed0194f57e161fb742242fdace.png Statusmeldungen | RescueOperator https://status.rescue-operator.com/de de Routing Service Downtime https://status.rescue-operator.com/de/incident/1101950 Sun, 25 Oct 2026 10:57:00 -0000 https://status.rescue-operator.com/de/incident/1101950#3243337bc167dcb2010555b8e4935586db921de03418857239252852405aed3f Incident Routing Service restarted and healthy again Routing Service Downtime https://status.rescue-operator.com/de/incident/1101950 Sun, 25 Oct 2026 10:50:00 -0000 https://status.rescue-operator.com/de/incident/1101950#449288ea6a26fb6cbf9fd88c796610caa6e27ea0da199c6a675a617e075c4767 Incident Our routing Service is not responding Hetzner vSwitch Degraded Performance https://status.rescue-operator.com/de/incident/1096159 Tue, 20 Oct 2026 20:00:00 -0000 https://status.rescue-operator.com/de/incident/1096159#a9e4714926895b3b265c30bca4bca50268fd166bffb9b804a1d3e1c03b9da387 Incident Hetzner has completed it works, we had no further downtimes Hetzner vSwitch Degraded Performance https://status.rescue-operator.com/de/incident/1096159 Tue, 20 Oct 2026 19:08:00 -0000 https://status.rescue-operator.com/de/incident/1096159#a77e48d686616f5358f3b9878d09b7b5b000d025e6ca4df4456a745928d77539 Incident 🇩🇪 Kurzzeitige Störung: Spiel nicht erreichbar Am 20.10.2026 war das Spiel zwischen ca. 21:08 und 21:13 Uhr (MESZ) nicht oder nur eingeschränkt erreichbar. Beim Laden kam es zu Fehlermeldungen und Zeitüberschreitungen. Ursache war eine Netzwerkstörung bei unserem Hosting-Anbieter. Sie hat die Verbindung zwischen unseren Servern und der Datenbank kurzzeitig unterbrochen. Nach der Wiederherstellung der Verbindung lief der Betrieb wieder normal. Es sind keine Spielstände verloren gegangen. Der Anbieter untersucht die Störung noch. Wir beobachten die Lage weiter und informieren hier, falls es erneut zu Einschränkungen kommt. https://status.hetzner.com/incident/10c63641-a480-458e-aee2-e6656a78d2f4 🇬🇧 Brief disruption: game unavailable On 20 Oct 2026, between approx. 21:08 and 21:13 CEST, the game was unavailable or only partially available. Players saw loading errors and timeouts. The cause was a network issue at our hosting provider that briefly interrupted the connection between our servers and the database. Once the connection was restored, the game ran normally again. No game progress was lost. The provider is still investigating the issue. We continue to monitor the situation and will post an update here if there are further disruptions. https://status.hetzner.com/incident/10c63641-a480-458e-aee2-e6656a78d2f4 Hetzner DNS outage https://status.rescue-operator.com/de/incident/1087298 Thu, 08 Oct 2026 18:30:00 -0000 https://status.rescue-operator.com/de/incident/1087298#bb147c74e061178b0fe0e58447bf19532dc5c86e70feeb2e70641f728761014d Incident 🇩🇪 **Zusammenfassung** Am 8. Oktober 2026 war Rescue Operator von etwa 17:20 bis 20:30 Uhr MESZ größtenteils nicht erreichbar. Die meisten Spieler konnten weder das Spiel noch das Menü laden; Anfragen liefen in ein Timeout oder schlugen fehl. **Ursache** Unser Hosting-Provider Hetzner verzeichnete einen Ausfall seiner DNS-Server in der Rechenzentrumsregion, in der unsere Server betrieben werden (Hetzner-Vorfall: „Störungsmeldung zu rekursiven DNS-Servern an den Standorten HEL1, FSN1 und NBG1“, Beginn: 15:22 UTC). Referenz: https://status.hetzner.com/incident/39cb6392-be3d-4761-a369-eaad28b8b8fc Unsere Server nutzen diese DNS-Server zur Namensauflösung externer Dienste – einschließlich unseres Authentifizierungsanbieters. Diese Abfragen wurden extrem verlangsamt oder schlugen komplett fehl. Dadurch konnten unsere Gameserver eingehende Anfragen nicht mehr verarbeiten, obwohl die Server, die Datenbank und die Spielanwendung selbst fehlerfrei liefen. Der Ausfall wurde nicht durch Code- oder Konfigurationsänderungen auf unserer Seite verursacht. **Behebung** Wir haben unsere Server auf unabhängige, öffentliche DNS-Resolver (Cloudflare und Google) umgestellt, wodurch die Abhängigkeit von den betroffenen Hetzner-DNS-Servern aufgehoben wurde. Das Spiel läuft seit 20:30 Uhr MESZ wieder stabil und ohne Einschränkungen. **Präventivmaßnahmen** * Dauerhafte Nutzung unabhängiger, redundanter öffentlicher DNS-Resolver auf allen Systemen * Erweiterung des Monitorings um End-to-End-Prüfungen (vom Login bis zum Backend), um Ausfälle dieser Art schneller zu erkennen Wir entschuldigen uns für den Ausfall und bedanken uns für eure Geduld! --- 🇬🇧 **Summary** On October 8, 2026, Rescue Operator was largely unavailable from about 17:20 to 20:30 CEST. Most players couldn’t load the game or menu, and requests either timed out or failed. **Cause** Our hosting provider, Hetzner, had an outage of its DNS servers in the data center region where our servers run (Hetzner incident: “Fault report on recursive DNS servers at the locations HEL1, FSN1 and NBG1”, started 15:22 UTC). Reference: https://status.hetzner.com/incident/39cb6392-be3d-4761-a369-eaad28b8b8fc Our servers rely on those DNS servers to look up the addresses of external services, including our login provider. Those lookups became very slow or failed completely. That blocked our game servers from processing requests, even though the servers, the database, and the game itself were running normally. No code or configuration change on our side caused this. **Resolution** We switched our servers to independent public DNS servers (Cloudflare and Google), which removed our dependency on the affected Hetzner DNS. The game has been running normally since 20:30 CEST. **What we’re doing to prevent this** * Using independent public DNS servers on all our servers going forward * Adding monitoring that checks the full path from login to the game backend, so we spot this kind of failure within minutes We’re sorry for the disruption, and thank you for your patience. Hetzner DNS outage https://status.rescue-operator.com/de/incident/1087298 Thu, 08 Oct 2026 15:15:00 -0000 https://status.rescue-operator.com/de/incident/1087298#9799a6d3ad53b2cecec86122a64787fe495ab5707358df598cbb025a58b6418f Incident 🇩🇪 **Untersuchung läuft** Wir untersuchen derzeit Berichte über Verbindungsprobleme und lange Ladezeiten beim Starten des Spiels und im Menü. Wir halten euch hier auf dem Laufenden, sobald neue Informationen vorliegen. --- 🇬🇧 **Investigating** We are currently investigating reports of connectivity issues and loading failures when launching the game or accessing menus. We will post updates here as soon as more information is available. Wartung: [SCHEDULED] Infrastructure Works https://status.rescue-operator.com/de/maintenance/1059809 Fri, 11 Sep 2026 11:57:59 -0000 https://status.rescue-operator.com/de/incident/1059809#84a320cffb8cbf5a497ad78190da134e08ce3619cee002f5fec2261acdb6e302 Maintenance We migrate to a new database system. We expect complete downtime for about 1 hour Wartung: Infrastructure Updates https://status.rescue-operator.com/de/maintenance/1052830 Sat, 05 Sep 2026 22:15:00 -0000 https://status.rescue-operator.com/de/incident/1052830#7dbfa495ff196ce9f014f9b5976c8d84c2b3ab5d383f342eed2486276dc16fe3 Maintenance Planned maintenance Frontend Services - high latency https://status.rescue-operator.com/de/incident/1032105 Tue, 25 Aug 2026 07:50:00 -0000 https://status.rescue-operator.com/de/incident/1032105#46259dd1c44ea4224f1351b460dad05092bde0fa9d6bd1ceb83ebe457736d31f Incident The autoscaler scaled all frontend services excessively down to 1 container. We have identified the issue after restarting the frontend services. Frontend Services - high latency https://status.rescue-operator.com/de/incident/1032105 Tue, 25 Aug 2026 06:00:00 -0000 https://status.rescue-operator.com/de/incident/1032105#c728730965351f9594f2d01890511d369c92dade57a8a2152c5b2642964e3d22 Incident Game is loading slow for some users Wartung: Infrastructure Updates https://status.rescue-operator.com/de/maintenance/1031266 Mon, 24 Aug 2026 20:00:00 -0000 https://status.rescue-operator.com/de/incident/1031266#c11f8b4006cd19359ead631acea373fe6236830fe9f8e69ec8d4267f95d5260d Maintenance This is an planned event Database high latency https://status.rescue-operator.com/de/incident/1023982 Thu, 20 Aug 2026 22:00:00 -0000 https://status.rescue-operator.com/de/incident/1023982#9a8e77f3b71e1ef8229f87261d4fa36a6f8b1660731e80eae8a0363ed7ed2677 Incident We have successfully mitigated an malicious attack on our infrastructure and have blocked suspicious traffic Database high latency https://status.rescue-operator.com/de/incident/1023982 Thu, 20 Aug 2026 19:10:00 -0000 https://status.rescue-operator.com/de/incident/1023982#9f539df4db5b82e236ae19e4b0325d2891c27d45eadc56386df7adfcba47c868 Incident Our primary Database is experiencing high read/write latency. [SCHEDULED] Server Restart https://status.rescue-operator.com/de/incident/1006599 Mon, 10 Aug 2026 00:18:00 -0000 https://status.rescue-operator.com/de/incident/1006599#c4347c32e1c36fdb0210ec426de08fdffea9b590f04affe20aa6ae339bec949c Incident [COMPLETED] - Update & Restart [SCHEDULED] Server Restart https://status.rescue-operator.com/de/incident/1006599 Mon, 10 Aug 2026 00:15:00 -0000 https://status.rescue-operator.com/de/incident/1006599#62f5ed779a1fcecf6f26a204ee043249650f59abd7d8caaac35f77014f4db9df Incident Scheduled Weekly Server - Update & Restart RescueTerra Downtime https://status.rescue-operator.com/de/incident/964625 Wed, 15 Jul 2026 08:45:00 -0000 https://status.rescue-operator.com/de/incident/964625#46ed7cf4be3aac9e8b076ab53219c63868c57c6c94335385d1ff777c193e2f0a Incident We have identified an faulty pgsql plugin in the RescueTerra Postgres Database. The issue is resolved and all geo related data should flow in again. This impacted the mission generation as as well as the hydrants map. RescueTerra Downtime https://status.rescue-operator.com/de/incident/964625 Wed, 15 Jul 2026 07:45:00 -0000 https://status.rescue-operator.com/de/incident/964625#046334628f0f6d6316adc239e257a95e4679bf3a15bd16222aa80299effc59b8 Incident We are experiencing network drops to our RescueTerra Database. Wartung: Infrastructure Updates https://status.rescue-operator.com/de/maintenance/964484 Wed, 15 Jul 2026 06:30:21 -0000 https://status.rescue-operator.com/de/incident/964484#6ab7f5518b05fdc073add09b1ed2c3530bcd853a1c15cf98920d3d7e2ba80b35 Maintenance Infrastructure Updates Database high latency https://status.rescue-operator.com/de/incident/960032 Sat, 11 Jul 2026 13:05:00 -0000 https://status.rescue-operator.com/de/incident/960032#8f98622a6ecc57cd9bd95ee49ef76e57df3667a585f0d01ce617d644c0fc1c24 Incident We identified the issue and were able to fully restore the database after an Server restart. Database high latency https://status.rescue-operator.com/de/incident/960032 Sat, 11 Jul 2026 12:50:00 -0000 https://status.rescue-operator.com/de/incident/960032#96d5050685d168ea5e2e53923ac720699a52bf0d51f5f2f06d13a9bc30830b0e Incident Our primary Database is experiencing high write latency. Wartung: Version Update v2026.5.0 https://status.rescue-operator.com/de/maintenance/945001 Mon, 06 Jul 2026 16:02:25 -0000 https://status.rescue-operator.com/de/incident/945001#61b41e5ed7830ae764ccefe9696047851ef0b937264e9a00f8ea6ff1dea68ff4 Maintenance We roll out an major update and may experience some minor downtime during database operations. Faulty update of external services made the game unsuable for some users https://status.rescue-operator.com/de/incident/937128 Sat, 27 Jun 2026 13:00:00 -0000 https://status.rescue-operator.com/de/incident/937128#9c0304dcaaa54d6200684e70d8e75ebc6822ae564b222f93ab3188b75d24d240 Incident After a full purge of the faulty service and a complete server restoration, everything is up and running again. We do not expect any follow up problems. Faulty update of external services made the game unsuable for some users https://status.rescue-operator.com/de/incident/937128 Sat, 27 Jun 2026 11:30:00 -0000 https://status.rescue-operator.com/de/incident/937128#1291c42a11797f99a6a72e00f3a981e83dc569c1ed6cc7443bff3b2d70c42223 Incident Major incident: Due to a faulty update of an external service provider, our primary server experienced an unusual high CPU activity with following CPU starvation for our API and therefore an degraded Game service for some users. Wartung: Infrastructure Updates https://status.rescue-operator.com/de/maintenance/936789 Sat, 27 Jun 2026 07:59:30 -0000 https://status.rescue-operator.com/de/incident/936789#ae16b87b32f23c6bdcbaf634433eb8172650eb9aebad2ab5d3a592181f3d7cc2 Maintenance We are updating our servers.