← Go back to CGN Federated Services

Database Severs out of Storage

February 29, 2024 at 8:00 AM UTC

ravenation-web ravenation-jobs ravenation-search cologne-web cologne-jobs cologne-search

Resolved after 13h 30m of downtime February 29, 2024 at 9:30 PM UTC

Status from 8:30 - Both Database nodes ran out of storage. After looking closer into this issue I could not find out what was using so much storage.

Status from 12:00 - After testing some other solutions, I decided to restore from the last backup. This restore is currently running.

Status from 14:00 - social.cologne is again available. For ravenation.club I cannot give an ETA when it is available again. Sadly there I mixed the backups up and have to redo the restore.

Status from 17:00 - ravenation.club is back online. Currently the search function is not working, because the Elasticsearch Database got lost in the process. I have to redeploy it and create reindex.

Status from 21:30 - Elasticsearch indexing finished.

Last updated: February 29, 2024 at 8:00 AM UTC