I am sure many of us have noticed that the site had problems over the last four or five days.

The downtimes were caused because of unrecoverable hardware issues with our server. The result was that he had to rebuild the setup from scratch on a machine and restore from a backup. We have also switched to a new provider since the previous one was consistently causing issues.

After this was done, image uploads were still broken for some time. There was no good fix for this because one of the database files used by pictrs had become corrupted due to the aforementioned hardware issues. To resolve this, we had to use an non-corrupted database file from a very old backup. Now image uploads should work fine. The downside is that images uploaded recently will not show up properly. There is not fix for this other than to reupload these images. Sorry about this.

Most of the technical problems with the site should be fixed now.

There is one maintenance task remaining related to moving the image storage to a new S3 provider which will require some downtime. We will inform about this beforehand.

Thanks for your patience.

  • redtea@lemmygrad.ml
    link
    fedilink
    English
    arrow-up
    5
    ·
    1 year ago

    Would it be worth making a post on lemmy.ml if lemmygrad becomes inaccessible? I had thought there was a ddos attack, as one of the big servers was hit yesterday, maybe lemmy.world.