Appreciate the quick response even on Canada Day! Have a good one!
this post was submitted on 01 Jul 2024
152 points (100.0% liked)
Lemmy.ca's Main Community
3325 readers
17 users here now
Welcome to the lemmy.ca/c/main community!
All new users on lemmy.ca are automatically subscribed to this community, so this is the place to read announcements, make suggestions, and chat about the goings-on of lemmy.ca.
For support requests specific to lemmy.ca, you can use [email protected].
founded 4 years ago
MODERATORS
Happy Canada Day! Lol
Good morning and happy Canada Day. Thanks for working tirelessly to get things running.
Seems like the API, apps and other frontends were working but the main web frontend wasn't? I wonder if it is anything similar to what happened to the unfortunate feddit.de
Something got into a weird state and restarting either the backend or frontend didn't help. Taking the entire stack down and then bringing it back up, resolved it.
It's weird since it crashed at 1am and at 3am we gradually restart all backend and frontends, so that automatic restart should have fixed it too. All the containers reported healthy, but nginx wasn't reporting any available frontends.
I suspect some sort of weird lemmy bug, but we'll just have to improve monitoring for now and try to debug this more if it happens again.
I believe feddit.de is moving to feddit.org actually, the original instance might have gone down fully now
I just learned about it the other day: https://lemmy.ca/comment/10102577
Hi there! Looks like you linked to a Lemmy community using a URL instead of its name, which doesn't work well for people on different instances. Try fixing it like this: [email protected]
I found a post with context on oldfeddit's main, it's someone writing in German saying the site [note: specifically the frontend] is down and the admin is MIA. Feddit.org is ran by a Viennese non-profit.
Thanks for everything you guys do. And on Canada Day no less!
thank you
Happy Canada day, legends.
Hello,
Good luck with the troubleshooting!
As I suggested elsewhere, could you maybe setup a "status" community on another instance (e.g. sh.itjust.works, it's Canadian as well), so that people can go there to see updates about the potential outages?
We have https://status.lemmy.ca already in place, we'll try to keep it updated as much as possible.
Indeed, but I was more talking about a Lemmy community where people would be able to discuss and give each other information.
I actually stumbled upon someone asking a question on Reddit, it could have been interesting to have a place to redirect this person to: https://old.reddit.com/r/Lemmy/comments/1dtj4hc/can_anyone_help/
The alternative is a Matrix room, but it might take some time to set up compared to just a community on another instance
I'm looking at making a custom CloudFlare error page that embeds the status page. At least we'll be able to put some communication there when something happens without people having to guess where to go.
Sounds great, thanks!