this post was submitted on 06 Mar 2025
4 points (100.0% liked)
Aotearoa / New Zealand
1774 readers
62 users here now
Kia ora and welcome to !newzealand, a place to share and discuss anything about Aotearoa in general
- For politics , please use !politics@lemmy.nz
- Shitposts, circlejerks, memes, and non-NZ topics belong in !offtopic@lemmy.nz
- If you need help using Lemmy.nz, go to !support@lemmy.nz
- NZ regional and special interest communities
Rules:
FAQ ~ NZ Community List ~ Join Matrix chatroom
Banner image by Bernard Spragg
Got an idea for next month's banner?
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Hey Dave, how much storage space is this lemmy instance using out of interest?
The main VPS drive is currently using 330GiB of storage. Onsite and offsite backups are extra.
This is largely the image storage (266GB) and that's partly historical (Lemmy used to keep full size images indefinitely as "thumbnails" and currently has no way to delete them). The database itself is around 25GB.
Thats less than I thought, considering how much content goes through this server each year.
A couple of versions back there were some changes to images. The current set up we have is to proxy all images and save none. Previously thumbnails were stored forever and other images were loaded direct from source (e.g. if someone on Lemmy.world uploaded a meme, everyone one looking at it on every instance would always load the image from lemmy.world). Proxying is optional in Lemmy but I've enabled it. There is still some tweaking to do because certain sites don't work well (from memory I think Imgur and Youtube are two big ones).
The proxy is currently configued to store images for 3 days after they were last accessed. So if no one on lemmy.nz looks at a particular meme for three days then the cached image is deleted. The image is re-loaded on demand, so if you go to look at something from a month ago and no one else has looked at it recently, then the lemmy.nz server will re-download it and then proxy it to you. If you browse All with order set to New you'll see this in action, as the brand new posts take a little while for the images to be downloaded and provided to you.
Posts from before we turned on proxying don't use the proxying, they just have the thumbnails stored in full resolution and kept indefinitely. I did previously use a tool for deleting old thumbnails which also helped.
Long story short, it's been a struggle to keep the hard drive use that small 😆