I didn’t think of using read only replicas, that would probably be a very good way to go since its probably 80%+ of actions are reads. Thanks for answering, I am excited to see the how lemmy grows and thanks for all the devs hard work!

I 100% agree with this and there have been great strides since I started using Lemmy ~v0.17! That said at some point optimization will have lower returns and have a higher effort to put into and once a community grows extensively it likely might not be enough, so I was curious to what you guys were thinking at that point, something like Ctius for sharding postgres?

It is a k8s cluster and using ceph for all of my storage so the latency from that I bet is the largest reason and upping the memory offsets the disk writes. i also have another postgres DB syncing as a fallback for high availability. Fortunately after tuning the database and giving it enough RAM my instance has been running pretty stable for over a year without any changes.

I am also using less powerful computers for the entire infrastructure (not server grade) which brings to the point of having horizontal scaling on database I imagine will be a growing need with growing instances, communities, and users since it can be cheaper to run multiple smaller spec servers rather than a single with the added benefit of high availability.

Yeah I used pgtune as a base and found more memory needed to be assigned to certain spots especially to keep federation with bigger instances, otherwise timeouts would occur resulting in my instance being constantly behind.

That said I read postgres 17 is much more memory efficient, though I have yet to move my lemmy database to it yet since its the largest haha.

On the server perspective, I have a question, what are your thoughts for horizontal scaling on the database? This seems to be the biggest limitation and requiring higher spec hardware to scale especially for the bigger instances.

My tiny instance for example I give over 20GB of RAM just to postgres to make it perform efficient enough.

There is an issue open requesting this… I been following it for a while.

Issue #2631

If its at the end forever it might be because you are putting too much soap in.

Ah your right it was just a extremely close gap after all the tallying was done. Shows how bad memory can be.

He lost the majority vote so technically not a majority of voting Americans voted for him.

Hey I don’t judge people from their fetishes. Not since the incident at least.

The answer I was hoping for!

For clarification, human meat or humane?

Power company was giving them away. It was weird they all had a musky smell to them.

I had power out with a newborn for like 5 days in the winter once… 30min sounds nice.

This is a nice tool though using it I think triggered my IP to be flagged with Cloudflare when I was trying to fix an issue with my instance and lemmy.ml.

I saw sharrr the other day which apparently can be self hosted and uses cryptography / expiracy / single download / multi part downloads to make it hard to find a compete file if an attacker even has host access, it also encrypts the file prior to uploading to the server and only you on the client side have the encryption.

That said, this is all according to the architecture of the service, not sure about security in practice.

If you are using openvpn this env may be a good thing to try. It may need adjusted though.

OPENVPN_MSSFIX=‘1350’

Yeah that makes sense I didn’t mean in any aggressive way I guess codeberg is archived so that answers the question of what one to use for issues and such. I’ll put up a feature request on it. I do appreciate the work and have been watching it progress!

What’s up with changing to github?

I’ve been watching this one since it can support high availability but the biggest thing I see missing is support for indexing / searching documents.

I like the direction this has gone so far and excited to see how it continues!

VPN would still work for iPhone I imagine. Small whitelist of DNS would do 90%+ of the job.