Before I start reading, if this has anything to do with differential privacy, I’m going to be disappointed.
Self Proclaimed Internet user and Administrator of Reddthat
Before I start reading, if this has anything to do with differential privacy, I’m going to be disappointed.
2nd best reporting in.
A faster db. Just the regular performance benefits, https://www.postgresql.org/about/news/postgresql-16-released-2715/
Also, Lemmy is built against v16 (now) so at some point it will eventually no longer JustWork
The script will be useless to you, besides for referencing what to do.
Export, remove pg15, install pg16, import. I think you can streamline with both installed at once as they correctly version. You could also use the in place upgrade. Aptly named: pg_upgradeclusters
But updating to 0.19.4, you do not need to go to pg16… but… you should, because of the benefits!
That awkward moment when you are the person they are talking about when running beta in production!
Since the 11th @ 9am UTC, LW has seen a 2 fold increase of activities. If my insider knowledge is right (and math) it’s 7req/s average up from 3req/s.
Lucky for both of us we are not subbed to every community on LW but I think we are subbed just enough to be affected.
Relevant: https://reddthat.com/comment/8316861 tl;dr. The current centralisation results in a lemmy-verse theoretical maximum for of 1 activity per 0.3 seconds, or 200 activities per minute. As total transfer of packets is just under 0.3 seconds between EU -> AU and back.
Edit: can’t math when sleepy
Should be already fixed. I’ve logged out and in on Jerboa.
We rebuilt the Lemmy container with an extra logging patch. Seems build docs need some work? as that’s the only difference in the past 1-2 days, except for moving to postgres 16…
Thanks for the ping.
I’ve gone back to mainline Lemmy. @Morpheus@lemmy.today check now please
Make sure to read the side bar. Support questions go to !askandroid@lemdro.id
See my PR for a new backup script. https://github.com/LemmyNet/lemmy-ansible/pull/210
I’ll get to adding it to the main docs on the weekend.
Tldr, piping your backups via docker is CPU expensive. Directly writing to filesystem in a postgres compatible format with compression is faster and more efficient on the CPU.
My 90GB+ (on filesystem) db compresses to 6GB and takes less than 15 mins.
Been running this since -rc1 & 0.19.1 for the past 13 hours. No issues related to Federation since! just higher CPU load compared to 0.18.x releases.
Thanks for another great release. Suppose I should go fix our ansible ey?
Should be fixed. (It already got merged: https://github.com/LemmyNet/lemmy/pull/4213)
No worries! I hope the community comes back around!
Yeah funding is good. Completely community funded :) Ours is on open collective if you want to see it 😉 (we are completely transparent)
We (reddthat) would welcome your community. 😉
Don’t forget & in community names and sidebars.
Constantly getting trolled by &
No reddthat too? 😜
Oh I was wrong, after further reading this looks to be a lot better than what I was thinking.
I must have been thinking about another methodology of attempted privacy over a dataset.