Meta community. Discuss about this lemmy instance or lemmy in general.
Final Update: Problem has been resolved by migrating my lemmy backend. We are currently catching up to lemmy.world, which should probably take all the next day. But the "distance" is reducing by hundreds of syncs per minute.
I will write a post-mortem soon
congrats, as a self hoster myself, i understand the feeling of getting something up and running to your liking. It's the best feeling.
I'm interviewing for a job today that could drastically change my life. If I get it I'll be setting aside some $ to help maintain this instance. Your work here and beyond (ex. AI horde) are incredible and I'm looking forward to helping
much appreciated mate!
Thanks a lot for putting the energy and time into fixing this.
Thank you for your continous work!
Thank you so much 🙏
Hell yeah!
HACKERPERSON-Energy. Hope you feel relieved now.
like you wouldn't believe
Appreciate everything you do! Thanks
W admin
Update: I have to take pict-rs down while I migrate
Update: Most likely culprit here is the distance between my backend and my DB. I am now planning a migration. I'll keep you posted
Just reminding everyone that if you can’t contribute with coding knowledge, you can alternatively contribute with a donation through Ko-Fi. There is also an option for LiberaPay if you prefer that platform.
Update: No appreciable change. I've now recompiled lemmy from scratch and added lemmy.world incoming apub federation to its own backend. Somehow that made the requests from LW 5x slower. This makes no sense...
I've tried tweaking the DB connection pool, with no appreciable effect to performance.
Maybe this is a dumb question but is there any indication the server is cpu-, memory-, disk-, or network-bound?
Thank you about all your work, you are amazing
Much appreciated update. Thank you for your work and everything you do. o7
I can help with docker and linux stuff if you need it, I work with them daily.
Best of luck. Hope we can figure this out.
This sounds so very complicated, I wish I had the expertise needed to help you out. I hope a fix can come soon.
Thank you for all the time you're dedicating towards this issue and for keeping us updated. You're the best!
I can help with docker and some linux stuff mainly, pm me if needed. I could also offer my instance (of 2 active users) for testing if needed.
I don't have experience with hosting lemmy, but I can help with the Linux and Docker parts too. Just PM me @[email protected]
Thanks peeps. I already figured out the docker stuff. What I need is help debugging lemmy internals
No help from Lemmy devs ? Sound they would be the only hope. Looks something deep in lemmy, is there a bug report open in their git ? sharing this and solving will help other instances in the future.
Have you tried simply uninstalling and reinstalling?
I'll see myself out...
Imo we should make a brand new instance to start clean.
We will call it dbzer1.com, it will be much better with hookers and blackjack!
Why stop there, we could make a religion out of this!
Probably a good idea to stop after several dozen iterations. dbsixty9.com sounds promising!
Good luck. o7
Thanks for the update. Appreciate all your hard work.
thanks for informing us on the situation