this post was submitted on 23 Feb 2024
1 points (100.0% liked)

sh.itjust.works Main Community

7694 readers
1 users here now

Home of the sh.itjust.works instance.

Matrix

founded 1 year ago
MODERATORS
1
submitted 8 months ago* (last edited 8 months ago) by [email protected] to c/[email protected]
 

Hello sh.itjust.works community,

Many of you have been eager to get an update about when the sh.itjust.works instance will get it's upgrade to the latest version of lemmy. Here's a update along with a tentative timeline.

In December 2023 I purchased a new server for this community. It took me awhile but I eventually made the time to get it racked at the local datacenter. For the sysadmins lingering and those interested here are the specs:

  • Dual Xeon 2.9Ghz CPUs (32 cores total)
  • 256GB ram
  • 4 x 1TB SSD in raid 10 (with room to add 6 more disks)
  • 10gbit networking

While I'm ready to proceed with the upgrade, I've decided to first migrate this instance over to the new hardware. Here are two reasons.

  1. Those of you who have been around long enough may remember that I've been running this instance on "borrowed" unused resources that were available at the time. There are no more resources available for this instance to grow.
  2. There are reports that the latest version of lemmy may use more resources. Given we are among the bigger instances, should I end up in a situation where I need to increase resources to keep things fast I'll be restricted.

Here's the tentative timeline:

Task Date Expected Downtime
Migration to new server Tuesday February 27 2024 @ 8:00PM ET 90 Minutes
Upgrade to V19.3 Thursday February 29 2024 @ 8:00PM ET Up to 120 Minutes
  • If anything major goes wrong on the 27th I will revert back the changes and bring the instance back up on the current server.
  • If anything major goes wrong on the 29th I will revert back using an earlier snapshot. If that fails, I will restore from a backup.

During these two planned events those who want to provide moral support or who want to get periodic updates are more than welcome to join us on our matrix channel

=========================================================
Update February 29 2024
We've successfully completed the upgrade to v1.9.3. I'm happy to announce that we did it in an astonishing 27 minutes, a whole 93 minutes under what was expected. The extra leg work that was done over the last few weeks combined with the better hardware definitely played a part. Looking over the processes, it looks like the service responsible for images is still doing some work so it's possible that you will come across some broken images. I'll be keeping on eye on that over the next bit and make adjustments if needed. Thank you all for the support and to all of you who kept me company on our matrix channel. Have a good evening.

=========================================================
Update February 27 2024
We've successfully completed the migration. I'm happy to announce that this instance is now running on its new hardware dedicated solely to this community! We experienced just under 40 minutes of downtime which is a whole 50 minutes less than expected. Please give this instance a chance to catch up what it missed but we should be good within the next 30 or so minutes. Thank you

top 50 comments
sorted by: hot top controversial new old
[–] [email protected] 0 points 8 months ago

Can we please unpin this now? It’s the top of all of my feeds still.

[–] [email protected] 0 points 8 months ago

Lets go! Congrats on the upgrade of the hardware!

[–] [email protected] 0 points 8 months ago

Please let us throw monies at you

[–] [email protected] 0 points 8 months ago (1 children)

How does one go about the blocking whole instances in 19.3?

[–] [email protected] 0 points 8 months ago (1 children)

Profile > settings > blocks

Be aware that this will only block communities of that instance from your feed. You'll still see the users from the blocked instance posting in other communities.

[–] [email protected] 0 points 8 months ago

right on, thanks

[–] [email protected] 0 points 8 months ago

Pictures don't seem to show up... but I'm guessing this is a caching issue, so it should be resolved by itself.

[–] [email protected] 0 points 8 months ago

Wow congrats ! I'm glad it went well :D

[–] [email protected] 0 points 8 months ago

Félicitation à toute l'équipe, merci pour votre travail

[–] [email protected] 0 points 8 months ago (1 children)

Great work Dude!

Looks like pict-rs uploads by my account from today are working, still waiting on pictures from a few days ago and beyond. (Well prioritized, in that case.)

Thank you!

[–] [email protected] 0 points 8 months ago (2 children)

I can't upload any pictures anymore :(

[–] [email protected] 0 points 8 months ago (2 children)
[–] [email protected] 0 points 8 months ago

All fixed, and photos restored. Thanks!

[–] [email protected] 0 points 8 months ago

Awesome, now I can go back to posting more AI images

[–] [email protected] 0 points 8 months ago (1 children)
[–] [email protected] 0 points 8 months ago* (last edited 8 months ago) (1 children)

Same. And I've got a high effort meme waiting to be posted too...

[–] [email protected] 0 points 8 months ago (1 children)

If they’re your memes and you want to post them now!

Upload to Catbox.moe

Copy the link and stick it inside this code:

![](LINK)

like

![](https://files.catbox.moe/ppmhl9.png)

[–] [email protected] 0 points 8 months ago

Thanks! By the time I saw your comment, the problem had been fixed, but I'll remember this catbox address, it might come in handy! (I knew other image hosting sites, but I wasn't sure if these still displayed images correctly on Lemmy since at one point one of the big instances had deleted all the externally hosted images)

[–] [email protected] 0 points 8 months ago (1 children)

I've encountered a problem, not sure if it's related to the update or not. On both Eternity and browser my Subscribed feed shows posts from All. From Eternity only upvoting posts fails with a 401 code, but I seem to be able to do it on the browser. Any one else encountered some like that?

[–] [email protected] 0 points 8 months ago (1 children)

Others have reported making Eternity work by removing their account and re-adding it.

[–] [email protected] 0 points 8 months ago

Thanks, that seems to have fixed it!

[–] [email protected] 0 points 8 months ago

Thank you!!!

[–] [email protected] 0 points 8 months ago

Dang, I was looking forward to being productive today, but you were just too quick.

[–] [email protected] 0 points 8 months ago

Dude, you're the Scotty of the fediverse, you rock.

Image

[–] [email protected] 0 points 8 months ago

Just want to say Good Luck and we're all counting on you!

[–] [email protected] 0 points 8 months ago* (last edited 8 months ago)

I know Scaled isn't selectable in Sync so you have to set it as default in Lemmy settings to use it. Does anyone know what other new features have no/limited compatibility with Sync? Or any other app for that matter?

[–] [email protected] 0 points 8 months ago

Good luck, Dude! I'm sooo looking forward to seeing what I previously upvoted.

[–] [email protected] 0 points 8 months ago

Good luck with the update in (if I'm right in the timezone calculation) a couple of hours...

[–] [email protected] 0 points 8 months ago

Nice job on the migration! Excited for the update!

[–] [email protected] 0 points 8 months ago (1 children)

Woohoo!

Now, can anyone point out what -if anything- changed for us end users?

[–] [email protected] 0 points 8 months ago (1 children)

This change only brings speed & stability, which is essential, but hard to see for us, end users. The bigger one is going to happen on Thursday, where Lemmy itself is going to be updated. After Thursday's update, any users will be able to block entire instances and see our upvotes, along with many other Lemmy updates.

[–] [email protected] 0 points 8 months ago (1 children)

After Thursday’s update, any users will be able to block entire instances and see our upvotes,

awww yeaaaahhhh finally! thank you!

[–] [email protected] 0 points 8 months ago

Note that it is only blocking communities. You'll still see comments from users registered there. IIRC

[–] [email protected] 0 points 8 months ago

this instance is now running on its new hardware dedicated solely to this community! We experienced just under 40 minutes of downtime which is a whole 50 minutes less than expected

Woohoo, that's awesome! Thank you so much!

[–] [email protected] 0 points 8 months ago

Wow, so new and snappy, smells like fresh cut mahogany in here

[–] [email protected] 0 points 8 months ago
[–] [email protected] 0 points 8 months ago (1 children)

Looks like the site was down this morning. Was the migration done earlier ? or just some downtime ? Good luck for the migration, It's an opportunity to use my alt account on fedia, so not that bad

[–] [email protected] 0 points 8 months ago (1 children)

There was a little hiccup this morning unrelated to the migration tonight. The Lemmy services like to be restarted every once in a while. Once we move to the new hardware I'll be able to look into implementing a better logging system and hopefully be more proactive when situations like these happen.

[–] [email protected] 0 points 8 months ago

Tysm for your work ! I appreciate it a lot!

[–] [email protected] 0 points 8 months ago

That's a relatively low spec server, I thought it would be worse. What does the co-location cost?

load more comments
view more: next ›