[Done] New try at upgrading to 0.18.1 July 1st 20:00 CET

We’ll give the upgrade new try tomorrow. I’ve had some good input from admins of other instances, which are also gonna help troubleshoot during/after the upgrade.

Also there are newer RC versions with fixed issues.

Be aware that might we need to rollback again, posts posted between the upgrade and the rollback will be lost.

We see a huge rise in new user signups (duh… it’s July 1st) which also stresses the server. Let’s hope the improvements in 0.18.1 will also help with that.

GatoB,

How loaded are the servers? It would be good to see it maybe in the instance sidebar or a website

Nuggets,

Finally able to register. Glad to be here.

reblochon,

Nice work!

ReducedArc,

The progressive web app had ui issues after the update so I uninstalled it and now I can’t figure out how to reinstall it 😕 tried wefwef but that doesn’t load anything and can’t log in. Happily staying patient though, hoping things smooth out!

Spitz,

A lot of improvements, but some weird problems. Jerboa finally allowed me to log in but not much else. Connect is working better, but won’t allow me to reply to one particular post (“incorrect language” or something). The browser version and wefwef are slow and glitchy - my comment about birds ended up in a conversation about Lemmy apps. I don’t know anything about tech stuff but I get the impression that people are working very hard to fix all the issues. And the spezidus wouldn’t be making things easy. Looking forward to a bigger better Lemmy!

PreciousDeclaration,

I just installed the newest version of Jerboa, and have been trying repeatedly to log in, but I keep getting an error message saying “incorrect login”. How did you finally get logged into Jerboa, did you have to change your password?

Spitz,

Didn’t change my password, just reinstalled the app and logged in. But it won’t let me post, reply, check messages, reply to messages etc. So not really worth it at the moment.

PreciousDeclaration,

I just installed the newest version of Jerboa, and have been trying repeatedly to log in, but I keep getting an error message saying “incorrect login”. How did you finally get logged into Jerboa, did you have to change your password?

PreciousDeclaration, (edited )

I just installed the newest version of Jerboa, and have been trying repeatedly to log in, but I keep getting an error message saying “incorrect login”. How did you finally get logged into Jerboa, did you have to change your password?

Edit: I finally gave up last night trying to login to Jerboa, but I tried again this morning, and was able to successfully login.

Spitz,

Didn’t change my password, just reinstalled the app and logged in. But it won’t let me post, reply, check messages, reply to messages etc. So not really worth it at the moment.

ulu_mulu,
@ulu_mulu@lemmy.world avatar

It worked this time, nice!! Feels a lot better, much more responsive.

Anaralah_Belore223, (edited )

Website loading took about 2 seconds

Posting this comment took about 5-9 seconds

Editing this comment took about 3-8 seconds

SuperCuber,

Looking better! Let’s go!

candyman337,
@candyman337@lemmy.world avatar

Tried to logout, website on mobile won’t release my session, and when I tried to login on jerboa it said password incorrect, not sure if that’s a ui issue or a lemmy.world issue though

Hetoimos,

404 record not found on mobile.

Hetoimos,

404 record not found on mobile.

AtheistComic,

Pages loading slowly here and sometimes not loading content. Could be due to the number of new users.

FiduciaryOne,

Thanks everyone for your hard work!

CertifiedDook,

Logging in doesn’t work - returns 404 record not found. Resetting password does log you in though,

Grangle1,

Was just able to login at least on browser using password reset. Can confirm.

ultrahamster64,
@ultrahamster64@lemmy.world avatar

New update sure is fire, post making process page is all cleared up!

Barns,
@Barns@lemmy.world avatar

Looking awesome! faster, more responsive, new sorting types, tighter layout, no auto-load of random posts 🥳 🥳

Just need to sort out the wefwef issue, and we’re back in business…

00Lemming, (edited )
@00Lemming@lemmy.world avatar

PSA from Admin Team: The update completed roughly two hours ago. Since that time, the Admin team (and other site admins) have been working on the noted performance issues. We believe we have found a solution, but we still need time to test this out. You may still see brief outages and differences in performance as we are testing different configurations. We are trying to prevent rolling back.

While I know this can be frustrating - especially today - please keep in mind we have a team of volunteer techies (from around the globe!) collaborating on this issue. It is an inspiring situation. Also keep in mind that lemmy.world is quite a bit larger (and more active than any other instance). As such, we are a bit of a ‘test instance’ in regards to high volume requests. This is just part of the growing pain. We appreciate your understanding.

@ruud will provide a debrief once we have completed testing.

AlmightySnoo,
@AlmightySnoo@lemmy.world avatar

It’s not just performance issues (which seem to be solved right now?), the login form doesn’t work at all.

00Lemming,
@00Lemming@lemmy.world avatar

The login form should be related to the overall spiking we were seeing, though I can’t say we had conclusive evidence of that. I have been able to get it to load properly with a few refreshes. Maybe try clearing your cache? I had to do that several times during testing.

RaoulDuke,

For me login fails because lemmy.world/api/v3/user/login returns 404, it doesn’t seem like a cache problem on my end.

00Lemming,
@00Lemming@lemmy.world avatar

This is being reviewed by the Admin team. Are you logging in via browser or app?

RaoulDuke,

I’m logging in using browser.

RaoulDuke,

It seems to work now.

00Lemming,
@00Lemming@lemmy.world avatar

That is good to hear :) we continue to analyze the config to see where this failure is potentially happening.

TurnItOff_OnAgain,

We are happy to have all of you! Do what is needed to make this place the best. Even reddit sucked in the early days.

502 it went through, 504 try once more

00Lemming,
@00Lemming@lemmy.world avatar

Thanks for the kind words! Yeah, there are definite growing pains, and likely will be for some time (just do to the codebase we are working with, understandably). We have a really solid group though heading up lemmy.world though so we will be just fine ;)

illi,

Not sure if this is a good place to ask but it was on my mind these days, with the big user boom and probably most of it being directed at .world - should some of us consider moving to other instance to make room? Would it make sense? Would it help? Or are you ok having so many users under the .world umbrella (possibly causing even greater flood with people seeing it is the “main” (with biig quotes there) instance?

00Lemming, (edited )
@00Lemming@lemmy.world avatar

Technically speaking, yes, a portion of our issues are due to the highest user base of an Lemmy instance. So in theory, if half of our users dispersed to other instances, we would likely see some performance improvement here. However, lemmy.world is intended to be an accessible instance for the general population. The server itself that is running lemmy.world is beyond spec’d to handle much more than this user load. We are running up against code-level issues that we may or may not be able to get around with our internal configurations. This is just part of developing software in an environment were you go from a few thousand users total to hundreds of thousands in the space of a few weeks. There is no directive to have users create accounts on new instances, though if you are looking for an immediate performance improvement, that may be your best option currently. That is up to you to decide :)

illi,

Gotcha. So pretty much if I want to personally avoid the growing pains (or possibly ease them for others), I should consider it, but doesn’t particularly help you directly. Thanks for clarifying and thanks for all the work you all put into it!

00Lemming,
@00Lemming@lemmy.world avatar

Yup you nailed it. For additional context, Ruud is running an almost identical server for his Mastadon.world server which has 160k users. Relatively speaking, these are large, performant, and expensive servers. They can absolutely handle the current user influx we are getting from the Reddit exodus. Are hands are tied by software limitations unfortunately. I can confidently tell you were are constantly in communication about ways we can amplify user experience with the tools that we do have access to. For instance, this status page was recently spun up which you can access anytime you think there might be server issues to help confirm that what you are seeing is recognized at a server level. Things like that.

All that being said, for users who are looking for a smoother experience right now, I can recommend lemm.ee as a solid home as well. Their admin Sunaurus has been very active and helpful throughout this process and handles his instance very professionally. He is essentially another Ruud (though Ruud is the best! ;)). Just something to keep in mind going forward as I can’t make any promises about the time frames for these issues being resolved. Hopefully once we get contact back from the Lemmy devs we can start expediting a resolution. They have a lot on their plates right now though, haha, so we will see. Cheers!

illi,

Thanks for the additional context, you guys rock!

  • All
  • Subscribed
  • Moderated
  • Favorites
  • lemmyworld@lemmy.world
  • GTA5RPClips
  • DreamBathrooms
  • thenastyranch
  • magazineikmin
  • osvaldo12
  • ethstaker
  • Youngstown
  • mdbf
  • slotface
  • rosin
  • ngwrru68w68
  • kavyap
  • tester
  • cisconetworking
  • megavids
  • InstantRegret
  • khanakhh
  • cubers
  • everett
  • Durango
  • tacticalgear
  • Leos
  • modclub
  • normalnudes
  • provamag3
  • anitta
  • JUstTest
  • lostlight
  • All magazines