BeAware,
@BeAware@social.beaware.live avatar

Does anyone have a very detailed and comprehensive guide on how to scale up a Mastodon server?

I'm pretty noobish to Linux but I can follow guides if they have commands and stuff. Though, the only guides I could find were very light on the commands for certain steps.

My Sidekiq has been getting backed up every now and then with thousands of jobs. Of course they eventually clear out but I'd like to just mitigate it by adding more processes or whatever because I'm not even using 50% of my server resources🤷‍♂️

Any help would be much appreciated.

PS. My server is currently backed up so if you reply to this, I probably won't see it for a bit.😬

esk,
@esk@hachyderm.io avatar

@BeAware @hazelweakly wrote up a nice summary of things we did to #hachyderm after the initial surge Back In The Day, but i can't seem to find it.

esk,
@esk@hachyderm.io avatar
hazelweakly,
@hazelweakly@hachyderm.io avatar

@esk @BeAware yup, this ended up accidentally becoming the most comprehensive guide to scaling mastodon on the internet at the time. I'm not sure if it still is, but I wouldn't be surprised

Happy to answer questions if you have any! :)

BeAware,
@BeAware@social.beaware.live avatar

@hazelweakly @esk just giving it a glance, it might be over my head a bit...😅but I'll get a better look tomorrow when I'm in a better headspace.

kalfatermann,
@kalfatermann@mastodon.social avatar

@BeAware

I really don't want to talk people down, but simply setting up Mastodon is not enough, because you should also think about user security. There is a lot of user data that does not belong in other people's hands!

BeAware,
@BeAware@social.beaware.live avatar

@kalfatermann It's just my data and I've been very public so I don't have any false sense of privacy or anything here.

Federation doesn't give out private things like email or IP, so I think I'm okay in that department. I've been here for almost a year now...

koen,
@koen@procolix.social avatar

@BeAware what is your starting point?

What kind of resources does your server have, how many users do you have, how many followers, how many are followed?

I can tell you how to run an instance with thousands of users, using loadbalancers and spread out sidekiq processes, but that might be bad advise if you just need a bit more uhmpf in the right place.

BeAware,
@BeAware@social.beaware.live avatar

@koen My account is the only one of note that has basically any activity at all, so you can see my followers and following on my profile. My server is using the specs provided in the screenshot below.

I don't plan on slowing down anytime soon in terms of followers...I usually get 75-100 new followers per month so far.🤷‍♂️

If I could get help simply making use of the resources I currently have, even if it's overkill, so it would sort of "future proof" this kinda thing, that'd be great.

koen,
@koen@procolix.social avatar

@BeAware my guess is that is a virtual machine.

You are probably going to want to optimize your Postgres database first (to fit it to the amount of resources in your system).

BeAware,
@BeAware@social.beaware.live avatar

@koen Yea, it's a droplet from DigitalOcean.

Do you have any type of long form guide with commands and such? I'd hate to spam our timelines with a hundred questions going back and forth😅

koen,
@koen@procolix.social avatar

@BeAware go here: https://docs.joinmastodon.org/admin/install/#setting-up-postgresql then follow the pgTune link.

By the way, that page is full of optimization tips, but I would do this first. 😎💪🏻

BeAwaretv,

@koen I did what you said with the PGtune link and after I restarted my postgres, I can no longer access my instance...😭 😬 I feel defeated. I dont know what the original values were and how to get it back. =

koen,
@koen@procolix.social avatar

@BeAwaretv oh my, that is not good. Did your postgres start again after the changes?

BeAwaretv,

@koen what is the command to check this?😬

koen,
@koen@procolix.social avatar

@BeAwaretv
I would say ‘systemctl status postgresql’ and it should show if it’s running and some log entries.

BeAwaretv,

@koen Looks okay, but says "exited". not sure what that means exactly...

koen,
@koen@procolix.social avatar

@BeAwaretv this might be a bit crude, but perhaps a full restart of the droplet might help.

BeAwaretv,

@koen okay. I can shut it down and restart it. Let me see what happens

BeAwaretv,

@koen didn't help....😭 🤦‍♂️ I guess my Fedi adventure might be over...

koen,
@koen@procolix.social avatar

@BeAwaretv no need to be fatalistic about it. You have probably made a typo in the postgres config file or something else very small. Your data is not gone, you just need to get your database server started again.

koen,
@koen@procolix.social avatar

@BeAwaretv is there someone you trust that has a bit more Linux experience that might be able to help you get it running again together with you?

I have to get some sleep now (it’s 2:30 am and I have to get up in a few hours).

If nothing else helps I might be able to help you further tomorrow.

trendless,
@trendless@zeroes.ca avatar

@BeAware this page by @gunchleoc has a bunch of links to resources re: scaling at the very bottom

https://co-shaoghal.net/index.php?page=173&offset=0#section235

  • All
  • Subscribed
  • Moderated
  • Favorites
  • mastodon
  • DreamBathrooms
  • magazineikmin
  • thenastyranch
  • hgfsjryuu7
  • Youngstown
  • rosin
  • InstantRegret
  • slotface
  • mdbf
  • PowerRangers
  • tsrsr
  • kavyap
  • khanakhh
  • vwfavf
  • Leos
  • ngwrru68w68
  • ethstaker
  • everett
  • modclub
  • Durango
  • GTA5RPClips
  • osvaldo12
  • cisconetworking
  • tacticalgear
  • normalnudes
  • cubers
  • tester
  • anitta
  • All magazines