@mick@cosocial.ca
@mick@cosocial.ca avatar

mick

@mick@cosocial.ca

Average middle-aged guy from various places in Ontario.

Collector of various nerdly interests.

Into #running, #books, #chess, #videogames.

At least a little bit #buddhist. Trying to lead an examined life.

I believe that we have the right to safe digital spaces where we can build communities free from corrosive capitalist influence.

Working to build a sustainable, non-corporate web as a volunteer with #CoSocialCa

Posts auto-delete after 2 months.

This profile is from a federated server and may be incomplete. Browse more on the original instance.

mick, to random
@mick@cosocial.ca avatar

For the first time the Mastodon server has started to struggle just a little bit to keep up with the flow of the Fediverse.

We’ve usually been “push” heavy but we’ve started to see some spikes in “pull” queue latency. The worst of these spikes was today, where we fell behind by at least a couple minutes for most of the afternoon.

1/?

A pair of graphs showing sidekiq queue latency and enqueued jobs. The queue latency peaked at around 6 minutes at roughly 6pm this afternoon, but was between 1-2 minutes most of the afternoon. The maximum number of messages in queue at any one time was 12000. The majority of the traffic is pull queue.

mick,
@mick@cosocial.ca avatar

This is great! It’s exciting to see our community growing.

I’m going to make a simple change to see if we can better keep up.

The system that we’re running on has plenty of headroom for more sidekiq threads.

2/?

mick,
@mick@cosocial.ca avatar

For anyone interested in understanding the guts of Mastodon, I have found this article from Digital Ocean very helpful: https://www.digitalocean.com/community/tutorials/how-to-scale-your-mastodon-server#perfecting-sidekiq-queues

Eventually we’ll grow so big that we’ll need oodles of sidekiq queues and we’ll want to be able to customize how many types of them we want, and will run them as jobs across multiple servers and so-on.

But for now I’m just going to make the number of threads slightly bigger and see what happens.

3/?

mick,
@mick@cosocial.ca avatar

@thisismissem Yes I caught that. Not going near streaming. It’s about the best description of sidekiq I’ve found anywhere though.

If there are other good resources that are more up-to-date please share.

  • All
  • Subscribed
  • Moderated
  • Favorites
  • •
  • provamag3
  • rosin
  • normalnudes
  • everett
  • DreamBathrooms
  • ethstaker
  • magazineikmin
  • thenastyranch
  • Youngstown
  • GTA5RPClips
  • slotface
  • khanakhh
  • vwfavf
  • kavyap
  • megavids
  • mdbf
  • Leos
  • Durango
  • tacticalgear
  • InstantRegret
  • cubers
  • osvaldo12
  • ngwrru68w68
  • anitta
  • tester
  • modclub
  • cisconetworking
  • JUstTest
  • All magazines
    •