paul,
@paul@oldfriends.live avatar

Like clockwork, on Wednesdays, my Sidekiq pull Queues jump to 3K most of the day. After a half a day or so, it comes back around.

I wonder if there is a post dump by a bot or some task my server is doing? I am thinking a weekly task must be running.

I need to dig into my logs, crons, etc.

.

ThaMunsta,

@paul hmm over the last month I do see about 20k more processed tasks than, let's say... Saturday or Sunday which seem to be quieter days. If you look at daily is it significantly more variance for you?

paul,
@paul@oldfriends.live avatar

@ThaMunsta Sunday is my slowest day, Friday my loudest. But Wednesday, it is the only day where there seems to be a bottleneck and it is much quieter than Friday. Much, much quieter. It's like a dump of posts all at once on Wednesday.

ThaMunsta,

@paul oh interesting. I have needed to add a few domains to a DNS rewrite because the jobs would time out. When there are a lot of timeouts it has clogged my queue before. I also had a disk scrubbing task slow IO down enough to clog it. Both were annoying to try and track down the cause.

paul,
@paul@oldfriends.live avatar

@ThaMunsta

I got my sidekiq log ( journalctl -u mastodon-sidekiq -S-12h --no-tail > mastodon-sidekiq12hours.log ) from the journal and there were several hundred timeouts from RedownloadMediaWorker in my pull queue during the bottleneck.

Some 10 to 30 seconds long.

DemocracySpot,
@DemocracySpot@mstdn.social avatar

@paul 🤓

paul,
@paul@oldfriends.live avatar
DemocracySpot,
@DemocracySpot@mstdn.social avatar

@paul 😉 😘

  • All
  • Subscribed
  • Moderated
  • Favorites
  • random
  • DreamBathrooms
  • ethstaker
  • osvaldo12
  • magazineikmin
  • GTA5RPClips
  • rosin
  • mdbf
  • Youngstown
  • Durango
  • slotface
  • everett
  • kavyap
  • InstantRegret
  • thenastyranch
  • provamag3
  • tacticalgear
  • modclub
  • cisconetworking
  • tester
  • cubers
  • khanakhh
  • ngwrru68w68
  • normalnudes
  • megavids
  • anitta
  • Leos
  • JUstTest
  • lostlight
  • All magazines