Quite happy with the speed of the background task that ingests #ActivityPub data sent to #PieFed from other servers. Most Activitys are processed in around 0.1 seconds, average of 0.22 seconds, or ~5 per second. This is with just one worker process.
If a 4 core VPS can handle 6(?) worker processes/threads it'll do 6 * 5 = 30 per sec.
Glad to report that I've figured out what was causing some activities to spike to up to 1.4 seconds and fixed it. That should bring the average down to 0.1 seconds, or 10 Activities processed per second. Decent!
When an Activity arrives if it's the first time one from that instance or that user has arrived, there are a few extra network requests PieFed needs to make to ensure the Activity data is fully fleshed out. Fortunately most of them can be deferred to future background tasks.
Add comment