I think you are making a distinction between 'technically accurate' vs. 'conceptually adequate'. Conceptually there are many different ways to describe.
Your description tells how Fediverse is perceived now. But both servers and apps are not 1st-class citizens in the conceptual architecture.
"Activity exchange between actors in a distributed social network" may also do.
(And turn first two words to "Message exchange" to be protocol independent.)