The solution to this is Authorized Fetch. It trades a little bit of efficiency (individual AP messages being re-shareable by intermediaries) for proper authorization (every server must fetch the messages directly from the source, with the correct authorization). Mastodon implements it behind an env variable, and implementations like GoToSocial force it. No idea how kbin or Lemmy work but they should look into it.