Yes, in the same way that Mastodon and Lemmy federate at the moment. It’s all using ActivityPub underneath, which is the protocol of the Fediverse essentially.
You can’t follow individuals with Lemmy but you can see Mastodon user’s comments on posts and Mastodon users will see your comments and posts on Mastodon with certain hashtags, I believe.