Yep. Reading the spec gave me the impression that the authors wanted to create something that can do literally everything, not realizing that that makes it impossible to “fully” implement the spec.
Does your application correctly render when I dislike the fact that a user removed a file from a group? That’s something you can represent in ActivityPub.