I think this is one of those unsolvable infrastructure problems inherent to the structure of federation itself. Like, you can either have federation or private posts, but you can't really have both.
I also think the answer to needing closed groups is to return to forums, but that's ever more of an uphill problem these days than getting normal people on fedi, so I understand the frustration.