The documentation for groups, has a section that explains server vs client functions for groups, says server api needs only developer secret key and can perform any actions.
Last section at: https://learn.microsoft.com/en-us/gaming/playfab/features/social/groups/quickstart
I haven't found a way to remove members from groups from my custom backend (Azure Functions Cloudscript), because it always says that the entity is Unauthorized to remove members (using the PlayfabGroupsAPI.RemoveMembersAsync with a dummy Authentication Context).
PlayFabServerAPI doesn't have a method for removing group members, neither does PlayfabAdminAPI.
Any help is appriciated.