Well, atleast ur enemy have the same troubles, so it's kinda balanced I think.
Not always. At least not at the same time. You can get desync at the start of the fight, they can get desync on the end. That's the frustrating part. It's like RNG on who is going to win with odds increased by number of players on your side and APM is out the window. But let's worry about APM.