Happened 3 times at different forts. Every time I summoned a ballista to attack a gate, and once the gate was destroyed, I pressed Left Alt to exit the ballista and couldn't move.
While in this state, I can still mount, dodge and attack, but the movement keys do not work.