I don't know if this is what happens for you, but there is a bug where the game thinks you are charging up a heavy attack and slows you down accordingly. It is easily fixed by really charging a heavy attack. Just try and see if that works the next time you run into this problem.