Seems like the 5pc bonus for the Daedric Trickery set is a bit bugged. If you're mounted and happen to get tapped by an NPC or ride to close (get pulled into combat) then 5pc bonus kicks in and the random buff causes you to dismount. Not sure the 5pc bonus is mean to negate the stamina riding training, hah.