You got me curious, so I logged in with one of my PCEU alts who has a staggering 6419 magicka recovery, just to check this out.
But no. Recovery seems to be working as it should - although I don't have the numbers display enabled, on this character I can easily tell if my mag recovery is unusually low (ie. when buff food runs out), yet I noticed no such thing.