This has been a problem for me for months, in every zone (M1 iMac). Originally I thought it might be a bugged add-on, but even after fully disabling all add-ons, the issue persisted. After this much time, I just deal with it.
Same, 2011 iMac. Been like it for months.
I run ESO on Windows now on a bootcamp partition.
All the issues that are horrid on the Mac disappear in Windows. So it's not a hardware issue is it? Just a not-very-good Mac implementation.