This, use that you find best, mouse accuracy and speed is not very important in ESO at least not pve.I use keyboard and mouse for all my gaming but that's because I will also have forums and stuff open on a second screen and tab to that when waiting for things.
If you're better with a controller though there is no reason not to use one.