It happens to me too, it happens to a lot of people but interestingly enough not to everyone. Its a problem with ESO itself or the servers they use but the staff refuses to take accountability for it to try to save face after their terrible track record of bugs.