This is a known issue that was partly addressed in patch 1.4.5 on September 20, 2014. However, the hotfix we deployed was only targeted at the locations players teleport into in Cyrodiil (specifically when doing so via the UI, and only this method of entering the zone) and cannot account for character swapping. As such, it is still possible for this error to occur in other locations. Future updates to help address this issue are planned.
To work around this on your affected character, enter a nearby "indoor area" (buildings or cave entrances that cause a load screen to happen) or quit and restart the client.