Constant disconnects when traveling directly between houses

Shantu

Experiencing frequent disconnects when doing the following:

1. Travel to your house.
2. While at your house, travel to someone else's house by selecting their name on a guild roster and selecting "Visit Primary Residence".
3. While at the other players residence, open the map and travel directly back to your house.

I do this frequently to change Mundus stones at the guild house. Disconnects me nearly every time with some "cannot connect to server" error.