The whole purpose of housing is making a place to spend time and enjoy even after decorating, like in Skyrim. Yes, I know this isn't Skyrim, but that was the model people were expecting from ZOS for housing.
In that spirit, we need to be able to access our bank, or at least store items in the house in an unlimited number of containers, including furniture.
We need to be able to to access the guild store and guild bank in order to truly make them guild halls where guild members will want to hang out, craft, and enjoy the company of other players.