I just finished all of the towns this weekend. Some of them I was alone, other times a friend of mine joined me. For a little while we had "company" of the red or blue persuasion. Here eventually it's always the same though. People that are doing quests in the towns fight at first generally, as long as it's a fairly even match of players they tend to give that part up and go on about the quests. Bruma can be the most fun for that once that point is reached and you find three colors of players running around doing fetch quests and jumping on a dolmen. Which is what happened this weekend. Get a few kills, do a few quests, get some random junk from a container. Good times.

That all said, in general I agree with you. If you don't want any PvP don't do those quests. It's a risk/reward of doing them though. Maybe you'll get into a fight, maybe you'll find no one. Either way though, expect there to be action along the way.