A bit of both. It really depends though on how I'm feeling and how good my connection is. It also depends on whether it's actually worth trying to PvP. If it's three bars against one/none in Cyrodiil, then I won't bother with it.
So I guess I'm mainly PvE, but hey. I like PvE and PvP. So I try and do a bit of both equally.