You can remove them from all allies in the settings menu, however I don't think there is an option to remove self only.
There could be an add-on for it if you haven't checked already.
@Turelus - EU PC Megaserver "Don't count on others for help. In the end each of us is in this alone. The survivors are those who know how to look out for themselves."