Fidelity mode just has too many issues, between crashes, constant FPS drops in any form of group content and barely, if any noticeable visual upgrades compared to Performance.
The only downside of Performance mode right now is the combat text being a complete mess thats being pushed to the side, but once that fixed Performance is obviously the way to go.