If you want to do damage, don't wear heavy armor. You need the crit and resource bonuses from light or medium armor or you'll be relying too much on basic attacks.
It's not the attribute points that matter. Medium and light armor give you resource regeneration, reduced resource costs, and extra critical strike chance. You can't really get those stats anywhere else.
If you want the heavy armor look, use 2 heavy (chest and shoulders) with the rest medium or light, or find a disguise to wear.