I'm going both Blacksmith and Clothier. I have zero problems harvesting more than enough plant fiber for light armor, and more than enough ore for heavy armor.
But I've found it's really quite a grind coming up with enough leather for a full set of medium armor.
Is it just me?
The funny thing is, while grinding specifically for medium armor mats, I always wind up with so much more ore and plant fiber just by stopping to harvest in between bear/wolf/skeever kills....